- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper introduces a large-scale text-image dataset under permissive licensing with a specified validation and test set. This dataset can be used to test future works around text-image generation under a controlled setting. Do provide an initial baseline the paper also provides results of a diffusion text-to-image model trained on the dataset.
Critical strengths
The paper observes that there is no generally available large-scale text-image dataset with permissive licensing available. This makes it difficult for generative approaches to be compared fairly, since many approaches train on different kinds of data even if they evaluate on the same test sets (e.g., COCO). The new text-image dataset (scale of 100M pairs) seeks to remedy this by providing a fixed data regime under which different generative approaches can be fairly compared. Since all images come under a permissive license the dataset is hosted directly instead of providing URLs (which is common for other datasets but leads to dataset rot since the URLs might not be available at a later time). The dataset is filtered for NSFW and deduplicated and comes with captions provided, split into long captions, medium captions, and tags. Additionally, a simple diffusion transformer baseline is trained and evaluated on the dataset to provide an initial baseline of the quality.
Critical weaknesses
The dataset is probably not of the highest quality since a) deduplication seems to have been run at a threshold such that not too many images get removed; I think deduplication should be run such that deduplicates are removed, regardless of how many images that removes b) only basic aesthetic quality filtering is run on the dataset c) the captions come from a small VLM
Questions for authors
Besides the dataset, can you release all other metadata you already collected, e.g., different captions, the data you used for deduplication, etc. This metadata might be interesting for people who want to explore additional quality filters and how they affect training outcomes.
Is this dataset supposed to be static or will you update it with better captions etc going forward? A lot of quality improvements in generative models come with better data, so always having the best or a high-quality dataset ready will help make sure that other improvements come from actual methodological approaches and not just improved data processing.
Response to Reviewer bE3o
We thank the reviewer for their valuable time and constructive feedback. The reviewer (1) raised concerns about deduplication, (2) commented on aesthetic quality filtering, (3) inquired about captioning model selection, (4) requested release of additional metadata, and (5) inquired about future dataset updates. We address each point below.
GPIC removes all exact duplicates, verified using SHA-256 hashes, and high-confidence near-duplicates identified using SSCD copy-detection features (Section 2.3). Through manual inspection, we found that even image pairs with high SSCD similarity (0.75–0.95) can remain visually distinct, differing in pose, viewpoint, or object identity (Figure E.1). Given the limited availability of permissively licensed data on the internet, we adopt conservative deduplication to preserve these distinct images.
As described in Section 2.2, we remove low-resolution images and those with severe visual defects, including blur, underexposure, and overexposure (Figures 4 and D.1). Our goal is to provide a diverse dataset and benchmark for foundational research in visual generation rather than a dataset optimized for aesthetic preferences. A human audit of 50K randomly sampled images identified 45 images with quality defects (0.09%), indicating a very low residual defect rate.
As explained in Section 2.4, we created a captioning microbenchmark to select a model that balances caption quality and throughput. We compared Qwen3-VL models at 2B, 4B, 8B, and 30B-A3B across five quality criteria (Figure 6, Appendix F). Qwen3-VL-4B achieves comparable overall caption quality to the larger 30B-A3B model (1.68 vs. 1.73), with the highest spatial understanding and attribute binding scores. This quality-throughput tradeoff is important because captioning 100M images requires substantial compute (approximately 1,500 H100 GPU-hours using Qwen3-VL-4B).
To further evaluate caption quality, we measured image–text alignment using Qwen3-VL-Reranker-8B [G], a multimodal reranking model that estimates the probability (from 0 to 1) that an image matches a given text.
Alignment scores are consistent across all three subsets. We additionally conducted a human audit of 50K randomly sampled image–caption pairs from the final GPIC dataset and identified 620 cases (1.24%) with captioning errors. These errors involve counting and spatial relationships in medium and long captions, while the overall scene descriptions remain accurate.
We thank the reviewer for the suggestion. We are happy to release additional metadata collected during GPIC construction. As described in Sections 2.1 and 2.5, GPIC already includes per-image licensing, attribution, resolution, and caption metadata. Each GPIC image is assigned one of four caption formats, so one caption is generated per image (Section 2.4). For deduplication, we will additionally release image-pair identifiers and SSCD similarity scores.
GPIC is designed to remain a fixed dataset and benchmark (Sections 1 and 2.5), since changes in training data prevent fair comparisons across generative modeling methods. We agree that improved captions and data filtering may benefit future research; such improvements are best released as separately versioned datasets, leaving the original GPIC benchmark unchanged. Our evaluation protocol recommends reporting any deviations such as changes to captions (Section 3), keeping comparisons interpretable.
We hope the rebuttal addresses all your concerns. We are happy to answer any additional questions.
References
[G] Li et al. Qwen3-VL-Embedding and Qwen3-VL-Reranker: A unified framework for state-of-the-art multimodal retrieval and ranking. arXiv 2026.