- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper presents an empirical study of color annotations in text-to-image pretraining. The authors compare two annotation strategies: Pixel, which extracts region-level color palettes using K-means clustering, and Predicted, which employs a fine-tuned multimodal captioner to predict object colors and generate color-enriched descriptions. An additional Predicted-Leaf configuration is introduced to examine the effect of reduced palette exposure.
Critical strengths
-
The paper investigates a practically relevant problem concerning the role of color annotations in text-to-image pretraining.
-
The experiments cover several aspects of color generation, including numerical color fidelity, object-color binding, compositional generation, and sensitivity to color conditions.
Critical weaknesses
-
Limited methodological novelty and insufficiently developed research contributions. The proposed annotation strategies largely rely on established techniques, including K-means clustering for palette extraction, multimodal captioning for semantic color descriptions, and structured conditioning for diffusion models. The paper does not introduce a substantially new learning algorithm, architecture, or color representation mechanism.
-
The experimental comparisons do not isolate the effects of color annotation strategies. This is my primary concern. The Pixel and Predicted configurations differ in several important factors beyond how color palettes are obtained. Specifically, their textual descriptions, frequency of explicit color words, palette lengths, and potentially their region layouts are different. For example, Table 7 shows that the percentage of descriptions containing color words increases from 59.6% in Pixel to 82.8% in Predicted, while the average number of palette entries per element decreases from 4.98 to 1.86. These differences can independently affect both language-conditioned generation and numerical color accuracy.
-
The conclusions regarding palette dependence are not sufficiently convincing. One of the central findings is that the Pixel configuration performs substantially worse when numerical color annotations are removed. However, this observation is not particularly surprising because the model is trained to exploit precise numerical color conditions.
Questions for authors
Can the authors provide controlled ablations in which the region layouts, descriptions, palette lengths, and color-word frequencies are fixed, while only the palette extraction strategy changes?