- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper identifies caption coverage—the proportion of multi-object training images whose captions name multiple objects—as an actionable factor in diffusion models’ compositional ability. Its central contribution is to distinguish learning individual visual concepts from learning to interpret several object descriptions jointly in one prompt. By varying captions while keeping images fixed, it clarifies why exposure to complex scenes alone may not teach reliable multi-object generation. The work connects this gap to how models route object-specific conditioning and explains how architecture and sampling influence the supervision needed. It gives the community a measurable target for dataset auditing and recaptioning, alongside a framework for distinguishing failures of visual concept knowledge from failures of joint prompt interpretation.
Critical strengths
- This paper takes a look back the the fundamentals of the diffusion models. It delves into the topic of caption coverage, focuses on the object level accuracy and coverage, providing a complimentary perspective of the image-caption alignment.
- Training is constructed on the controlled dataset, providing an in-depth analysis of the diffusion models from scratch instead of simply peeking the pretrained models.
Critical weaknesses
- The author is recommend to clearly identify the range of discussion. It is better to clearly confine your discussion under traditional transformer-based diffusion models without external harness or agentic systems, as it will be a completely differenty story if an agentic system providing layout is available by the side.
- Is the conclusion really generalizable to prevailing diffusion models, if we conduct the experiments on the synthetic datasets like CLEVR, ShapeWorld and MS-COCO, as the distribution of the former two is completely different from the from the data source training modern diffusion models, such as LAION. The author is recommended to extend his conclusion to the prevailing pretrained diffusion models w.r.t. the dataset statistics and their actual performances.
Questions for authors
- Actually concepts have correlations. How can the authors seaprate the contribution to the explicit mentionings of the object, and the objects contained in the descriptions of the backgrounds? (e.g. Even in a description such as
A dinning room with a round table, it is highly likely that the generated image would contain chairs inside. ) - Can the authors extend their discovery or their proposed method to other concepts in generation, such as style, color and texture?
- What does the distinction (note that this is not equivalent to the difference) lies between conditioning (Farid et.al, 2025) and captions, as the majority of the conditioning lies in text, and what is the difference between this paper's contribution and confining Farid et. al into caption only? Does the analysis of this paper really offer a complimentary perspective?
Note that I will adjust my evaluation based on the author's rebuttal.