- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies structural repertoire discovery for compositional text-to-image generation. It proposes Archive-Guided Structural Illumination (AGSI), a training-free search method that uses control layouts to prioritize unexplored structural niches while updating its archive only from feasible generated outputs and their measured structure. Experiments on spatial relations and exact counting show improved structural coverage across two benchmarks (GenEval, T2I-CompBench++) and two controllable generators(GLIGEN, InstanceDiffusion). Ablation studies support the benefit of using realized rather than intended structures to guide search.
Critical strengths
- The paper proposes a clear and useful objective on how to uncover diverse realizations that satisfy the same compositional constraint, offering users more structural choices rather than a single best image.
- The proposed training-free method AGSI is simple, which uses inexpensive layout proxies to select candidates and actual generated outputs to update the archive. It can be combined with existing layout-controlled generators.
- The paper is well-written and easy-to-follow.
Critical weaknesses
- The evaluation seems to be limited to a coarse, handcrafted definition of structural diversity: Diversity is measured using two handcrafted geometric descriptors and nine bins. Greater coverage does not necessarily imply more meaningful visual diversity.
- Modest gains over baselines, and baselines (stable diffusion v1.5) are outdated. On the main spatial-relation task (Table 1), AGSI discovers only about 0.39 additional niches out of nine compared with Proxy-Balanced after 64 generations.The performances seems to be incremental compared to the outdated baselines.
- Lack of efficiency analysis: Although Table 10 reports UNet evaluation counts, end-to-end runtime comparisons with the main search baselines are missing. The analysis of efficiency helps to assess practical efficiency.
Questions for authors
- Do the gains still hold with different bin boundaries, finer grids, or alternative structural descriptors? This would help establish whether the improvement extends beyond the chosen 3×3 archive.
- What is the total runtime of AGSI compared with Proxy-Balanced and BOP-Elites, including candidate selection and image evaluation? Does its advantage remain under a matched efficiency budget?