- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2(+1)
- Soundness
- 3
Read review
Paper summary
This paper introduces GEMS, an agentic framework for text-to-image generation. The framework includes an iterative generate–verify–refine loop, trajectory memory, and reusable domain skills. The authors evaluate GEMS across five mainstream benchmarks and four downstream tasks using different text-to-image models. The results demonstrate consistent performance gains over the original generators.
Critical strengths
-
The authors evaluate GEMS with two image generators across five benchmarks and four downstream tasks, showing consistent improvements. Experiments with Qwen3.5-27B as an alternative MLLM also yield comparable results on GenEval2, providing further evidence of the framework's generalizability.
-
GEMS outperforms CRAFT on GenEval2 (63.5 vs. 55.2) while requiring fewer images per prompt (2.80 vs. 2.83). Combined with the inference cost analysis in Appendix C.3, this suggests that the gains are not simply driven by more generation attempts.
Critical weaknesses
-
The Agent Loop closely resembles CRAFT's iterative verification and refinement process. However, the baselines do not receive the same domain skills. A skill-matched comparison is needed to show that GEMS’s design improves over existing frameworks.
-
Figure 4 shows that retaining historical prompts, feedback, and images already improves GenEval2 from 52.4 to 59.8, while compressed experiences further increase it to 61.4. Since the Compressor also generates new strategic guidance, the contribution of compression itself remains unclear.
Questions for authors
-
Could the authors compare GEMS with existing refinement frameworks (e.g., CRAFT) using the same automatically selected domain skills to better isolate the contributions of Agent Memory and the refinement design?
-
Could the authors provide an ablation that separates the effect of experience compression from the additional strategic guidance generated by the Compressor?
-
Many in-text citations are incorrectly formatted, with missing parentheses around author-year citations (e.g., "inference-time scaling Hao et al. (2023)" instead of "inference-time scaling (Hao et al., 2023)"). Please correct the citation formatting throughout the paper.