- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
ToolArtist post-trains Emu3.5 for knowledge-grounded image generation through reasoning, external search and native visual output. It uses teacher trajectories for SFT, then applies GRPO with caption-intent and image-quality rewards to text and image tokens. The proposed policy also permits further search and redrawing after an image has been generated. Evaluation covers WISE and WorldGenBench-Humanities.
Critical strengths
-
Factual image generation is a useful application, and adapting both evidence acquisition and visual synthesis to the task is a reasonable direction.
-
The system reports competitive results, especially on WorldGenBench-Humanities. The WISE improvement from 0.74 after SFT to 0.79 after RL supports the effectiveness of the overall RL recipe. The source-summary ablation also offers a useful finding about retrieval quality.
Critical weaknesses
-
Limited novelty. Unify-Agent already integrates search, grounded recaptioning and native image generation within a unified model. The proposed workflow mainly adds a post-generation review and refinement loop. The RL formulation also offers limited methodological novelty: it uses GRPO with text-intent and image-quality rewards, a combination already used by Gen-Searcher Extending the updates to image-generation tokens changes the scope of optimization, but does not introduce a distinct optimization method. Overall, the contribution appears to be an incremental combination of existing ideas, which falls short of the claimed new paradigm. What substantive methodological advance goes beyond these extensions?
-
The experiments do not establish the value of the added components. The WISE improvement from 0.74 after SFT to 0.79 after RL supports the complete training recipe, but does not show that updating the generator is beneficial or that reviewing and revising generated images helps. There is neither a control that disables the review loop nor a frozen-generator baseline that optimizes only search and captions. Comparisons with other systems also change the backbone, data and retrieval tools. Could the authors isolate these two additions under comparable settings, reporting image quality before and after revision and the additional generation cost? These controls are central to assessing whether the limited methodological changes offer a meaningful practical improvement.
Questions for authors
See Weaknesses.