- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper optimizes structured natural-language guidance for a VLM critic in multi-round text-to-image generation. The guidance addresses repair actions and their ordering and is refined using trajectory feedback while all model weights remain frozen. Experiments on GenEval, GenEval 2, and ConceptMix show improvements over IRG.
Critical strengths
The method uses feedback from previous repair trajectories to refine reusable critic guidance while keeping all model weights frozen.
Critical weaknesses
- The specific contribution of the structured skill design is not sufficiently established. Although the component-removal ablations show that action and ordering guidance contribute to the final system, they do not isolate the benefit of the prescribed structure over critic-instruction optimization without that structure, using the same trajectory feedback and optimization budget. In addition, the rationale for choosing 25 training examples and 25 validation examples, and the procedure used to select or construct them, are not clearly described. Further details would help assess the design of the optimization data and improve reproducibility.
- Generalizability across generators and editors remains untested. The proposed method is evaluated only with Qwen-Image and Qwen-Image-Edit. Since effective repair actions and ordering may depend on these models’ capabilities, it remains unclear whether the learned guidance transfers to other generator–editor combinations, or whether repeating the optimization with those models yields similar improvements. This limits the evidence for the method’s broader applicability.
Questions for authors
- Can the critic combine multiple repairs into a single editing instruction? EdiVal-Agent [A] reports higher instruction-following success for single-shot multi-instruction editing than for sequential editing with Qwen-Image-Edit under its evaluation protocol. Has the paper compared jointly addressing multiple errors with addressing them sequentially according to the learned repair ordering? Reporting both final constraint satisfaction and editing cost would help clarify when explicit repair ordering is beneficial.
- What motivated the choice of 25 training examples and 25 validation examples? How were these examples selected or constructed, and what considerations guided their coverage of failure types and difficulty levels?
- Could the proposed skill structure and optimization procedure be adapted to improve other aspects of text-to-image quality, such as aesthetics?
[A] Chen et al. EdiVal-Agent: An Object-Centric Framework for Automated, Fine-Grained Evaluation of Multi-Turn Editing. ICLR 2026.