- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes EditThinker, a plug-and-play image-editing framework built around an 8B vision-language model (VLM). Given the source image, original editing instruction, and current edit, the Thinker generates an analysis of editing failures, semantic-consistency and perceptual-quality scores, and a refined instruction. The underlying image editor remains frozen and applies each revised instruction to the original source image. The authors construct the ThinkEdit-167k dataset and train the Thinker using supervised fine-tuning (SFT) on expert demonstrations followed by GRPO with rewards based on actual editing outcomes. Experiments across four image-editing benchmarks and multiple editors report improvements in aggregate performance, along with ablations on reward configurations, model design, data partitioning, and iteration budgets.
Critical strengths
-
A practically relevant problem and a reusable framework. The paper addresses cases in which edited images appear plausible but fail to satisfy the requested changes. Refining instructions through visual feedback without modifying the underlying editor is a potentially useful and broadly applicable approach.
-
Broad evaluation with targeted ablations. The authors evaluate the framework across multiple editors and four benchmarks, and examine SFT/RL, the joint Critic-Refiner design, output ordering, and iteration budgets. The reported results support the overall effectiveness of the framework on several editing tasks.
Critical weaknesses
-
The distinction from recent related work is not sufficiently clear. MIRA (Zeng et al., CVPR 2026 Findings) also uses a plug-and-play VLM, visual feedback, and SFT+GRPO for iterative image editing. The authors should clarify the specific benefits of the joint Critic-Refiner design and full-instruction rewriting, ideally through comparisons using the same editor and editor-call budget.
-
The critique and refinement capabilities are not directly evaluated. As the Introduction states, “A VLM may correctly describe an editing error yet suggest a revision that the same editor cannot realize” (Section 1, p. 2). However, the experiments mainly report final editing quality. It would be useful to measure the prediction error of the Thinker's score output, as well as the improvement rate and magnitude after executing its answer instruction.
-
The distinct role of the Edit Reward remains unclear. If candidates in a GRPO group share the same previous editing result, the quality-difference reward may be equivalent to an absolute-quality reward after standard group-wise normalization. The authors should clarify the implementation, compare the two reward formulations, and report single-step improvement rates before and after RL.
-
Quantitative analysis of per-round editing quality is missing. Table 3(b) compares iteration budgets and Best-of-N selection, but does not show whether quality improves consistently across rounds. Given the degradation examples in Appendix G, the authors should report improvement/degradation rates and the score gap between the best intermediate result and the final result.
-
End-to-end inference costs are not quantified. The authors acknowledge that editor-call counts exclude VLM computation. Reporting the end-to-end latency of the Thinker and Editor, the time spent in each component, and the hardware configuration would make the efficiency analysis more complete.
Questions for authors
None