- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces ETCHR, a framework that decouples image editing from visual understanding to enable MLLMs to "think with images." Addressing the limitations of tool-based methods and unified models, ETCHR employs a dedicated, question-conditioned image editor trained via a two-stage recipe: Reasoning Imitation to map abstract questions to visual transformations, and Reasoning Enhancement using VLM-derived rewards for edit correctness and downstream utility. The system further incorporates an Edit-Verify-Reason inference pipeline where the understanding model validates edits before use. Experiments across five task families demonstrate consistent Pass@1 improvements over baselines when paired with various open- and closed-source MLLMs. However, despite these overall gains, the evaluation lacks a granular, task-stratified analysis of editor-specific failure modes and does not sufficiently validate the reliability of the verification mechanism against human judgment, leaving concerns about error propagation and the true contribution of the editing module unresolved. Should the authors address these concerns, I would consider raising my score.
Critical strengths
-
Clear presentation. The paper is generally well-structured and clearly presents the proposed framework, training pipeline, and experimental results, making the method relatively easy to follow.
-
Good decoupling properties. Decoupled design avoids unified-model trade-offs and preserves editing fidelity. Its plug-and-play editor works across diverse MLLMs without fine-tuning, delivering consistent benchmark gains.
Critical weaknesses
1.Insufficient Analysis of the Editor's Contribution and Failure Modes. Although the paper reports overall performance improvements, the experimental analysis does not sufficiently isolate the contribution of the proposed editing module or explain its task-dependent behavior. In particular, the paper provides qualitative examples, but lacks a systematic, task-stratified analysis of editing failures and their downstream effects to establish when and why editing benefits downstream reasoning, and when it introduces detrimental visual changes. More systematic task-level ablations and qualitative analyses are needed to distinguish failures caused by incorrect edits from those caused by the downstream VLM's inability to exploit otherwise useful edited images. Comparisons with controlled editing baselines would provide stronger evidence for the claimed contribution of the editor.
2.Insufficient Validation of the Edit Verification Mechanism. The Edit-Verify-Reason pipeline relies on an VLM to assess the validity of generated edits, but the reliability of this verification step is not sufficiently established. Since VLM-based verifiers may exhibit hallucinations, false acceptance of incorrect edits, or false rejection of valid edits, the verification mechanism may fail to prevent error propagation. The paper would benefit from a dedicated evaluation against human-annotated edit-validity judgments. Further comparisons between verification-enabled inference, verification-disabled inference, and fallback-to-original-image strategies would clarify whether verification reliably improves downstream reasoning. The authors should also discuss the potential for correlated errors between the verifier and the downstream understanding model, and investigate whether structured constraints or independent verification signals can improve reliability.
Questions for authors
Please refer to "Weaknesses" above.