- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates whether image editing RL can be performed without a dedicated editing reward. It trains a Lever module that converts a source image and an editing instruction into a complete target-state description, and then uses mature T2I reward models to evaluate edited images. Lever training combines target-state alignment, source-target contrast, preference calibration, and semantic/distributional anchoring.
Critical strengths
The paper studies an interesting and potentially impactful problem: whether the mature T2I reward ecosystem can be reused for image editing, thereby reducing the cost of constructing dedicated editing rewards. The Lever-Calibration and Lever-Anchoring components provide a useful discussion of reward alignment and reward hacking. Experiments with multiple editing backbones and captioners provide some evidence of transferability.
Critical weaknesses
-
A Lever-generated caption may still describe the global image correctly, while the T2I reward only evaluates overall image-text alignment. It may not understand that a specific local region should remain unchanged. The paper should construct fine-grained source-edit consistency tests and compare the transferred T2I reward with a genuine source-edit reward.
-
The claim that editing rewards are unnecessary is somewhat broader than what the experiments establish. Lever training still relies on editing data, successful/failed edit pairs, and editing-specific calibration examples. The evaluation also uses editing-specific metrics such as EditScore. A comparison with a directly trained editing reward under matched data and computational budgets would clarify the actual savings.
Questions for authors
See Critical Weaknesses
Dear Reviewer Pygn,
We sincerely appreciate your time and effort in reviewing our work. We have done our best to address the concerns you raised, and we would greatly appreciate it if you could kindly share your thoughts when time permits.