- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
The paper presents MT-OPSD, an on-policy self-distillation framework for multi-turn image editing. In multi-turn editing, every round after the first is conditioned on the model's own generated output rather than on a real image. This creates a train–test discrepancy (exposure bias) and causes errors to compound across editing rounds. To address this, the authors train the model directly under these exposure-bias conditions using a dual on-policy strategy. A student model learns both to avoid drift when given an "identity" (no-op) edit instruction and to perform edits correctly from an already-drifted input. The teacher is the same model, conditioned instead on a clean image. The authors also introduce a benchmark for long-horizon multi-turn image editing. They demonstrate empirical improvements over several multi-turn editing baselines across three different editing backbones.
Critical strengths
- The paper is well written and easy to follow.
- The approach appears novel and generally effective. Several non-trivial design choices, such as gated promotion and on-policy training, are well supported by the ablation studies.
- The proposed long-horizon benchmark is a valuable contribution that could benefit future research on multi-turn editing.
- The method generally outperforms competing approaches at longer editing horizons, which is the regime the paper specifically targets.
Critical weaknesses
-
Motivation -- Table 1 suggests that recent proprietary models do not suffer from the stated issue. GPT-Image-2 and Nano Banana Pro both achieve near-perfect scores on the proposed LME-Bench, which may indicate that the problem is already largely solved.
-
Results on the pre-existing protocols (MSE-Bench and ImgEdit) are not very convincing. On Flux2-klein, there is hardly any improvement over the base model, and on Qwen and FireRed, Emu Edit outperforms or closely matches the proposed method in almost all turns. This makes it unclear whether the gains on LME-Bench carry over to other evaluation settings.
-
The qualitative results show only a subset of the turns, which makes it difficult to assess prompt adherence and overall edit quality across the full editing sequence. Showing all turns, at least in the supplementary material, would help.
Questions for authors
Please address the weaknesses listed above. In addition, I have the following questions:
-
The rollouts appear to use a fixed sampling recipe (number of sampling steps, guidance scale) throughout training. Does performance hold under different sampling configurations at test time, or is the method tied to the recipe used during training?
-
The paper motivates L_id by arguing that asking a single edit to both correct accumulated errors and apply the intended change is too difficult. However, L_edit seems to require exactly this. Because the teacher is conditioned on the clean image, the student must produce a clean edited image from a drifted input, which means performing both restoration and editing. This appears to undercut the motivation for L_id, and the two terms seem to define conflicting targets: should the model edit the image it is given, or the "clean" image? Could you clarify how these two objectives are meant to fit together?