- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes a region-aware on-policy distillation method for local image editing. The method uses an edit-conditioned teacher target inside the editing mask and an identity-conditioned preservation target outside the mask, while additionally restricting teacher supervision to an empirically selected early denoising window.
Critical strengths
(1) The paper aim to address a practical problem in local image-editing distillation: transferring editing capability from a stronger teacher while avoiding unintended changes in non-target regions.
(2) The region-aware supervision is simple and practically appealing: different teacher targets are used inside and outside the edit mask during training, while no mask or teacher is required at inference.
Critical weaknesses
(1) My main reservation is that the temporal component of the proposed method is not convincingly supported by the training results. A central part of the paper is the claim that OPD supervision should be concentrated in the early denoising stage, motivated by the trajectory and model-switching analyses. However, the ablation in Table 2 shows that, with the same region-aware supervision and one sampled state, full-range sampling (0–49) actually achieves better preservation than early-only sampling (0–13), while maintaining the same functional correctness. The main demonstrated advantage of the early window is therefore reduced student rollout length rather than improved editing quality. Moreover, the appendix itself notes that the switching analysis does not establish that early-only OPD is optimal and that a matched-budget comparison is needed. Given that “spatio-temporal alignment” is presented as the central contribution, I do not find the current evidence sufficient to support the temporal part of the claim.
(2) I am also not yet convinced that the empirical evaluation is sufficient to establish the significance and generality of this rather specific modification to OPD. The main effective change is to use an edit-conditioned teacher inside the mask and an identity-conditioned teacher outside it, but the evaluation is limited to a single FLUX 9B-to-4B teacher–student pair and is mainly compared with a relatively simple Base OPD baseline. The related-work section discusses several recent OPD approaches, yet none is included in the main comparison. Since the proposed method is fairly specialized, stronger comparisons and evidence that the gain persists beyond this particular model pair would, in my view, be important for demonstrating a sufficiently broad contribution for ICLR.
Questions for authors
(1) Why is the temporal window fixed to states 0–13? Could the authors provide matched-budget comparisons with middle, late, and full-range sampling?
(2) How are the training masks obtained? How robust is the method to imperfect masks?
(3) Can the authors compare with some more recent OPD baselines mentioned in the related works section beyond Base OPD?
(4) How well does the method generalize beyond the FLUX 9B-to-4B setting? Does it require closely matched teacher/student architectures or latent spaces?