- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates the problem that persistent source-image conditioning may limit editing quality in unified image generation and editing models. The authors observe that different editing tasks exhibit varying degrees of dependence on the source image and that source-image attention changes dynamically throughout the denoising process. Based on this observation, the paper proposes temporarily switching to the T2I mode during certain denoising steps and then restoring editing conditioning to improve editing quality while preserving the original image content as much as possible. Experiments show that the proposed method improves editing quality across three unified models and four benchmarks while maintaining similar average perceptual preservation scores, although it introduces some pixel-level preservation loss.
Critical strengths
-
The paper presents an interesting observation that different image editing tasks exhibit varying degrees of dependence on the source image, and that source-image attention follows different temporal patterns throughout the denoising process. This observation provides valuable insights into the conditioning mechanisms of unified image generation and editing models and offers an intuitive motivation for the proposed task-switching strategy.
-
The paper provides systematic and extensive experimental analyses, covering different conditioning configurations, task-switching intervals and durations, guidance strategies, and the trade-off between editing quality and source-image preservation. Furthermore, the authors evaluate the proposed method across multiple models and benchmarks, providing convincing empirical support for its effectiveness.
-
The paper presents a clear and well-motivated research problem, highlighting how persistent source-image conditioning may restrict the editing capabilities of unified models.
Critical weaknesses
-
The paper's motivation is based on the dynamic changes in source-image attention during a 50-step denoising process and the potential redundancy of source-image conditioning at certain stages. However, diffusion distillation methods such as DMD[1] and DMD2[2] have demonstrated that conventional multi-step denoising can be compressed into one-step or few-step generation, and related works have also applied few-step sampling to image editing tasks. The phenomenon observed in this paper may not exist in one-step or few-step editing processes, which limited the paper's motivation.
-
Temporarily removing source-image conditioning and introducing T2I generation during denoising may lead to unintended changes unrelated to the editing instruction. For example, in the second example of Figure 5, there appear to be unnecessary grass details around the fox, while in the third example, suspicious shadow changes can be observed near the bookshelf. These observations suggest that even after restoring editing conditioning, unintended changes introduced during the T2I phase may not be fully corrected.
-
The proposed method relies on an additional VLM to generate a target caption based on the source image and editing instruction. However, this process may introduce incorrect semantic information or overemphasize details unrelated to the editing objective. Since source-image conditioning is completely removed during the T2I phase, such inaccurate descriptions may further lead to unintended content generation, and restoring editing conditioning in the subsequent stage may not necessarily correct these errors.
-
Although the paper observes that source-image attention varies dynamically throughout the denoising process, the proposed method still relies on a fixed switching interval determined in advance through empirical sweeps. Specifically, they uniformly adopt
[10,16)as the switching interval, while the attention-based selective switching strategy only determines whether to switch, rather than adaptively deciding when to start and end the T2I phase for different images and editing tasks. However, different images and editing tasks may exhibit substantially different dependencies on source-image conditioning, and a fixed interval may not be suitable for all cases. Furthermore, Table 10 shows that the optimal switching intervals vary across models and evaluation metrics. For example, BAGEL achieves its best GEdit overall score with[35,45)rather than[10,16). Therefore, this empirically determined fixed switching strategy may limit the adaptability and generalizability of the method. Further investigation into dynamically determining switching times based on source-image attention would be valuable. -
Although the paper discusses related works such as HiDream-E1[3], SaaS[4], GRAG[5], and RvR[6], the experiments mainly focus on internal ablation studies of different conditioning configurations, switching intervals, and guidance strategies, without direct comparisons with existing methods. In particular, HiDream-E1 has already adopted a staged editing-to-generation refinement approach, while SaaS and GRAG also improve editing quality by adjusting the relative influence of the source image and editing instruction. Therefore, the current experiments are insufficient to fully demonstrate the advantages of the proposed task-switching strategy over these existing approaches. I suggest that the authors include comparisons with relevant baselines under comparable model settings and computational budgets, or further explain why such comparisons are technically infeasible.
[1] One-step Diffusion with Distribution Matching Distillation
[2] Improved Distribution Matching Distillation for Fast Image Synthesis
[3] HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformer
[4] SaaS: Self-Adaptive Attention Scaling
[5] Group-Relative Attention Guidance for Image Editing
[6] Enlarging Modification Space Boosts Image Refinement in Unified Multimodal Models
Questions for authors
Please see my weakness.
5 comments
Thank you for the detailed response. While I appreciate the authors' clarifications, several of my main concerns remain insufficiently addressed, particularly due to the lack of additional experimental evidence. I therefore maintain my original score of 2.
Thank you for following up! We’d like to highlight the new evidence provided in our response:
- Preservation equivalence tests [link]
- A human study assessing human–judge agreement [link]
- Fig. 3 extended to all 3 models, addressing differences in conditioning behavior across models [link]
Could you clarify what additional experimental evidence would help address your remaining doubts about our contributions?
Official Response to Reviewer 6BqA
We appreciate the reviewer’s recognition of our study’s motivation, its insights into source-image conditioning, and the breadth of the experimental analysis. We address each of your concerns below.
Distillation and our study address complementary questions: reducing sampling cost and improving editing through conditioning. We show that changing conditioning along the denoising trajectory improves editing quality. The resulting editor could then serve as a teacher for distillation, without requiring the student to switch as well. Few-step generation therefore does not remove the motivation for studying multistep trajectories. Whether distillation preserves these gains is an interesting direction for future work.
Yes, some minor details can change, including the shadows you noted and the candles on the table. Fig. 5 shows that returning to editing reduces these changes compared to a one-way switch, although it does not restore every source detail. The T2I interval gives the model more freedom to execute the requested edit. When pure editing fails to make the intended change, improved fidelity can be worth a small loss of unrelated detail. We report the preservation costs in §4.4 and examine how interval placement and duration affect this balance.
Our new paired TOST tests comparing fixed [10,16) with pure editing support equivalent mean GPT preservation within ±0.25 points on a 0–10 scale for all 3 models (results). Our human study also shows that GPT largely agrees with human preservation judgments. Together with the fidelity and naturalness gains reported in the paper, this evidence supports that T2I intervals can improve editing quality without a substantial loss of perceptual preservation.
Using a language model to improve generation prompts is established practice, including in DALL·E 3. Such rewriting can introduce errors, but its benefits outweigh these risks, as our E* results demonstrate. In our switching setup, the generated caption guides only a small part of the trajectory, which limits the influence of potential caption errors. We discuss caption errors in §5 as a potential failure mode, but have not noticed them as a recurring issue. Unintended content generation is covered by our preservation evaluations.
We had also explored whether attention statistics available during denoising could guide adaptive interval selection without additional forward passes. The signals we tested were insufficient for reliably choosing interval boundaries, even in a simpler classification task choosing among predefined intervals placed throughout the trajectory. Online exit selection also poses a specific challenge: source attention is unavailable during the T2I interval because the source image is absent. We therefore report timing sweeps and use attention for the simpler decision of whether to apply a fixed interval. We agree that adaptive timing is a valuable goal, but achieving it without increasing denoising latency proved difficult. Using editing–T2I prediction disagreement could help, but evaluating both predictions requires additional forward passes, making this a promising inference-time scaling direction beyond the scope of our current work. Regarding BAGEL’s later optimum, our extended Fig. 3 suggests an explanation for why preferred interval placement differs across models.
HiDream-E1 switches from editor to generator weights. Our E→T2I mode already tests the same editing-to-generation handoff while keeping a unified model’s weights fixed. RvR targets T2I refinement rather than instruction-based editing and requires additional training. SaaS selects layers through OmniGen-specific perturbation analysis; GRAG uses text tokens for Kontext but source-image tokens for Qwen-Edit/Step1X-Edit. Neither specifies these choices for our backbones. We therefore cannot compare these methods directly: RvR requires additional training, while SaaS and GRAG require ambiguous adaptations to our models.