- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes DynEdit, a training-free image editing framework for diffusion multimodal language models. A source branch extracts reconstruction residuals using the masking pattern of the evolving target branch. Prediction disagreement identifies editable tokens, spatial and temporal schedules adjust source guidance, and source-consistent tokens are decoded before editable tokens. Experiments evaluate mask-free and mask-grounded editing on PIE-Bench, PIE-Bench++, and GIDE-Bench, with additional backbone and component ablations.
Critical strengths
-
A coherent editing mechanism with practical value. Synchronizing source residual extraction with target generation allows localization, preservation, and decoding order to evolve together. In the mask-free setting, this removes the need for an external grounding model and provides a useful capability beyond editing within a fixed mask.
-
Meaningful evidence of improved editing–preservation trade-offs. The evaluation includes same-backbone discrete baselines, identical-mask comparisons, generation budgets, and detailed appendix ablations. On PIE-Bench, reported global structure distance improves from 3.84 to 2.81 and latency decreases from 31.1 to 21.3 seconds relative to GIDE. These benefits support the method’s practical contribution, although background preservation is weaker in this setting.
Critical weaknesses
-
The component gains are not fully separated from changes in editing strength. Removing several components reduces alignment while improving preservation, and the schedule ablations show that adjusting guidance can recover similar operating points. Appendix D provides useful evidence for spatial adaptation, but a comparison at matched edit-region alignment would better establish whether the complete mechanism improves the trade-off over simpler alternatives. Eq. 11 also couples residual strength to Gumbel noise amplitude, complicating attribution specifically to source guidance. This affects how much independent algorithmic value can be assigned to the proposed components.
-
The robustness of automatic localization is not sufficiently characterized. Argmax disagreement is discontinuous, and the source and target branches also differ in their visible image context. Previously decoded tokens appear to remain fixed, so an early incorrect decision may prevent a required edit. The process visualizations demonstrate successful examples but do not establish how often this failure occurs. Since reliable automatic localization is a central benefit over fixed-mask editing, this uncertainty matters to the method’s applicability.
Questions for authors
- At comparable edit-region alignment, does DynEdit retain better preservation than GIDE or the principal ablated variants? A limited comparison using existing PIE-Bench results or a small guidance sweep would address this question.
- Do the adaptive-guidance gains persist if Gumbel noise amplitude is held fixed across the compared variants?
- Can previously decoded tokens be reopened? If not, what evidence characterizes failures caused by early localization or fixation errors?
7 comments
[W1 & Q2]. Adaptive guidance with fixed Gumbel amplitude
We thank the reviewer for this suggestion. As clarified in revised Appendix B (lines 847–855), the complementary weighting between source-residual guidance and Gumbel noise in Eq. (11) follows the stochastic fusion formulation adopted in GIDE [GIDE Sec. 3.1 and Algorithm 1]. DICE similarly adopts complementary coefficients to simplify hyperparameter selection [DICE Appendix E.2].
This is an empirical parameterization that jointly controls source-residual correction and sampling stochasticity through a single coefficient, rather than a theoretically required coupling. DynEdit follows this formulation and focuses on making the coefficient spatially and temporally adaptive.
To examine whether the effectiveness of our adaptive guidance depends on this complementary weighting, we conduct additional experiments with a fixed Gumbel noise amplitude of 1, while retaining the adaptive source-residual guidance.
We report both the influence of initial guidance strength and the ablation of adaptive guidance components under this alternative formulation.
1. Influence of initial guidance strength.
Table 3. Effect of initial guidance strength with complementary and fixed Gumbel noise on PIE-Bench. All experiments use 64 steps and cosine guidance decay.
| Initial Guidance | Original | Fixed Gumbel | ||||||
|---|---|---|---|---|---|---|---|---|
| CLIP-G ↑ | CLIP-E ↑ | BG PSNR ↑ | Dist. ↓ | CLIP-G ↑ | CLIP-E ↑ | BG PSNR ↑ | Dist. ↓ | |
| 0.6 | 25.77 | 22.75 | 21.66 | 3.44 | 25.91 | 22.86 | 21.00 | 3.84 |
| 0.7 | 25.27 | 22.21 | 22.52 | 2.81 | 25.51 | 22.50 | 21.89 | 3.13 |
| 0.8 | 24.92 | 21.85 | 23.28 | 2.45 | 25.05 | 22.03 | 22.95 | 2.58 |
As shown in Table 3, fixing the Gumbel amplitude generally increases target alignment while reducing source preservation, consistent with the increased stochastic perturbation during generation. Nevertheless, both formulations exhibit the same overall trend: stronger initial source guidance improves preservation at the expense of editing strength.
This indicates that the complementary noise weighting influences the editing–preservation operating point, but does not fundamentally change the role of source guidance.
2. Ablation of adaptive guidance components.
Table 4. Adaptive guidance ablation with complementary and fixed Gumbel noise on PIE-Bench. All experiments use an initial guidance strength of 0.7 and cosine decay.
| Method | Original CLIP-G ↑ | Original CLIP-E ↑ | Original BG PSNR ↑ | Original Dist. ↓ | Fixed Gumbel CLIP-G ↑ | Fixed Gumbel CLIP-E ↑ | Fixed Gumbel BG PSNR ↑ | Fixed Gumbel Dist. ↓ |
|---|---|---|---|---|---|---|---|---|
| Full | 25.27 | 22.21 | 22.52 | 2.81 | 25.51 | 22.50 | 21.89 | 3.13 |
| w/o M2 | 23.02 | 20.13 | 26.93 | 1.00 | 23.18 | 20.27 | 26.76 | 1.20 |
| w/o spatial | 25.20 | 22.12 | 22.29 | 3.10 | 25.43 | 22.39 | 21.43 | 3.44 |
| w/o time | 23.95 | 20.96 | 25.91 | 1.39 | 24.04 | 21.10 | 25.82 | 1.51 |
As shown in Table 4, the effects of adaptive guidance remain consistent when the Gumbel amplitude is fixed.
Removing M2 or its temporal adaptation substantially reduces target alignment while favoring source reconstruction. Meanwhile, removing spatial adaptation degrades both target alignment and source preservation, confirming that spatially differentiated guidance contributes to the overall editing–preservation balance.
Importantly, these trends closely match those observed under the original complementary weighting. Therefore, the qualitative contributions of adaptive guidance persist even without dynamically scaling the Gumbel noise amplitude.
Overall, the fixed-Gumbel experiments confirm that the complementary weighting primarily serves as a practical parameterization of the residual–noise balance, while the contributions of spatially and temporally adaptive source guidance remain valid under an alternative noise configuration. We retain the original formulation for consistency with prior work, its rationale is now explained in revised Appendix B (lines 847–855).
[W2 & Q3]. Robustness of localization, irreversible token fixation, and failure cases
We thank the reviewer for raising these important concerns. We first clarify the motivation behind our disagreement-based localization. Argmax disagreement is a deliberate design choice motivated by the discrete generation mechanism of dMLLMs, where token predictions are ultimately converted into discrete token decisions. Rather than comparing the entire predicted distributions, we directly identify positions where the two branches favor different tokens, providing a simple token-level signal of source–target discrepancy.
Regarding the different visible contexts, the two branches share the same masking pattern but retain their respective source and evolving target contexts. Since localization is performed only on the remaining masked positions, comparing their predictions under these distinct contexts allows us to capture discrepancies arising from both the editing prompts and the evolving visual content. We consider this a natural way to exploit the progressive masked-generation mechanism of dMLLMs, rather than requiring identical visible tokens across branches. Nevertheless, argmax disagreement is not guaranteed to accurately capture semantic differences, particularly under uncertain predictions, and alternative distribution-aware signals may offer further improvements. We therefore discuss how our framework mitigates localization errors and acknowledge its remaining limitations below.
1. Irreversible token fixation and robustness of progressive localization.
As explicitly stated in revised Appendix J (lines 1877–1889), previously decoded tokens cannot be reopened or remasked in our current implementation, following the standard progressive masked-generation strategy of dMLLMs. Therefore, incorrect early decoding decisions cannot be directly corrected and may affect subsequent predictions through the fixed context.
Our framework is designed to mitigate, rather than eliminate, this limitation by exploiting the progressive and localized generation process of dMLLMs.
Specifically, during the initial steps, strong source guidance encourages source-consistent predictions, while the decoding schedule fixes only a small number of tokens. M3 further prioritizes tokens classified as non-editable, reducing the likelihood of prematurely fixing editing-relevant content.
As generation progresses, source-consistent background and structural tokens are preferentially decoded, providing increasingly informative visual context for subsequent predictions. Meanwhile, M2 adapts source guidance according to the evolving localization results, balancing source preservation and target-oriented generation.
Importantly, the three modules form a mutually supportive progressive process. M1 provides the dynamic localization information required by M2 and M3, while M2 influences subsequent source–target predictions through adaptive guidance, and M3 establishes visual context through edit-aware decoding. Thus, localization guides generation, while the evolving generation context in turn supports subsequent localization.
We acknowledge that individual localization decisions are not guaranteed to be correct. For example, as source guidance weakens at later stages, some background tokens may be incorrectly classified as editable. However, the previously established source-consistent context, together with the remaining source guidance, can help constrain their subsequent predictions and reduce unintended modifications.
This coordinated process helps mitigate uncertain localization, but does not guarantee recovery from incorrect early decisions, particularly when such decisions result in prematurely fixed tokens.
We thank the reviewer for recognizing the practical contributions of DynEdit. We address these concerns with additional experiments and failure-case analyses below.
[W1 & Q1]. Component contributions and matched-alignment comparisons
We thank the reviewer for this important suggestion. To better distinguish improvements in source preservation from changes in editing strength, we conduct additional controlled comparisons at matched edit-region alignment (CLIP-E), covering both individual module ablations and the comparison with GIDE.
1. Component contributions at matched editing strength.
We adjust the initial guidance strength of each ablated variant to achieve comparable CLIP-E scores, allowing us to directly compare source preservation at similar editing strength.
Table 1. CLIP-E-matched module ablation on PIE-Bench (revised Sec. 4.5, Table 4). Guidance is adjusted for each ablated variant.
As shown in Table 1 (also revised Sec. 4.5, Table 4), all variants achieve nearly identical CLIP-E scores. DynEdit also obtains the highest CLIP-G and the best source preservation across all five metrics.
In particular, removing M1, M2, or M3 increases the global structure distance despite maintaining comparable edit-region alignment. Removing temporal or spatial adaptation similarly degrades source preservation.
These matched-alignment results are included in revised Sec. 4.5, Table 4 (page 10). These results show that the observed improvements are not explained solely by differences in CLIP-E-measured editing strength. Even when the ablated variants recover comparable target alignment through guidance adjustment, they consistently sacrifice more source information than the complete method, which also retains the highest global target alignment. This provides direct evidence for the complementary contributions of the proposed modules within our coordinated framework.
2. Comparison with GIDE at matched editing strength.
We further adjust DynEdit's initial guidance strength to match GIDE's edit-region alignment, enabling a more controlled comparison of their editing–preservation trade-offs.
Table 2. Comparison with GIDE at matched edit-region alignment on PIE-Bench.
As shown in Table 2, at nearly identical CLIP-E scores, DynEdit achieves higher global target alignment and consistently better global preservation across all five metrics. In particular, the structure distance decreases from 3.84 to 2.63, representing a 31.5% reduction.
GIDE retains an advantage in background preservation, which is expected because it directly copies source tokens outside the externally estimated editing mask. However, DynEdit achieves better overall structural consistency, while the background preservation gap is relatively modest at this matched operating point.
Importantly, GIDE relies on external SAM-generated masks, whereas DynEdit performs mask-free editing without external localization. DynEdit also reduces inference time from 31.1s to 21.3s, corresponding to approximately 1.46× faster inference.
Furthermore, our experiments under identical external masks (Sec. 4.3) demonstrate that DynEdit consistently outperforms GIDE across the reported metrics from 16 steps onward, further validating its effectiveness when external grounding is available.
Overall, these controlled comparisons indicate that DynEdit's improvements are not simply attributable to choosing a different CLIP-E operating point. The proposed framework provides stronger global structural preservation at comparable edit-region alignment, while offering greater flexibility and efficiency across different editing settings.