- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper studies training-free object removal with few-step distilled diffusion models and proposes ReState. It uses intermediate features from the first denoising pass to match masked positions with similar background positions, then aggregates the corresponding clean latents from the source image to form an explicit background target. This target is used to correct the model’s clean prediction. The correction strength depends on the noise level and becomes zero at the final step, while object-excluding attention remains active throughout sampling. The authors evaluate the method on two paired benchmarks and several distilled backbones. Intervention analyses and ablation studies examine the roles of the background target, correction timing, and attention constraints.
Critical strengths
The method is simple and training-free, works with frozen pretrained models. The experiments are thorough, covering two paired benchmarks and multiple distilled backbones, with ablation studies that support the effectiveness of the main components.
Critical weaknesses
None
Questions for authors
-
All reported ReState experiments use UNet backbones. Have the authors tried applying it to DiT models such as FLUX or Qwen-Image? If not, what changes would be needed, and what limitations might arise?
-
Can it also be combined with SARG in Attentive Eraser or adaptive attention suppression in AdaEraser? Have the authors tested whether it provides additional gains over these methods?
3 comments
Thanks for the response and additional experiments. The DiT results and combinations with SARG and AdaEraser answer my two questions. The comparisons with the full official baselines and directly decoded background targets also make the performance gains more convincing. I still see the contribution as incremental, especially since a simple constant-weight schedule performs similarly. However, the method is useful, requires no training, and works well in the tested settings. The remaining limitations, including smooth fills, do not change my recommendation. I maintain my score of 3 (weak acceptance).
Thanks to Reviewer hdD7
We sincerely thank Reviewer hdD7 for the follow-up and for the continued positive assessment. We are glad that the DiT results and the combinations with SARG and AdaEraser answered both questions, and that the comparisons with the official baselines and the directly decoded background targets made the gains more convincing.
Your two questions led to the DiT extension (App. G.2) and the combination study (App. D.8) in the revision. We will release our code, evaluation scripts, and per-image outputs to support future work on training-free removal.
Thank you again for the constructive review.
[1/1] Response to Reviewer hdD7
We sincerely thank Reviewer hdD7 for the encouraging review and for recognizing that the method is simple, training-free, and applicable to frozen pretrained models, with thorough experiments and ablations. Below, we answer your two questions. All changes are marked in blue in the revised manuscript.
# [Q1] Extension to DiT Models such as FLUX and Qwen-Image
Yes, we applied ReState to five DiT backbones (FLUX.2-klein-4B and 9B, FLUX 3 Image Klein, Qwen-Image-Flash, and Z-Image-Turbo). On OBER-Test, it raises the masked PSNR from 10.0–11.3 dB to 17.3–19.6 dB at the native number of forwards of each model (Table R1; App. G.2).
Table R1 (i.e., Tab. G3). ReState on DiT Backbones (OBER-Test). All models use their native resolution and number of forwards (NFE).
# [Q2] Combination with SARG (Attentive Eraser) and Adaptive Attention Suppression (AdaEraser)
Yes, it can be combined with both, and it provides large gains over them: adding our direct correction raises the re-tuned SARG from 15.34 to 18.57 dB and the adaptive suppression of AdaEraser from 11.71 to 17.79 dB on OBER-Test (Table R2).
Table R2 (i.e., Tab. D7). Attention Forcing Without and With the Direct Correction of ReState (OBER-Test, SDXL-Turbo; Masked PSNR ↑ / SSIM ↑ / LPIPS ↓).
We thank the reviewer again for these two questions. Extending the analysis to further architectures and video diffusion models is an interesting direction for future work.