- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper introduces CRAudit, a method to find and fix "conditional response collapse" in one-step image editors. After distillation, different editing instruction sgive almost the same result. Instead of only checking final output's fidelity or so, CRAudit pushes the text embedding along a fixed set of semantic directions and measures how much the edit made by those distilled model changes.
The authors argue that this collpse should be predicted early so they forecast from the first three model checkpoints which directions will fail. During distillation they add a loss which asks the one-step model to change the image as much as the original model does when the text embedding is moved along each direction, and this loss puts more weight on the directions that are forecast to fail. For a model that is already distilled they keep it frozen and train a small adapter that brings the weak directions back. The authors show that edit quality drops fast once only a few directions still change the output. Their final editor is fast and people prefer it over FlowEdit, which is a strong editing baseline.
In conclusion, this paper mainly shows:
- The loss of editing ability in one-step models shows up in the spectrum of the text-to-image response.
- The weak tail directions carry edit control for specific categories because changing them moves only the target edit type.
- Protecting and repairing these directions gives a fast editor with strong quality and human preference.
Critical strengths
- The paper targets an important behavior of distilled editors. One-step models often ignore an edit and return the source image. The paper turns this into a measurable collapse of the model's response to text. This adds a mechanism to the diversity loss [1] and the weak edits [2] already reported for fast models.
- The effective-rank finding gives the field a method to measure this collapse as the rank of the text response falls during distillation. Especially they show that edit quality drops sharply once the rank passes a critical value in all four model families. The weak tail directions also carry edit control for specific categories.
- Each proposed component have comprehensive experiments on them to understand the property of each method or components, although these same experiments withdraw its claims (Weakness 1).
References
- [1] R. Gandikota and D. Bau. Distilling Diversity and Control in Diffusion Models. WACV 2026
- [2] G. Deutch et al. TurboEdit: Text-Based Image Editing Using Few-Step Diffusion Models. SIGGRAPH Asia 2024
Critical weaknesses
- In the main text, the paper itself dismiss every single main claim by itself after named them. For example: It calls the bound "a post-hoc audit, not a forecast". The predictor's Brier score is worse than a constant baseline, and only two of 32 cases fail. Prediction does not beat current-state allocation after correction. The loss terms are "not established" as necessary. The repair "cannot certify a successful finite edit". Almost every other result is also followed by what it does not establish. So the reader cannot tell what the paper finally claims, and the title's "predicting, preventing, and repairing" is NOT supported as stated.
- The claim or components do not connect to each other in method, results or in conclusions. The audit, risk predictor, distillation loss, adapter and a separate repair baseline each have their own terms and their own eval set. The paper keeps their results separated and never shows how they interact to each others. The related work session have similar issue as the paper lists nearby methods without saying what they missed. It also omits the closest prior observations. Distilled models keep control directions but do not activate them [1], and few-step editing gives too weak edits [2]. So the reader cannot see how the rank-collapse finding leads to the editor's gains, which is the link the paper is built on.
- Fig. 1 is hard to read and looks unfinished, the lattering is stretched and the plots and labels show visible artifacts. Some labels are pasted over the original text with some stray marks around them. We highly suggest that the authors redo this figure with proper plotting and drawing tools.
- The main result are thin and their provenance is still unclear. The protocol states five seeds and bootstrap intervals, but the main table has no intervals reported. SSIM and DreamSim are listed as metrics but never reported. Adding the adapter doesn't change the headline edit score. The repro statement lists figures, deps, sanity checks and measurement record. Secion S10 also describes a release with entry points. But the paper submissions has no supplementary material and I also didn't find any url point the anonymous code repo.
References
- [1] R. Gandikota and D. Bau. Distilling Diversity and Control in Diffusion Models. WACV 2026
- [2] G. Deutch et al. TurboEdit: Text-Based Image Editing Using Few-Step Diffusion Models. SIGGRAPH Asia 2024
Questions for authors
- Why do the current-energy and current-error arms in Table 4 give exactly the same numbers in every cell? Why does the Brier section use a prevalence of 0.0654 when 2 of 32 series fail?
- Which teacher and student does each family use? How is CLIP-E computed? Were all reported numbers produced by new training runs for this submission?
- Suppose the paper were centered on the rank-collapse finding. Does the critical rank depend on the edit category or the distillation family? Does the effective rank at an early checkpoint alone allocate the budget as well as the risk predictor?
Besides the questions above, please also refer to the weakness part.