- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
If I understand correctly, the paper reports a finding about how few-step generators respond to small perturbations of the input. Compared with the original base model, the output changes of a few-step generator span more linearly independent directions. The authors then try to promote this diversity directly as an optimization objective, to improve few-step generation.
Critical strengths
I did not find any.
Critical weaknesses
-
The paper is nearly unreadable. I have read a large body of work on few-step distillation of diffusion models and have published and practiced in this area. Even so, I could not identify the key points of this paper. It casually introduces new concepts and terminology, and its appendix is extremely long. I do not think writing of this kind should be published under any circumstances. The paper needs a complete rewrite, not to become acceptable, but simply so that its content can be reviewed seriously.
-
A simple and trivial method is obscured by misleading framing. The method itself is not complicated. On top of DMD2, it adds a feature-covariance term that encourages diversity and a relational distillation term on features. This could have been presented clearly. Instead, the paper wraps it in misleading and unclear arguments and turns the whole manuscript into a disaster. As a method contribution, I also consider it trivial.
-
The logic of the paper is broken. Most of the paper describes how small perturbations of the input affect the output, and relates the diversity of this response to few-step generation. What is actually introduced in training, however, is the diversity of the output features themselves, computed over samples from independent noises, not the diversity of the model's response to input perturbations. The paper offers no convincing link between the two.
Questions for authors
See weaknesses