- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies different strategies of timestep selection in diffusion sampling. The authors argue the existing method often suffer from "projection bottleneck" so different methods may even lead to the same schedule. For example, suppose there's hard constraint minimal step-size = 0.01, then one scheduler proposing 0.001 and the other proposing 0.005 will be adjusted to the same step-size (and thus not useful).
To overcome this issue, the authors propose to use a global allocation strategy, that assigns weight to each timestep, and then normalize the weights to get the step sizes.
Critical strengths
The problem is practically relevant.
The phenemonon that different diffusion models have common speed, curvature, and topological summaries is interesting, and may be valuable for other applications.
The paper is generally well-written.
Critical weaknesses
The paper compares the local control that uses Unified multi-scale score defined in their eqn (10). However, I felt this is different from the common methods used in the existing literature (including those cited in the author's paper), for example, DPM-solver. Thus I felt the specific method where the authors critiqued is not commonly used.
The global allocation strategy does not seem to be much better than the uniform stepsize. Thus I felt the methodological contribution of this paper is slightly overstated.
The handcrafted schedule is somewhat confusing.
I felt the overall writing is fine. However part of the paper seems unnecessarily abstract. For example, the definition of speed, curvature, and topological summaries. The projection bottleneck can also be explained in a simpler way.
In summary, I felt the paper claims 3 contributions: 1. a common phenomenon, 2. pointing out drawbacks of existing methods, 3. propose a new method. I found the first contribution interesting (though could be investigated deeper and more systematically), but am not currently convinced by the other two contributions.
Questions for authors
-
Can you comment on how often is (10) used in actual diffusion sampling?
-
Can you explain more on the handcrafted schedule?
-
Can you comment on Text-to-Image models?