- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies a failure mode of selecting diffusion sampling schedules by endpoint error, the relative L2 distance between a few-step sample and a high-step reference generated from the same noise. Holding the model, solver, number of function evaluations, and initial noise fixed, the authors show that endpoint error search can favor schedules with large low-noise gaps and worse image quality scores under strong classifier-free guidance. They explain this disagreement through controlled interventions and a two interval models, and propose constrained endpoint search, which limits the maximum low noise gap before minimizing endpoint error.
Critical strengths
-
This paper presents a rigorous and well-controlled diagnostic analysis. While keeping the model, solver, NFE, prompt information and initial noise constant, only the evaluation timesteps were varied. This analysis goes beyond a mere correlation study, moving the three evaluation points from high-noise regions to low-noise gaps improved the PickScore by (0.124, [0.051, 0.197]), whilst simultaneously increasing the endpoint error. By utilizing held-out prompts, paired confidence intervals, multiple metrics and targeted interventions, the key SD1.5 results were rendered compelling.
-
This paper proposes a simple and practical early-warning and intervention strategy. Checking low-noise intervals whilst optimizing the distance to the reference point is easy to implement, and constrained endpoint search is able to recover the majority of the observed PickScore loss across multiple test scenarios. Furthermore, the paper candidly explains the settings under which the methods's failure may be mitigated or eliminated.
Critical weaknesses
-
It remains unclear how often this failure affects practical timestep search methods. The main result selects among 57 fixed candidate schedules using strong guidance on SD1.5. The effect becomes smaller with a larger candidate set, is mixed on SD3.5, reverses without guidance, and is not clearly observed when the OSS adaptations use their own first-order update. Thus, the evidence supports a failure mode under specific conditions, but not yet a general limitation of endpoint-based timestep search. The paper should narrow its claims or demonstrate the issue in more representative published search methods.
-
The explanation and proposed remedy remain limited. The two-interval model assumes that image quality is more sensitive to errors in later stages, but it neither explains nor empirically predicts when this condition holds in practical diffusion models. Constrained endpoint seach also relies on empirically selected spacing parameter, provides incomplete recovery in some settings, and can underperform alternatives such as AYS. Consequently, its practical advantage over existing schedules or direct quality based selection is not yet clear. Furthermore, the core comparisons are primarily based on implicit endpoint L2 error and learned perference metrics. Distributional metrics provide supporting evidence, but human evaluations are limited to the relatively small scope of the SDXL comparison. The conclusions should therefore be framed around the evaluated fidelity and quality measures rather than ODE fidelity and perceptual quality in general.
Questions for authors
-
Given that the effect weakens with a larger candidate set, is mixed on SD3.5, reverses without guidance, and is not clearly present for OSS with its own update, in which practical settings do the authors expect published endpoint-based search methods to encounter this problem?
-
Can the author verify the hypothesis that image quality is more sensitive to low-noise errors through empirical research, rather than relying directly on this hypothesis in the two-interval model? Can this theory predict when inconsistencies will occur?
-
Can the authors provide broader human evaluation across SD1.5 and PixArt- to verify that the reported preference-metric differences correspond to human judgments?