- Rating
- 3
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper investigates if higher numerical accuracy necessarily leads to better target fidelity in diffusion sampling. The authors show that Euler can achieve better target fidelity than Heun despite having larger numerical discretization error. They establish theoretical results for Gaussian VP models and conduct experiments on synthetic Gaussian mixtures, including learned-score experiments in 2D and 32D.
Critical strengths
- The paper studies an interesting distinction between numerical accuracy and sample quality.
- The experiments consider different training checkpoints and NFE budgets and illustrate the behavior under different settings. The visualization in figure 1 is nice and clear.
Critical weaknesses
- The experiments are conducted on synthetic Gaussian mixture models, but the behavior remains unclear on realistic diffusion models and image generation.
Questions for authors
Following weakness.
- I am curious about how this insight could be applied to practical diffusion models. In particular, since the experiments use synthetic distributions where the ground-truth score is analytically available, how would a similar experiment be designed for real-world datasets where the true score is unknown? How could the target fidelity be evaluated in such settings?
- Regarding experiment section 5.5, given that the unpaired MMD evaluation does not show statistically significant reversals, how might this insight translate into improved generation quality or inform sampler selection in real-world diffusion models?