- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
SONGS proposes a training-free stochastic sampler based on scalar Brownian motion. It estimates a direction from completed solver stages, holds it fixed over the next interval, and injects noise with a drift correction based on the projected score. Experiments show substantial improvements at very low NFE budgets. However, the paper's claim that the sampler preserves marginal distributions for arbitrary adapted step-process directions raises a significant theoretical concern.
Critical strengths
The paper tackles the important practical challenge of generating high-quality samples with very few model evaluations. Its simple, training-free approach and promising experimental results make it a worthwhile direction to explore.
Critical weaknesses
-
The paper's theoretical analysis does not establish its central distribution-preservation claim as stated. Although the sample-quality results are promising, they do not address this theoretical gap. Moreover, the experimental details are insufficient for independent reproduction, making it difficult to assess the empirical contribution on its own.
-
The marginal-preservation claim in Proposition 3.4 does not hold in general. In Appendix B.5, the derivation treats the frozen random matrix as spatially constant in the unconditional Fokker–Planck equation. However, adaptedness alone does not justify this step. The relevant coefficient is , which can depend on . To illustrate this issue, consider a stationary target with zero velocity, unit noise scale, and a frozen direction . Under Eq. (13), we obtain This counterexample shows that an admissible direction can change the marginal distribution, contradicting the general claim in Proposition 3.4. While this invalidates the theorem as stated, it does not necessarily undermine the practical effectiveness of the proposed sampler.
Questions for authors
-
How does Proposition 3.4 account for the counterexample above? If the proof conditions on the frozen direction, why is it valid to use the unconditional score in Eq. (13) for the resulting conditional distribution?
-
Could the authors clarify the exact sequence of model evaluations for the 3-NFE and 5-NFE settings, including initialization, final updates, timestep schedules, and noise coefficients?
-
Under the same solver settings and with matched noise energy, does the history-based direction perform better than fixed or independently sampled random rank-one directions?