- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper develops a residual-sampling procedure for speculative diffusion by decomposing an equal-covariance Gaussian residual into a one-dimensional sampling problem and an orthogonal Gaussian component, enabling block verification in continuous spaces.
Critical strengths
-
The residual decomposition provides a concrete technical mechanism for implementing block verification, supported by a sampling proposition and an analysis of why reflection-style deterministic corrections are insufficient.
-
The experiments distinguish verification improvements from drafter improvements and include quality checks using FID for images and trajectory MMD² for molecular dynamics.
Critical weaknesses
- The incremental latency benefit of block verification is limited in some settings, and its statistical reliability could be assessed more directly. On ImageNet LDM, the gain over reflection-based verification is 2.32% at 250 steps and only 0.09% at 50 steps; the reported uncertainties concern each method’s speedup over DDPM rather than the paired improvement between the two methods.
- The relationship between theoretical exactness and the numerical sampler requires further clarification. The distribution-preservation argument assumes correct residual sampling, whereas the experimental implementation limits lower-bound search to three iterations and bisection to four, leaving the effect of this approximation on the sampling distribution unclear.
Questions for authors
- Could the authors report paired latency comparisons and confidence intervals for the improvement of block verification over reflection-based verification, particularly where the reported gains are small?
- How sensitive are the residual samples, output quality, and runtime to the numerical-search budget, and could the authors quantify the sampling error introduced by the three-iteration bound search and four-iteration bisection?
2 comments
Thanks for the authors' responses, which address my concerns. I keep my original positive rating.
We thank the reviewer for their precise comments. Please see our general comments.