- Rating
- 2(+1)
- Confidence
- 3(+1)
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper introduces a novel particle-based diffusion guidance method, which leverages Stein's identity for scaling diffusion guidance problem in a derivative-free manner.
Critical strengths
With the current presentation, I can not identify any major strengths of this paper. Even though the paper raises some interesting problems such as training-free guidance, derivative-free guidance methods, particle-based diffusion guidance, scalability, etc. Some of them are in my area of expertise, but I can not recommend that they are their strengths because I can not clearly position their work compared to existing literature within their current paper version.
Critical weaknesses
I think that there are several major weaknesses of this paper.
- The way the authors present their research is too ambiguous. When reading through the paper, there are paragraphs that make sense, but there are also several disconnected paragraphs. The writing is extremely difficult to follow, with very complex logical reasoning flow and abundant unclear math formulation, which make very hard to digest the paper's information. The authors introduced different complex terminology without enough sufficient background. I would recommend the authors make an effort to restructure their paper to clarify the background/ existing literature and their contribution with respect to existing work.
2. Another major concern is the paper formatting. The paper seems to be written with different character fonts and font sizes. Especially, we can observe this in the paper title, sections, and math equations. In addition, a weird running header with the title "Manuscript prepared for ICLR 2027" but not "Under review as a conference paper at ICLR 2027", which somehow shows that the authors did not even use the main conference paper format. Eventually, the paper has no conclusion section, Section 2 is too short, and Section 3 and Subsection 3.1 run with the same title.
- There is an important related work, Stein Diffusion Guidance (SDG) [1], that proposes a very similar work. SDG also leverages Stein variational inference methods to correct biased approximate diffusion posterior samples and remains completely training-free without fine-tuning pretrained models. Even though the paper was released on arXiv in July 2025 and later accepted to ICML 2026, the authors seem to completely ignore this related work.
Questions for authors
I don't have any particular technical questions about this paper since I can not truly understand the paper, even from its abstract, after spending hours reading.
References
[1] Stein Diffusion Guidance: Training-Free Posterior Correction for Sampling Beyond High-Density Regions, ICML 2026. Nguyen et al.
5 comments
I appreciate the updates. While Stein Diffusion Guidance [1] is the most relevant work, the authors only cited it in the Appendix and never discussed it in the main text. However, the citation to this paper remains very skeptical (lines 601-602); I can not find any available .bibtex files that correspond to this citation. In addition, Stein Diffusion Guidance also performs a similar benchmarking on image tasks, but the authors never compare against it. Regarding their experiments, I consider they are not significant. In Figure 3, classical FK steering already performs competitively with the proposed approach. In the text-to-image generation (Section 5.3), the authors only showed some cherry-picked photos; there are no reported quantitative metrics, i.e., CLIP score [2], which makes it difficult to judge their actual model performance. Given the improperly formatted initial manuscript, improper discussion of related work, citation, and comparison, and weak evaluation protocol, I don't think this manuscript is ready for publication.
References
[1] Stein Diffusion Guidance: Training-Free Posterior Correction for Sampling Beyond High-Density Regions, ICML 2026. Nguyen et al.
[2] TFG: Unified Training-Free Guidance for Diffusion Models, NeurIPS 2024. Ye et al.
Thank you for the follow-up. We have to disagree with the assessment that our contribution is insignificant.
Our main experiments already demonstrate 36–39% lower critic- KS than FK across the three target strengths, which is far from being "little improvement". We further compare independently tuned FK and DAS on the Hopper 80% target, using the same Late-5 guidance window and runtimes matched within 5%. Entries report KS (ms/output):
| Ours | FK | DAS | |
|---|---|---|---|
| 16 | 0.0931 (0.458–0.471) | 0.1557 (0.463) | 0.1618 (0.485) |
| 32 | 0.0600 (0.914–0.916) | 0.1117 (0.895) | 0.1117 (0.881) |
Times are median batched ms per output, including proposal generation, model evaluations, and correction. At , our method achieves approximately 46% lower observed KS than both baselines at matched runtime.
We also showed strict improvement for the SMC-type algorithms analysed (like FK or DAS): our superpolynomial convergence versus of SMCs, our bound uniform in guidance depth , versus the growing-in- phenomenon of SMCs, under the stated assumptions. Specifically, the SMC error can grow with , meaning that smaller step sizes can worsen sampling accuracy at a fixed particle budget. This means that even if FK were, to some extent, competitive at a particular discretization, this would not negate the theoretical improvement or the significance of the contribution.
Furthermore, DAS and SDG require reward gradients, whereas our method uses only value queries. Our empirical gains therefore come without the additional gradient access available to these baselines. These empirical gains and theoretical advances establish a substantive contribution; the assessment of insignificance does not adequately account for either.
We also disagree that SDG is the closest methodological baseline. The shared word “Stein” in the two titles does not, by itself, justify identifying SDG as the most relevant prior work. That judgment must rest on the problem setting, sampling objectives, algorithmic mechanisms, and guarantees. Its kernelized SVGD regularizes denoising posteriors; our Gaussian Stein construction enables value-only guidance with whole-path correction to a prescribed tilted distribution. It is especially clear to see that SDG is not itself an asymptoticaly consistent algorithm under our setting. Our most relevant baselines such as SMC-type algorithms, DOIT were all designed based on asymptotic consistency. We explain these distinctions in the appendix. The previous entry referred to arXiv v3 of the same paper; we have now replaced it with the official ICML 2026 entry, we believe that this was a minor, fixable factor.
Nevertheless, we have directly evaluated paper-based SDG adaptations under our main experiment settings, with validation-based parameter selection and independent confirmation. The table below reports critic- KS for the best-performing SDG adaptation among those tested in each setting, with :
| Method | 30% | 60% | 80% |
|---|---|---|---|
| Ours, | 0.0306 | 0.0697 | 0.1128 |
| SDG, | 0.1709 | 0.2475 | 0.3337 |
Even the strongest SDG adaptation tested at each target incurs approximately 3.0–5.6 times our KS error. Thus it is far from being competitive with other strong baselines even if the reviewer insists that it should be compared.
About our text-to-image experiment: In our updated draft, our revised image evaluation also reports CLIP score, HPSv2, and ImageReward over 40 GenEval two-object prompts. Our variant achieves the highest mean on all three metrics, providing quantitative evidence beyond the displayed examples.
| Method | CLIP score ↑ | HPSv2 ↑ | ImageReward ↑ |
|---|---|---|---|
| FK-Steering, | 0.2883 | 0.2584 | 0.3489 |
| SVDD, | 0.2761 | 0.2451 | 0.0098 |
| URGE, | 0.2864 | 0.2498 | 0.5723 |
| Ours, | 0.2961 | 0.2622 | 0.8290 |
| Ours, | 0.2925 | 0.2599 | 0.3445 |
Finally, we appreciate the reviewer identifying the initial formatting issues. These are relatively straightforward to resolve and have already been corrected. These minor issues should not be conflated with the scientific significance of the contribution. We believe that the final assessment should address the revised manuscript and the evidence above.
We thank the reviewers for the detailed feedback. We have substantially revised the manuscript to address the concerns about clarity, readability, organization, and positioning, and have posted the updated version (with changes in red).
Overall revision. We were short on time before submission and did not polish the presentation as carefully as we should have. Following your feedback, we have substantially revised the motivation and technical explanations to make the paper clearer and easier to follow. We expanded the background, clarified our contribution and its relation to existing algorithms, and made the connection between guidance and correction more explicit. We also reduced auxiliary notation, repeated definitions, and technical digressions. The changes below illustrate this overall direction.
Specific changes include:
Abstract and background: The abstract previously opened with depth and width terminology; it now starts with the sampling problem and our guidance and correction design. We also expanded Section 2's brief introduction to define Bellman error and explain how resampling fluctuations become terminal bias.
Stein derivation (Section 3.1.2): We replaced several auxiliary estimators with a direct derivation of the selected candidate's mean and its guidance drift, reducing notation and making the connection to Stein's identity explicit.
Weighting argument (Section 3.2): The original text referred to Appendix C.1 for why the weight yields the target marginal. We now spell out the path weight and telescoping identity in the main text, with an explicit reference to the one-step identity in Appendix B.1. This directly shows why we are using the correct importance weight for the correction.
Formatting and organization: We replaced the mixed font setup and custom running header with the ICLR template settings, corrected the repeated section title, and added a concise conclusion summarizing the main takeaway.
We thank the reviewers for pointing out this omission and bringing SDG [1] to our attention. We have added an intuitive discussion and a schematic comparison in Appendix A.
SDG uses kernelized Stein variational inference to regularize clean predictions, aiming to mitigate reward hacking associated with approximate guidance surrogates. Our method uses the classical Gaussian Stein identity (Gaussian integration by parts) for value-based candidate selection, while correction is performed by whole-path MH. Under the stated assumptions, increasing the number of MH updates makes the output arbitrarily close in total variation to the prescribed finite-grid target, even with approximate intermediate values.
References
[1] Van Khoa Nguyen, Lionel Blondé, and Alexandros Kalousis. Stein Diffusion Guidance: Training-Free Posterior Correction for Sampling Beyond High-Density Regions. ICML, 2026.