- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper proposes ProxDG, a Training-Free Guidance (TFG) method that integrates Gradient Guidance and Solver-Based Guidance. The core of the paper is to compute a guidance direction for each based on the Proximal Operator and the Moreau Envelope, and inject it into the denoising process. In the practical algorithm, for different tasks, dedicated solvers for the corresponding Proximal Operator can be designed to improve efficiency. In addition, the authors introduce an Annealing Schedule for the guidance term and provide extensive theoretical analysis of ProxDG. Finally, the authors conduct experiments on PDE Solution Generation, Scientific Inverse Problems, and Robot Motion Planning to verify the performance of the algorithm.
Critical strengths
- The algorithm is simple and easy to understand, and it combines Gradient Guidance and Solver-Based Guidance into a single algorithmic framework.
- The theory is sufficient, and sufficient theoretical analysis is provided for the theoretical properties of the algorithm.
Critical weaknesses
- The computational cost is high. Because of the Proximal Operator, a minimization problem has to be solved at every step. For certain problems, closed-form solutions may exist, but for general problems, this means that every step requires an expensive solve.
- The organization of the appendix is not appropriate. Since the appendix contains a large amount of theoretical analysis, it would be more reader-friendly to organize it better: for example, providing a table of contents for the appendix, and explaining the order in which the appendix is presented, the main theoretical results in each part, and the proof tools.
Questions for authors
- Since this paper presents a unified framework, I would like to know how DSG [1] should be understood within this framework.
[1] Yang, L., Ding, S., Cai, Y., Yu, J., Wang, J. & Shi, Y. (2024). "Guidance with Spherical Gaussian Constraint for Conditional Diffusion." Proceedings of the 41st International Conference on Machine Learning, Proceedings of Machine Learning Research, 235:56071–56095.
I thank the authors for patiently answering my questions and for carefully revising the paper. Overall, the paper has become noticeably more readable. In addition, the authors' discussion of the computational cost has partly convinced me. Finally, the authors' discussion of DSG exceeded my expectations. I initially thought that DSG would be a special case of ProxDG, specifically analogous to imposing a spherical constraint, since DSG itself appears to derive a spherical constraint based on a Gaussian distribution and projects the distribution onto a sphere. The authors' discussion, however, has revealed another possibility. For these reasons, I choose to maintain a positive evaluation of the paper.