- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper extend the analyze by He et al 2025 on the role of Langevin preconditioning. It extends the conclusion in 2 ways: first, they confirm the conclusion of He et al 2025, and also show that inputing the score to the network can also help avoid mode collpasing. Second, they explore what chunk of the trajectory requires the score.
Critical strengths
This is an interesting analysis of the role of Langevin preconditioning. I appreciate the potential effort the author took to analyze these kind of techniques. However, I am sorry that I might have to say that I do not believe this paper has substantive strength that support acceptance.
Critical weaknesses
-
The conclusion is superfacial. The paper only anaysis the PIS style loss, and only analyze different way of inputing the score (and different time to input the score). There are many other more interesting things that the paper failed to find and discuss (or just leave it open). It is hard to see what this conclusion guide us for a betterr neural sampler.
-
The theory is not informative and not relevant. Prop 1 is so obvious and not means anything. Also, the score agrees with the optimal control does not mean the score is important at the point they agree. Think about diffusion model! Most of them has bad score agreement at data end, but it does not matter.
-
The experiments are not representative and not convincing. Only GMM and WM is analyzed. The window test also did not fully conduct on WM. We know different target can have very different behiour (also in different number of dims). However, the paper did not discuss or test any of the conclusion can transfer to more complicated / higher dimension target.
-
The scope is limited to old methods PIS. (See my question)
Questions for authors
There are many recent methods that do not need preconditions. But they implicitly learning to regress the score at some point (flow sampler, adjoint sampler, BMS, etc). How you explain them? When these score are effective or not?