- Rating
- 4(+1)
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper proposes NF$^2$M, a model somewhere between Stochastic Normalizing Flows, Flow Maps and Diffusion models. In detail the core idea is to replace the Gaussian in the denoising step of a diffusion model with a conditional normalizing flow that predicts the clean sample given the current noised state . They then go on and show how to use this model for sampling -- similar to annealed importance sampling --, but following a diffusion transport path and applying local SNIS corrections at each diffusion step.
They show good performance of the proposed model & sampling scheme on molecular systems.
Critical strengths
The derivation of the SNIS-corrected transition kernel is novel and sound. The resulting local SNIS correction together with the theoretical guarantees on the error are a nice package.
It's great that this framework provides exact proposal densities instead of relying on approximations, which gives us consistent estimators.
Critical weaknesses
The experimental section (+ appendix) is very cluttered. Since the proposed "NF2M-(M)IS" method+model has many parts it's not immediately clear what effect the NF2M actually has. While -- or maybe because -- there are over 40 pages of appendix, I don't see a clear cut experiments that shows the clear theoretic advantages actually translate into the real world.
I would have liked some simple dataset where we can see e.g. the error correction and variance scaling as a function of integration steps. I don't see a clear advantage of using MIS since for Chignolin it is worse the IS.
Questions for authors
- If you want to optimize with the Reverse KL, you'd want a different non AR flow, right? Otherwise training would take way longer.
- The Inner ESS in Fig 4. So this is ESS is for a given pool of up to 20 samples? An estimated ESS of 1 is simply the minimum. How is this informative then?
- How do you explain that there is no consistent behaviour between Ala-2 to 6? I'd broadly expect the different models to perform similar relative to each other, because this is essentially a very similar problem.
7 comments
Answer to reviewer QjQ4 [2/2]
How do you explain that there is no consistent behaviour between Ala-2 to 6? [...]
The relative behavior is in fact consistent and follows two clear trends:
- Energy. NF²M's raw samples achieve the best E-W2 on every system (Tab. 24) except on ALA-6.
- Torsions. The ranking follows system size. SNIS's T-W2 grows steadily with dimension (0.24 → 0.36 → 0.78 → 1.77 → 3.86), while NF²M's grows much more slowly and overtakes it from ALA-6 onward. This is expected: global SNIS reweights whole configurations, which works well in low dimension but degenerates as dimension grows, whereas NF²M corrects easier per-step posteriors.
The one outlier, NF²M's T-W2 on ALA-2, stems from its training split (Klein & Noé, 2024), which deliberately over-represents a rare state. Correcting this requires a large reweighting of mode populations. Global SNIS with 10⁶ proposals performs it directly, while NF²M's small per-step pools (M = 14) leave residual bias. This is consistent with our bounds, whose finite-M bias grows with the -divergence (Thm. 7). The remaining differences among flow-map baselines mostly fall within their large seed variance.
We thank the reviewer again for their constructive feedback. We hope our responses address their questions, and we would be grateful if they would consider raising their score. We are happy to answer any further questions.
Dear authors, I have received your answers, thanks for clarifying.
I still feel like my question on the inner ESS estimator still hasn't been answered (at least for me to understand): If your estimator for Inner ESS is 1, then it's just at its minimum. To me this simply indicates the absence of signal showing that the Effecting Sampling Ratio is larger 0.
Does that make sense?
Answer to reviewer QjQ4 [1/2]
We thank the reviewer for their feedback and for finding the derivation of the SNIS-corrected transition kernel “novel and sound,” with the local correction and theoretical guarantees forming “a nice package.” We are also glad they value that our framework “provides exact proposal densities instead of relying on approximations, which gives us consistent estimators.” We address each point in detail below.
We respectfully note that the main experimental content is concentrated in a single section, Sec. 5.1, with two tables. Tab. 1 compares NF²M against all baselines on five peptide systems under a matched protocol, and Tab. 2 reports their training and inference costs. Together, they directly show how the method performs under realistic conditions.
NF²M-IS itself has few moving parts: it is the SNIS-corrected transition of Eq. (12) applied in a loop (Alg. 1), which takes a few lines of code. The appendix is organized by component:
We have added an appendix roadmap that explains each section’s role and highlights the relevant results and takeaways, including the candidate-budget comparisons and refinement ablations (p. 17, “Appendix roadmap,” lines 878–889).
Controlled experiment. We focused on the standard peptide benchmark, where ALA-2 already serves as a small, well-understood system. Our bounds predict consistency as M grows, and both metrics indeed improve monotonically with M on all systems (Fig. 5). Fig. 2 shows how the schedule-dependent quantities governing error propagation, as,t and γt,s, vary with the number of steps K.
MIS on chignolin. The gap in Tab. 1 reflects different selected configurations rather than MIS itself. The IS model uses K = 5 steps with M = 20 candidates per trajectory, while MIS was restricted to K = 8 and uses a smaller pool (C=2, M=6, i.e., 12 candidates). At matched configurations the two perform on par (Fig. 5), and MIS is 20% faster on chignolin at the same refinement setting (Tab. 4). As noted in our answer to Reviewer wD31, MIS is a secondary, optional component whose benefit should grow with system size.
Indeed, on-policy reverse-KL training with an autoregressive flow is expensive, since every step requires sequential sampling and backpropagation through it. Off-policy objectives avoid this. For instance, samples produced by the NF²M sampler itself can be reused and reweighted, so that training only requires density evaluations, which take a single parallel pass. Moreover, reverse KL would be used to fine-tune the flow after forward-KL pretraining (Sec. 3.2), so only a limited number of steps would be needed.
Yes, the inner ESS is computed per transition over one trajectory’s candidate pool (M≤20 for IS, CM for MIS) and averaged over trajectories. It is not the ESS of the final samples, which carry equal weights and are evaluated directly by the Wasserstein metrics.
Despite its small range, it serves three purposes. It shows that MIS with C components matches IS with CM candidates. It locates where the proposal is weakest, namely at low noise and on chignolin, which is where MAExL is most accurate. And ESS/M is the standard estimate of 1/ρt, the χ2 quantity in our bounds.