- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
WASABI learns a diffusion sampler for an unnormalized Boltzmann distribution by translating infinitesimal Wasserstein descent into updates of a bridge denoiser. It estimates mean and covariance contributions using generated samples and target energy gradients, alternating denoiser fitting, correction learning, and sample generation with replay. Experiments on DW-4, LJ-13, and alanine dipeptide report improved backbone-angle Jensen–Shannon divergence on the molecular benchmark.
Critical strengths
1. A substantive connection between distributional transport and denoiser updates. Section 3.1 and Appendix A.1 derive the first-order response of the bridge posterior mean to endpoint transport, accounting for both endpoint displacement and changes in conditional weights. Under the stated regularity assumptions, this provides a concrete mechanism for translating a prescribed Wasserstein direction into an update of a generative model, rather than merely invoking an analogy with Langevin dynamics.
2. A tractable, score-free regression formulation. Sections 3.2–3.3 and Appendices A.3–A.5 make the regression objective computable from generated endpoints, cached target gradients, and network evaluations without evaluating the sampler's density or score. The covariance estimator supplies the expected inner product needed for training, rather than a pointwise covariance estimate, avoiding a separate conditional-sampling procedure under the stated exact-denoiser and integrability assumptions.
3. A meaningful improvement on the reported molecular observable. Section 4.3 and Table 3 report ALA2 backbone-angle Jensen–Shannon divergence of 0.0254 ± 0.0033, compared with 0.068 ± 0.009 for damped BMS [1], across three seeds and approximately one million generated samples per seed. This is a substantial improvement on that metric, while the matched DW-4 experiment in Section 4.1 and Table 1 also gives WASABI the lowest mean energy Wasserstein distance among the compared methods.
Critical weaknesses
1. The practical loss-to-theory gap and its bias–variance consequences are not adequately validated. Section 3.1 establishes the first-order Wasserstein correspondence for full covariance weight and a common infinitesimal step, whereas the experiments in Appendix B.4 downweight covariance; moreover, the estimator's unbiasedness in Section 3.2 assumes an exact conditional mean that is replaced by a learned denoiser. Downweighting preserves the target's ideal fixed point but changes the update direction, while denoiser approximation can bias the estimated correction; neither this bias nor the tilted estimator's stochastic-gradient variance is quantified in Sections 3.2–3.3 or Appendix A.4. The issue is therefore not a demonstrated algebraic error in the loss, but an unvalidated connection between minimizing the practical objective and obtaining accurate, statistically efficient Wasserstein updates.
2. The empirical advantage is mixed, and the benefit of the covariance correction is not isolated. Section 4.2 and Table 2 show that WASABI trails BMS [1] on both LJ-13 metrics: configuration Wasserstein distance is 1.597 ± 0.003 versus 1.54 ± 0.00, and energy Wasserstein distance is 1.677 ± 0.224 versus 0.53 ± 0.04; these are quoted baseline results rather than matched retraining, and the DW-4 advantage in Table 1 is limited to the mean energy metric. The strongest molecular result in Section 4.3 evaluates only the two-dimensional backbone-angle distribution despite generating Cartesian coordinates, and Appendix B.3 documents rare-region underrepresentation, so the headline result does not establish accurate sampling of the full molecular distribution. ALA2 also combines the proposed update with a high-temperature MD prior, alignment, annealing, and the bond–angle split architecture described in Appendix B.3, while the covariance sweep in Appendix B.4 and Table 5 fixes the update scale at 1.00 rather than the selected 0.10, leaving the covariance contribution to the headline gain unresolved.
3. Larger-system scalability and end-to-end efficiency remain unvalidated. Section 4 restricts evaluation to DW-4, LJ-13, and ALA2, although BMS already evaluates LJ-55 and ALA4 in its Sections 4.2–4.3 [1]; there is consequently no larger-system evidence that the additional covariance estimation and repeated denoiser fitting remain beneficial at comparable accuracy. Multi-molecule evaluation such as GEOM-DRUGS, used by Torsional Diffusion [2], is also absent, leaving broader applicability untested, although conformer generation is a different evaluation regime and LJ-55 or ALA4 is the more direct scalability test. Even the reported small-system efficiency advantage is conditional: Appendices B.3–B.4 pair accuracy from a replica-exchange-derived prior with a 3.13 million force-call estimate for a different local-MD prior, and the FLOP accounting excludes geometric calculations and other operations. This does not establish the end-to-end accuracy–cost advantage of the procedure that actually produced the reported results.
Questions for authors
1. Fidelity and estimator accuracy. Please specify the actual time-dependent update and covariance-weight schedules and, on a tractable target with a known denoiser response, measure correction error using exact versus learned denoisers and full versus downweighted covariance. Can the authors also compare the direct and tilted estimators' stochastic-gradient variance at matched computational cost as dimension and bridge time vary? This would separate deliberate changes to the update from estimator bias, sampling noise, and fitting error.
2. Contribution of covariance and molecular accuracy. At the selected ALA2 update scale of 0.10, can the authors compare zero versus the selected nonzero covariance weight while holding the prior, alignment, bond–angle split architecture, annealing, replay settings, and computational budget fixed? Please report energy-distribution agreement and minority-basin populations alongside backbone-angle divergence, with a complementary structural metric such as the TICA-based Wasserstein distance reported by BMS [1]. This would test whether covariance drives the headline improvement and whether the gain extends beyond the angle histogram.
3. Larger-system accuracy and measured cost. Can the authors evaluate one larger fixed-target system, such as LJ-55 or ALA4, against BMS [1] using matched target and evaluation conventions, and report accuracy together with end-to-end runtime, peak memory, and force evaluations? Please include the actual prior preparation, denoiser fitting, correction training, and sample-generation costs, rather than pairing measured accuracy with a different prior-generation procedure. This would establish whether the additional estimation and refitting machinery provides a practical advantage beyond the small systems studied.
References
[1] Bridge Matching Sampler: Scalable Sampling via Generalized Fixed-Point Diffusion Matching
[2] Torsional Diffusion for Molecular Conformer Generation
5 comments
(2/n) Response to reviewer yR4Q
W2 Empirical Advantage
Thank you for these comments and for the careful review of the experiments. We agree that BMS achieves better LJ-13 results. However, WASABI remains competitive with strong sampling baselines: its configuration Wasserstein distance is close to ASBS (1.597 versus 1.59), and its reported mean energy Wasserstein distance is lower than both ASBS and AS (1.677 versus 1.99 and 2.40, respectively). We believe these comparisons provide useful context for the remaining gap to BMS.
In the paper, we attribute WASABI’s worse performance on the energy metric to undercoverage of the left tail in LJ-13’s energy distribution. We also notice that our energy distribution is slightly more peaked at the mode, which is consistent with the mode-seeking behavior that reverse-KL-based training can exhibit in practice. The steep Lennard–Jones potential also makes energy particularly sensitive to small differences in particle separations.
Interestingly, BMS exhibits a different coverage pattern on ALA2 and appears to assign more probability mass to low-density regions, whereas WASABI tends to underrepresent certain rare configurations. We believe this difference may be related to the objectives underlying the two approaches. WASABI is motivated by reverse-KL descent, while BMS is connected to a forward-KL objective over path distributions through its Markovian projection formulation. Indeed, the authors of BMS explicitly identify this connection as a possible explanation for their method’s mode-covering behavior (Blessing et al., 2026, Section 4.3). Our observations are consistent with this interpretation and highlight an interesting distinction between the two approaches: broader mode coverage does not necessarily imply more accurate probability allocation, as illustrated by WASABI’s lower reported dihedral JS divergence on ALA2 and its lower W2-TICA metrics.
We hope this clarifies the remaining LJ-13 discrepancy and puts it in the context of WASABI’s overall performance. We believe that extending our denoiser-update formulation to other objectives is a particularly exciting avenue for future work.
W3/Q3: Large system scalability and transferability
We agree with the reviewer that our current experiments establish performance on small molecular benchmarks, and extending WASABI to substantially larger systems remains an important direction for future work. The mathematical formulation applies directly to larger systems, but maintaining sampling accuracy at manageable computational cost requires further investigation. Our ALA2 results, obtained using 4-layer, 64-channel PaiNN backbones compared with the 6-layer, 256-channel backbone used by damped BMS, suggest that architectures tailored to the target energy landscape can help achieve strong performance with compact networks. Exploring such architectural choices, alongside increased model capacity where needed, provides a promising path toward larger systems. Another direction is to evaluate the accuracy and variance of covariance estimation as system size increases and develop more robust estimators to support scaling.
Regarding transferability, the standard GEOM-DRUGS conformer-generation benchmark used by Torsional Diffusion involves learning from conformer datasets and generalizing to unseen molecules. This differs from our focus on learning a sampler for a specified physical energy without requiring equilibrium target samples. We nevertheless view energy-based training across molecular systems, potentially combined with existing conformer data, as a valuable extension.
W3/Q3: End-to-end compute cost and prior initialization
Our training FLOP estimate already includes correction training, denoiser fitting, and generation of fresh replay-buffer samples. Prior preparation is additionally included in the reported energy/force-call budget. These estimates cover the principal training components.
We also re-ran our method with high-temperature MD prior instead of REMD prior to match our FLOP estimate (see response to Q1/W1).
Response to reviewer yR4Q
Q1 Fidelity and estimator accuracy
We thank the reviewer for requests of clarification on suggestions of diagnostics.
We have clarified the implemented bridge-time update and covariance-weight schedules in Appendix B.3.
As reviewer requested, we have added a tractable two-dimensional Gaussian study in Appendix B.5, Figure 6, comparing correction accuracy using exact and learned denoisers with full and downweighted covariance contributions. Each fitted correction is evaluated against its corresponding analytic response. In this example, we found that errors decrease with increasing Monte Carlo sample budget, and learned denoisers yield errors close to the exact-denoiser baseline. We also observe larger correction errors at later bridge times; This is consistent with the potentially larger sampling fluctuations associated with the estimator’s t/hₜ and t²/hₜ² factors as the bridge-noise scale decreases. The appendix specifies the experimental settings and distinguishes estimation error from the deliberate change in response introduced by covariance downweighting.
Our tilted-noise construction is an alternative estimator of the same population quantity as the direct Gaussian estimator; under the stated assumptions, both are unbiased. We introduced tilting because the direct estimator exhibited very high variance and prevented stable training in our experiments.
(1/n) Response to reviewer yR4Q
We thank the reviewer for their detailed assessment and recognition of our theoretical connection, tractable formulation, and ALA2 gains. Below, we clarify the scope of our claims and provide additional evidence addressing their concerns.
We thank the reviewer for highlighting the distinction between the idealized update and the practical algorithm. The role of Theorem 3.1 is to guide practical diffusion-sampler design through Wasserstein gradient flow in distribution space. The ideal Wasserstein update requires the unknown score of the current sampling distribution and is therefore not directly tractable. By characterizing the induced first-order denoiser change through its mean and covariance contributions, the theorem guides our construction of a tractable regression update that avoids evaluating the current distribution’s density or score.
We agree that this result does not establish convergence or monotonic KL decrease for the implemented procedure. Finite step sizes, approximate neural-network fitting, and replay-buffer reuse introduce deviations from the ideal population iteration. Covariance downweighting further modifies the ideal Wasserstein direction; although it preserves the target as an ideal fixed point, this does not establish convergence. Our experiments provide evidence of practical effectiveness on the reported sampling metrics, while convergence guarantees remain an open direction for future work.
We have revised the Conclusion to clarify this scope and the theorem’s role in guiding algorithm design and have added an expanded discussion on covariance damping and the use of a replay buffer (see response to reviewer H1H8 ).
Thank you for suggesting this! Following your suggestion, we ran an ablation testing whether the model performs better with a modest covariance weight. We present the results below and find that across 3 seeds the dihedral JS to the MD reference improves by roughly 9%.
Per your suggestion, we assess structural agreement beyond the dihedral histogram by evaluating TICA-(W_2). We use the pretrained TICA model distributed with the ALA2 dataset referenced by BMS’s public implementation, without refitting. We project 10,000 generated configurations and 10,000 FAB validation configurations onto its first two components and compute their Wasserstein-2 distance.
We hope that these additional evaluations provide a more comprehensive assessment of WASABI's sampling accuracy beyond the backbone dihedral-angle distribution. In particular, the TICA-(W_2) results suggest that WASABI's improvements extend to agreement along slow collective coordinates, providing complementary evidence of its ability to capture the molecular conformational distribution. We acknowledge that these metrics do not fully characterize the high-dimensional target distribution, particularly the coverage of rare conformational states, and will clarify these limitations in the revised manuscript. We thank the reviewer for encouraging us to strengthen our empirical evaluation.