- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes an efficient approach to Fokker–Planck (FP) regularization for learning molecular force fields from equilibrium configurations without force labels. Existing FP regularization methods improve the consistency of diffusion-based force fields but incur substantial computational overhead due to expensive higher-order derivatives. To address this issue, the authors introduce two weak-form FP objectives: Galerkin FP, which enforces consistency across diffusion times, and Stein FP, which constrains endpoint forces. By leveraging integration by parts, finite-dimensional test functions, and an unbiased U-statistic estimator, the proposed approach avoids expensive Hessian computations. Experiments demonstrate that Galerkin FP achieves simulation quality comparable to existing FP regularization methods while significantly reducing training time and memory consumption.
Critical strengths
- Clear motivation and practical relevance. The paper addresses the substantial computational overhead of higher-order derivatives in FP regularization. Improving training efficiency is practically important, particularly for scaling force-field learning to larger models and molecular systems.
- Principled and computationally efficient formulation. The proposed weak-form FP objectives leverage Galerkin projections and integration by parts to avoid expensive Hessian computations. The unbiased U-statistic estimator further provides a theoretically justified formulation rather than a purely heuristic approximation.
- Significant efficiency improvements. Galerkin FP achieves simulation quality comparable to existing FP regularization methods while providing approximately 2.5–3.5× speedups and substantially reducing memory consumption. The matched-compute comparisons further demonstrate its practical benefits.
- Useful insights from comparing Galerkin FP and Stein FP. The experiments suggest that enforcing consistency across diffusion times is more effective for training from scratch, whereas endpoint constraints can be beneficial for refining pretrained DSM models. This distinction provides useful insights into regularization strategies at different training stages.
Critical weaknesses
- Insufficient evaluation of force-field accuracy. Despite the paper's focus on force-field learning, the evaluation primarily emphasizes equilibrium distributions, PMF errors, and simulation stability, with limited direct analysis of force prediction errors.
- Limited guarantees from finite-dimensional weak constraints. Galerkin FP only constrains the projection of the FP residual onto a finite-dimensional test-function space, potentially missing important residual components that could affect local force accuracy and long-term simulation stability.
- Limited evaluation on larger molecular systems. Most experiments use small coarse-grained systems, including Chignolin represented by only 10 Cα beads. The largest all-atom system contains just 42 atoms, leaving scalability to more complex molecular systems insufficiently validated.
- Unclear scalability of the test-function representation. The proposed RBF test functions rely on pair-distance features whose dimensionality may grow substantially with molecular size. The sensitivity of this representation to increasing molecular complexity remains insufficiently explored.
- Direct force accuracy and comparison with conventional force fields. Could the authors report direct force MAE/RMSE against reference forces, particularly on MD22? This would help clarify whether the proposed method improves actual force prediction accuracy or primarily improves the equilibrium distributions produced by the learned dynamics. Additionally, could the authors include conventional label-based force fields as reference baselines to contextualize the trade-off between force-free learning and supervised force-field methods, in terms of both force accuracy and equilibrium simulation quality?
- Scalability to larger molecular systems. Can the authors provide experiments on larger all-atom systems to demonstrate that the proposed efficiency improvements and simulation quality are maintained as molecular size increases?
- Test-function dimensionality and expressiveness. The test functions are constructed from pair-distance features. How does the dimensionality of these features scale with the number of atoms, and how are the relevant atom pairs selected? Although the authors study sensitivity to the number of test functions, it remains unclear how increasing feature dimensionality affects RBF bandwidth selection, test-function expressiveness, and the conditioning of the Gram matrix. Can a fixed number of test functions adequately constrain important FP residuals in larger molecular systems?
- Practical importance of the U-statistic estimator. Although the U-statistic estimator is theoretically unbiased, Table 7 shows nearly identical simulation performance with and without the correction. Could the authors clarify under what conditions this correction provides a meaningful practical advantage, and why it is emphasized as a main contribution?
Questions for authors
see weakness
2 comments
Thank you for your reply; I keep my score.
Thank you for the careful review. We added force measurements, scaling results, and test-space diagnostics to address your questions.
Summary. We report direct force errors alongside a supervised reference (Tbl. 13), measure the strong residual (Fig. 4), report cost and memory across systems (Fig. 13), and analyse the test space and metric (App. F). Galerkin FP reduces the full residual by 4-7 times on three systems. Although it trains on a finite projection, its cost stays at 1.8–2.8 times DSM for varying number of atoms, and it matches or outperforms recent energy regularizers (Tbl. 2).
Force accuracy (W1, Q5). We computed RMSE, MAE, and cosine similarity against DFT forces on MD22 and mapped all-atom forces on alanine dipeptide. We also trained the same backbone with force labels as a supervised reference (Tbl. 13).
FP regularization improves the distributions (Q5). While force error and RSDE sample quality are nearly the same for models, we see how their simulations differ by up to 3.5 times in JS. That means, surprisingly neither tells us which model simulates well. Fu et al. (2023) also found the same for supervised force fields. However, the FP residual at small t does tell them apart. Galerkin FP reduces it by 4-7 times on three of four systems (Fig. 4), and offers a good indicator.
Finite test space (W2). Because Prop. 1 controls only the part of the residual inside the test span, we measured the full residual directly (Fig. 4). At t=10−3, we reduce it by 4-7 times relative to DSM on three datasets and by 2.7 times on Chignolin. On KS dipeptide and MD22, we match Pointwise FP, which has no projection (4.4 vs. 3.1 and 5.3 vs. 6.1 times). Because the two methods also agree in force error (17.5 vs. 17.6 kcal/mol/Å on MD22, Tbl. 13) and in broken bonds (at most 2.4% vs. 2.7% of states, Tbl. 15), we see no sign that the projection misses a component that matters for forces or stability.
Test functions and scaling (W4, Q7). We use all N(N−1)/2 pair distances, as Sec. 4 now states. On MD22, test functions, moments, the Gram matrix, and its solve take 12 ms of a 491 ms step. The main additional cost actually comes from a backward pass through the network. Across various number of atoms, Galerkin FP costs 1.8–2.8 times DSM per step and only about 2.7-3 times its memory, compared with 5.6–6.6 times the step time for Pointwise FP (Fig. 13) using only few Hutchinson probes.
Bandwidth and conditioning. We note that pairs further away may 'dominate' the RBF bandwidth. Thus, we use the median bandwidth. We re-estimate G each step with a relative ridge and a condition cap (10^5). Because the Gram metric makes the loss independent of the scale and correlation of the tests, we see one default weight stay stable on all four dataset (Tbl. 10). When t is almost 0, the covariance has an effective rank of about 1.5 which is rising to ~10 at larger t (Tbl. 8).
Larger systems (W3, Q6). MD22 is our largest dataset / system with 42 atoms. Across our four systems, the cost relative to DSM stays at 1.8–2.8 times (Fig. 13). We tested additive radial functions that keep the number of test functions independent of molecule size and give similar quality to the default (Tbl. 9). Evaluating all pair distances still scales quadratically with the number of particles.
U-statistic (Q8). Because the bias of the naive estimator scales with 1/n, the two estimators agree at batch size 1024, which is the setting of the ablation (Table 7 in the submission, now Tbl. 18). At an exact model, the naive objective reads 31.7 instead of zero at n=16 and 1.8 at n=256, while the U-statistic stays at zero within its sampling error (Tbl. 17). The correction therefore matters when memory limits the batch, as on MD22 with n=128 and on larger systems. It needs no extra model evaluations and guarantees that the loss vanishes in expectation at an FP-consistent model for every batch size.
We ask you to consider the new force, residual, and scaling evidence when updating your assessment.