- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
DASL is a post-hoc Bayesian uncertainty method for pretrained equivariant machine-learned interatomic potentials (MLIPs). It keeps the trained network fixed and places a Gaussian Laplace posterior over a small subset of 64-512 weights. The posterior curvature uses both energy and force Jacobians. Weights are selected by their joint energy-force sensitivity on the training data, which reverses the max-variance rule of prior subnetwork Laplace (MaxVar). The uncertainty at a test input is the induced output variance. The method is tested on a 1D toy potential, on ammonia and 3BPA with a PaiNN model trained by the authors, and on the released MACE-OFF23-small model over five molecular splits. It is compared with last-layer Laplace, MaxVar and random subnetworks on the same frozen model, and with BLIP, deep ensembles and Bayes by Backprop. DASL has the highest force Spearman correlation between uncertainty and error on ammonia (0.905) and MACE (0.612), but not on 3BPA. My expertise is generative modeling and ML evaluation, not atomistic simulation, so I focus on the method and the evaluation.
Critical strengths
- Practical post-hoc setting with controlled comparisons. The pretrained predictor stays unchanged and no retraining is needed. All Laplace variants share the same frozen mean, so differences come only from the uncertainty method. The paper uses matched budgets, readout controls and budget ablations, and it is tested on a released pretrained MACE model.
- Informed selection beats random selection everywhere. DASL improves over random subnetworks on every benchmark and the paper is also open about where DASL does not win.
Critical weaknesses
- Gains over simple baselines are unclear and the evidence is thin. DASL has the highest Spearman on ammonia and MACE but loses on 3BPA at both temperatures, where the deep ensemble is best. The authors state that DASL vs MaxVar on MACE is not statistically significant. Ammonia and 3BPA are single runs with no confidence intervals. The evaluation data is small: 64 training and 129 test configurations for ammonia, and 64 adaptation and 128 test molecules per MACE split. NLL and CRPS are nearly identical across the Laplace variants because a large fixed noise floor dominates the predictive variance. On MACE, DASL’s force CRPS (0.0433) is slightly worse than the frozen model with noise only (0.0428). The 3BPA dihedral split is mentioned but not reported.
- Limited novelty and cost/usefulness are not shown. Symmetry preservation and energy-force consistency, presented as core properties, hold for any Laplace posterior over an equivariant energy model. So last-layer Laplace, MaxVar and random subnetworks have them as well. All subnetwork baselines in the experiments also use the joint energy-force curvature. Only the selection rule distinguishes DASL. Wall time and memory are not reported, although scoring all 694320 MACE weights needs force second derivatives. The motivation is MD trajectories drifting out of distribution, but no downstream use of the uncertainty is tested.
Questions for authors
- Report wall time and memory for subnetwork selection, posterior construction and prediction, vs. last-layer Laplace, MaxVar (SWAG) and the ensembles, especially for the 694320-parameter MACE model.
- Report 1) confidence intervals over seeds for ammonia and 3BPA 2) the 3BPA results on all four test sets, including the dihedral split 3) ammonia NLL and CRPS with a validation-selected noise floor, so the scores reflect the epistemic part.
- Can you show the uncertainty is useful downstream, for example in active learning or in detecting failures in an MD run that drifts out of distribution?