- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper uses a pretrained neural network potential (NNP) as a training-free score inside annealed Langevin or probability-flow ODE sampling for crystals. It argues that NNPs trained on relaxed structures have no data for very close atom pairs, so noisy sampling drives atoms into overlap where the learned force is unreliable. The authors define a “completeness boundary” at 0.75 times the sum of covalent radii and add three protection layers: 1) an analytic ZBL-matched repulsion below the boundary 2) a density-scaled noise 3) a hard constraint that projects close pairs back onto the boundary. Each run starts from a known MP-20 test structure plus Gaussian noise and anneals it back down, which the authors frame as the relaxation stage of crystal structure prediction. A noise scan with MACE-MP-0 shows the bare sampler fails above a noise threshold, while the protected sampler keeps the failure rate near zero. A benchmark with eSEN reports validity, stability, SUN and match rate. My expertise is diffusion and score-based sampling rather than interatomic potentials, so I focus on the method and the evaluation.
Critical strengths
- Clear and practical observation. Pretrained potentials are not trained on overlapping configurations, so using them directly as a sampling score fails at high noise. The paper measures this with large trajectory counts across 20 compositions and two potentials. The bare failure curve is a useful reference for anyone using an NNP inside a sampler.
- Careful and honest reporting. The authors separate start-time failures from sampler-induced ones, pair the layer ablation, and check threshold-free statistics. They state openly which protocols were not run and where their theorems do not apply.
Critical weaknesses
- The method is a set of protection layers for relaxation, and the layers are not new. Each run starts from the known test structure plus noise, so it recovers a given structure rather than generating from a composition. The composition-only start was not run. Much of the failure comes from injecting up to several Å of noise into a relaxation, which standard relaxation does not do. The layers themselves are standard: ZBL repulsion spliced into ML potentials is common and already built into MACE-MP-0, and a minimum-distance constraint is a standard device in structure search. The paired ablation shows the hard constraint (L3) does almost all the work, density-scaled noise adds almost nothing, and the step-rejection guard is harmful. The repulsion-off arm that would show whether the analytic wall adds anything beyond the potential’s own repulsion was not run. The boundary itself is a chosen threshold at the edge of the training data, and where the potential’s forces actually become wrong is never measured.
- Downstream effectiveness and theory are not connected to the claims. The OOD rate and validity both test minimum interatomic distance, which L3 enforces directly, so its win on these metrics is close to circular. Stability uses NNP energies on a hull restricted to MP-20 phases with no DFT check, and SUN decreases with protection on PF-ODE. There are no baselines at matched settings: no plain FIRE relaxation of the noised start, no MD annealing or basin hopping, and no learned generator. Many of the described protocols, including DFT validation, efficiency, cross-potential and score comparison, are not executed. The theory is mostly general and does not explain why the layers work. Conservativity holds for any energy gradient. The steady-state result does not cover density-scaled noise. The reflection theorem is stated for an idealized process rather than the implemented projection. The reliability condition is refuted by the authors’ own measurements.
Questions for authors
- Compare against 1) FIRE or BFGS relaxation of the same noised starts 2) MD annealing and basin hopping at matched force evaluation 3) a learned generator conditioned on the same compositions.
- Report the composition-only start, so the method is evaluated as generation rather than recovery of a given structure. Also report DFT checks on a subset of the stable candidates.
- Run 1) the repulsion-off arm at matched drift caps and 2) a DFT force scan across the threshold, to show that the boundary and the analytic wall matter beyond the hard constraint.