- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a variational Kohn–Sham training framework for machine-learning force fields without precomputed DFT energy and force labels. Experiments on molecular systems show competitive force accuracy and promising generalization.
Critical strengths
- Eliminating the need for precomputed DFT labels could reduce the data-generation burden for machine-learning force fields.
- The density-matrix parameterization, eigendecomposition gradient treatment, and analytical force construction address implementation challenges, supported by a relatively detailed mathematical analysis.
Critical weaknesses
- The paper lacks comparisons with several relevant lines of prior work, including variational neural-network DFT-based training [1, 2], label-free electronic-structure learning [3], and methods incorporating SCF procedures [4]. The authors should clarify what is fundamentally novel beyond adapting these existing ideas to force-field prediction.
- The method still requires electronic-structure calculations during training and inference. A comprehensive end-to-end comparison with supervised training is lacking.
- Performance depends strongly on the sampling temperature and configuration coverage. More controlled experiments are needed to disentangle the benefits of variational training from those attributable to the training-data distribution. Furthermore, for larger molecules, the number of configurations required for convergence and the resulting model performance remain unclear.
[1] Li Y, Tang Z, Chen Z, et al. Neural-network density functional theory based on variational energy minimization[J]. Physical Review Letters, 2024, 133(7): 076401.
[2] Mathiasen A, Helal H, Balanca P, et al. Reducing the cost of quantum chemical data by backpropagating through density functional theory[J]. arXiv preprint arXiv:2402.04030, 2024.
[3] Zhang H, Liu C, Wang Z, et al. Self-consistency training for density-functional-theory hamiltonian prediction[J]. arXiv preprint arXiv:2403.09560, 2024.
[4] Wang Z, Liu C, Zou N, et al. Infusing self-consistency into density functional theory hamiltonian prediction via deep equilibrium models[J]. Advances in Neural Information Processing Systems, 2024, 37: 89652-89681.
Questions for authors
Related concerns are discussed in the weakness section.
3 comments
I appreciate the authors' substantial efforts in revising the manuscript and conducting additional experiments. Most of my original concerns have been adequately addressed, and the revised manuscript is significantly improved. I am therefore willing to increase my rating.
We sincerely thank you for the thoughtful feedback and positive assessment of our revised manuscript.
Response to Reviewer Pwhd
W1 — Prior work [1]–[4]; what is fundamentally novel
The revised paper cites [1]–[4], D4FT (Li et al., 2023), Hassan et al. (2025) and Dong et al. (2025), and credits them in Sections 1 and 2 (in blue) for the objective, the eigendecompose-and-occupy density construction, the minimal-basis anchor and the SCF-initial-guess use of Appendix I.
What is novel is what turns the objective into a force field, which none of [1]–[4] attempts. (i) Forces: none of the four computes one ([2] states they "can be derived from the Hamiltonian" and does not test it; [3] leaves the MD22 force labels unused). The loss reaches the predicted matrix only through its occupied subspace, so its eigenvalues are never trained (Section 4.2); forces read from them are 518× worse than ours and the uncanonicalised Rayleigh-quotient readout 132× worse (Table A7). The canonicalised readout of Eq. (5), exact to 10⁻⁹ meV/Å at a converged density, is ours. (ii) Single-pass inference: [2] follows the network with three DFT iterations and [4] iterates it to a fixed point; ours is one forward pass, one Fock build, one gradient, and Appendix H shows why even one Roothaan step overshoots. (iii) A backward pass with only occupied–virtual denominators (Eq. 6), where [3] clips eigenvalue differences and skips steps and [1], [2] describe no treatment; a primitive, not a new idea, and the revised Section 4.2 and Appendix G cite PySCFAD (Zhang & Chan, 2022) and Kasim (2020). To our knowledge no prior model trained this way has been evaluated as a force field.
W2 — Electronic-structure calculations remain at training and inference; end-to-end comparison
Table 2 is an end-to-end comparison: its supervised side pays labelling plus training and its variational side training only, with the same network, geometries, optimiser, schedule, seed and GPU type, scored on identical frames against our own converged SCF. On all four molecules the variational model has the lower force and energy error at the lower total cost; the aspirin and azobenzene gaps lie far outside the seed-to-seed spread of the new Appendix N, the ethanol and malonaldehyde force gaps inside it. Appendix F repeats the comparison on 3BPA at ωB97X/6-31G(d), where the two routes cost the same and the variational model's force error is about half the supervised one on every test set.
W3 — Dependence on sampling temperature and coverage; configurations needed for larger molecules
To separate sampling from objective we gave MACE our training distribution outright: maintainers' rMD17 settings, our 94,950 ethanol geometries sampled at 1600 K with a converged label for each, 20 epochs (1.9 million frame visits, twice our 950,000), scored on the same complete 1,000-frame test set against our converged SCF. MACE is one training run; our entries are the mean ± SD over three training seeds:
Given our geometries and a label for each, MACE does not approach our accuracy (Table A15, new Appendix N): the training distribution alone does not produce the accuracy, and the objective alone (Table A6) does not produce the robustness under extrapolation.
Larger molecules: Appendix E trains one model across the eight galectin-8 ligands (52 to 64 atoms) with the budget of a single rMD17 molecule, 95,000 geometries and 237,500 steps in total, i.e. 11,875 geometries per ligand. It reaches 0.90 to 0.96 meV/Å force MAE on every ligand (Table A5), against a mean of 0.98 meV/Å for the per-molecule rMD17 models: for drug-like molecules of this size the configurations consumed and the accuracy reached are comparable to the small-molecule case, with an eighth of the geometries per molecule.