- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces GEM-FIELD, which predicts electron densities from molecular geometries and uses them for property evaluation and SCF initialization. It places multiple Gaussian shells around atoms and learns their radii, widths, and nonlinear angular distributions to represent the residual relative to the SAD density. The Gaussian expansion of the predicted density is used to construct the Coulomb matrix in the target AO basis. DFT evaluation and a generalized eigensolution then provide orbitals and approximate properties, or the resulting density matrix is used as an initial guess for SCF.
Critical strengths
The solver-oriented motivation is supported by actual calculations. All 1,050 OOD molecules in SCFBench converge, and the number of SCF iterations is reduced by approximately 40.5% relative to MINAO initialization. When model inference and initial density-matrix construction are included, the total runtime reduction with the analytical Coulomb implementation is smaller, at 8.98%. I appreciate that the paper explicitly reports results that include these overheads.
Critical weaknesses
The additional contribution of the model and training approach over existing methods is not sufficiently established.
GEM-FIELD constructs a Fock matrix from the predicted density and diagonalizes it to obtain a density matrix and electronic properties, so its downstream computations are closely related to those of Hamiltonian prediction models. However, Tables 2–3 mainly compare against models that directly predict properties or energies and forces, while comparisons with Hamiltonian models are limited to the SCF initialization evaluation in Table 4. Methods such as QHFlow2, which derive orbitals, energies, and forces from predicted Hamiltonians, should be compared using the same data and DFT settings. The SCDP and BOA models already trained for Table 1 should also be evaluated through the same solver pipeline in Tables 2–3, and trained under the SCFBench setting to compare performance and cost in Table 4. If this is technically difficult, the necessary transformations, approximations, integrals, and additional costs should be explained explicitly. The absence of trained checkpoints alone does not make a convincing case for the necessity of the GEM-FIELD model or methodology over existing approaches. (QHFlow2, Kim et al., 2026)
Also, it needs to be compared with the recent benchmark of the SCF acceleration. SAIL was posted on arXiv on April 23, 2026, and reports that solver-aligned training can improve extrapolation to larger molecules for Hamiltonian and density-matrix models. However, this paper neither cites nor discusses this work, and provides no comparison with it. It is therefore difficult to assess the limitations of matrix-based approaches or the relative transfer advantage of density representations from the OOD results of existing QHNet and QHFlow models alone. Baselines that apply solver-aligned training to existing representations are important for assessing the benefits for SCF initialization. Beyond the density-error ablations in Table 6, it would be helpful to distinguish the effect of changing the representation within the same solver pipeline from the effect of changing the training objective using a common model where feasible. (SAIL, Eberhard et al., 2026) Without this comparison, the message is easily misled into thinking that the matrix-based or coefficient-based methods are not a good approach.
Training and initialization settings and total computational cost are unclear.
The exact PySCF routine used to construct SAD, and its relationship to the MINAO evaluation baseline, should be specified. A SAD-only baseline, with the learned residual set to zero, should also be evaluated using the same Fock construction and diagonalization. Reporting errors in both the predicted density and the resulting density matrix would help clarify the respective contributions of the learned correction and the subsequent electronic-structure calculations.
The end-to-end SCF timing in Appendix C is useful, but the energy and force results in Tables 2–3 do not report the time required for Coulomb/XC matrix construction, diagonalization, and property evaluation after model inference. Comparisons with MLIPs and Hamiltonian predictors should include total evaluation time on the same hardware, including the derivatives and post-processing required by each method.
Questions for authors
Comparison with density and Hamiltonian models. Could Tables 2–3 include QHFlow2 or other Hamiltonian prediction models evaluated using the same data, functional, and AO basis? Please also train ELECTRA, SCDP, and BOA for the respective benchmarks and evaluate them through the same solver pipeline to compare accuracy, SCF convergence, and total runtime in Tables 2–4. If this is difficult, please explain the specific technical constraints and additional costs, beyond the absence of trained checkpoints.
Total runtime and model scaling. Could you break down the time spent on inference, Coulomb/XC matrix construction, diagonalization, and energy/force evaluation in Tables 2–3, and compare total runtime against MLIPs and Hamiltonian predictors, including all required derivatives and post-processing? I would also like to understand the accuracy–runtime trade-off when increasing backbone size while keeping the number of shells and quadrature fixed. In particular, can a larger, more accurate model reduce total SCF runtime?
Level-3 training under the same budget. How do density NMAE and the property results in Tables 2–3 change when the same model is trained on level-3 grids with the same number of sampled points per molecule and optimization updates? Please also report actual training time and explain why level-0 was selected. If this comparison is difficult, please specify the computational constraints.
Definition of SAD and the effect of the learned correction. Could you specify the exact PySCF routine and basis settings used to construct SAD, its relationship to the MINAO initial guess, and how SAD/MINAO is used by each baseline in Table 4? Please also evaluate a SAD-only baseline with the predicted residual set to zero using the same Fock construction and diagonalization, and report errors in both the original predicted density and the resulting density matrix.
Effect of the parameter scaling on downstream performance In the OOD SCF calculations in Appendix C, inference takes 0.025 seconds out of a total of 9.910 seconds, or approximately 0.25%. A larger, more accurate model could therefore save more time by reducing SCF iterations than it adds through inference. The current angular-cutoff ablation reports only density accuracy, so the relationship between model size, property accuracy, and total runtime needs further evaluation.
6 comments
W2. Discuss SAIL (Eberhard et al., 2026) and distinguish the effect of density representation from solver-aligned training objectives.
Response: Thank you for pointing out SAIL. We have added a citation and discussion of SAIL in Section 5.3. We fully agree that the OOD degradation of directly supervised Hamiltonian and density-matrix models reflects a mismatch between ground-state supervision and SCF solver dynamics, and that SAIL's solver-aligned training effectively restores OOD SCF transfer for matrix-based models. At the same time, our revised experiments demonstrate the advantage of the representation under a shared direct-supervision objective and identical solver pipeline: in Tables 1–3, GEM-FIELD, SCDP, BOA, and ELECTRA are all trained with the same direct density loss without solver backpropagation, yet GEM-FIELD transfers substantially better to OOD properties and forces; similarly, in Tables 4–5, GEM-FIELD outperforms the directly supervised auxiliary-basis model NequIP-L, especially under AO basis expansion. Because differentiating through SCF iterations (including DIIS) requires a differentiable solver and increases training memory and runtime, we view representation design and solver-aligned training as complementary and note their combination as a promising future direction.
W4&Q2. Break down stage-wise runtimes for force evaluation (Tables 2–3) on identical hardware against MLIPs, QHFlow2, and DFT.
Response: We added a complete stage-by-stage runtime and accuracy breakdown on the 51-atom folic-acid geometry in Appendix C.4 (Table C2), evaluated on the same NVIDIA RTX 4070 Laptop GPU (mean std over 3 runs after 3 warm-ups) using QM9-trained checkpoints. Timings cover preparation, network forward pass, Coulomb/XC construction, diagonalization, and force evaluation (including automatic energy differentiation for NequIP/MACE, MINAO input-Fock construction for QHFlow2, and full grid/auxiliary-basis derivative responses for density and Hamiltonian models):
- Self-consistent DFT takes 29.243 ± 0.327 s.
- Direct MLIPs run in 0.0303–0.0720 s, but incur large OOD force MAEs of 300.47–333.07 meV/Å.
- QHFlow2 takes 10.024 ± 0.051 s and yields a force MAE of 193.78 meV/Å.
- GEM-FIELD (level-0, numerical ) takes 11.354 ± 0.079 s (0.287 s prep, 0.073 s network forward, 3.879 s Coulomb/XC, 0.023 s diagonalization, and 7.092 s force evaluation)—running 61.2% faster than DFT while achieving a force MAE of 65.04 meV/Å, which is 78.4% lower than the best MLIP and 66.4% lower than QHFlow2 at only a 13.3% runtime increase. Analytical takes 12.843 s with the same 65.04 meV/Å MAE, and the level-3 numerical model takes 11.116 s with 69.20 meV/Å MAE.
The effect of scaling the backbone size on SCF runtime is detailed in Q5 below.
Q3. Report density, property, and SCF results when training on subsampled level-3 grids, along with training costs and the grid-generation bottleneck.
Response: We initially trained on level-0 grids because on-the-fly CPU generation of complete level-3 grids was a severe data-loading bottleneck, largely due to spatial grid sorting. During the rebuttal, we switched to GPU4PySCF grid generation with spatial sorting disabled, accelerating level-3 grid construction by 11.4× on water and 24.5× on benzene:
| Molecule | Grid level | CPU, default (ms) | CPU, no sorting (ms) | GPU4PySCF, default (ms) | GPU4PySCF, no sorting (ms) |
|---|---|---|---|---|---|
| Water | 0 | 1.721 | 0.377 | 1.794 | 1.259 |
| Water | 3 | 22.683 | 1.787 | 2.579 | 1.997 |
| Benzene | 0 | 9.022 | 2.521 | 2.529 | 2.015 |
| Benzene | 3 | 135.421 | 33.003 | 6.198 | 5.527 |
This enabled training GEM-FIELD on level-3 grids (sampling 1,000 points per molecule per visit) for 500,000 steps on QM9-PBE (~120 RTX 5090 GPU hours) and 300,000 steps on SCFBench (~60 RTX 5090 GPU hours). As updated in Tables 1–4, level-3 training substantially improves performance across all tasks despite fewer optimization steps:
- Density NMAE (Table 1): Level-0 and unpruned level-3 NMAEs drop to 0.035% and 0.037% (down from 0.037% and 0.226% for level-0 training), achieving the best accuracy on both grids.
- Properties & forces (Tables 2–3): Outperforms the level-0 model on 10 of 11 ID metrics and 6 of 11 OOD metrics, reducing ID energy-component MAEs by 77.5%–83.8%, ID total-energy MAE from 0.61 to 0.22 meV/molecule, ID force MAE from 4.81 to 3.21 meV/Å, and OOD energy-component MAEs by 36%–58%.
- SCF acceleration (Table 4): Lowers SCFBench ID and OOD RICs by 5.90 and 2.03 percentage points (from 58.40%/59.53% to 52.50%/57.50%), and reduces mean OOD end-to-end runtime from 8.959 s to 8.566 s (Table C1).
W3&Q4. Specify the exact PySCF SAD definition, its relation to MINAO in Table 4, and evaluate a zero-residual SAD-only baseline through the same one-shot pipeline.
Response: We have clarified these definitions and added the SAD-only baseline to Tables 1–3:
- SAD vs. MINAO and Table 4 baseline protocols: SAD is constructed via
pyscf.scf.hf.init_guess_by_atom(mol)in the spherical-harmonicdef2-SVPAO basis (cart=False), which block-diagonally superposes spherically averaged neutral-atom HF density matrices . In contrast, PySCF's defaultMINAOinitial guess projects minimal atomic natural orbitals onto the target AO basis. In Table 4, all RIC values are measured relative to MINAO: GEM-FIELD constructs and diagonalizes it once to obtain ; NequIP-L constructs directly from its full predicteddef2-universal-jfitdensity without SAD; QHFlow2 takes as conditioning input to predict and diagonalizes it; QHNet and QHFlow follow the official SCFBench protocol. - SAD-only baseline (, Tables 1–3): We evaluated raw SAD densities and passed through the exact same DF-PBE/def2-SVP Fock construction and single diagonalization . On QM9-PBE, SAD-only has level-0 and unpruned level-3 density NMAEs of 12.805% and 12.766% (and 12.768% / 12.734% on OE62-OOD). After one Fock diagonalization, still incurs huge errors on QM9-PBE (energy MAE of 15,306.77 meV/molecule, HOMO–LUMO gap MAE of 860.41 meV, and force MAE of 2,276.34 meV/Å) and OE62-OOD (37,831.62 meV/molecule, 482.45 meV, and 2,269.55 meV/Å). Adding GEM-FIELD's learned residual reduces these errors by 2 to 5 orders of magnitude (to 0.22 meV/molecule, 3.23 meV, and 3.21 meV/Å on ID), confirming that the accuracy stems from the learned density correction rather than the single diagonalization step.
Q5. Evaluate backbone parameter scaling (50M model) on end-to-end SCF runtime and report downstream property errors in the Table 6 ablations.
Response: We trained a 50M-parameter backbone variant, GEM-FIELD-L (level3), keeping the shell counts and degree-15 Lebedev quadrature fixed. As shown in Table 4, scaling from 3.6M to 50M parameters further reduces ID and OOD RICs from 52.50% and 57.50% to 51.58% and 56.79% with 100% convergence, achieving the lowest OOD RIC among all compared methods. In the end-to-end timing across all 1,050 OOD molecules (Appendix C, Table C1), enlarging the model under the numerical branch increases mean inference time by only 0.006 s (0.025 s 0.031 s) while reducing subsequent SCF time by 0.063 s (6.546 s 6.483 s, the shortest SCF time of any method), lowering total wall-clock time from 8.718 s to 8.642 s (increasing aggregate speedup from 1.25× to 1.26×). For the analytical branch, SCF time similarly drops from 6.539 s to 6.505 s (total time 8.672 s vs. 8.566 s for the 3.6M model).
Finally, we added one-shot HOMO–LUMO gap MAE and RMSE (evaluated on a 1% random test subset) to the angular-cutoff and backbone ablations in Table 6. Increasing the EquiformerV2 cutoff from to steadily lowers level-0 density NMAE from 0.066% to 0.037% and reduces the downstream gap MAE from 8.91 meV to 4.60 meV (and RMSE from 13.02 to 6.76 meV) overall, linking higher-order angular expressivity to downstream electronic-property accuracy.
Response to Reviewer DThF
Thank you for your rigorous review and constructive suggestions. We have conducted the requested experiments—including evaluating QHFlow2 across Tables 2–4, benchmarking SCDP/BOA/ELECTRA and a SAD-only baseline through the one-shot solver pipeline, training level-3 and 50M-parameter GEM-FIELD models, and adding stage-wise runtime breakdowns—and updated the manuscript accordingly.
W1&Q1. Evaluate QHFlow2 and density baselines (SCDP, BOA, ELECTRA) under the same solver pipeline across Tables 2–4, and clarify technical constraints and runtime overheads.
Response: We added QHFlow2 to Tables 2–4 and Appendix Tables C1–C2, and evaluated SCDP (trainable exponents), BOA, and ELECTRA through the same one-shot solver pipeline in Tables 2–3:
gdb_033390(C5N4, 92.93% of QHFlow2's total squared ID force error), Hamiltonian errors along near-singular overlap directions create a spurious occupied orbital (ε≈−17.38 Ha vs. +1.21 Ha), corrupting Pulay forces. On OE62 OOD (Tables 2–3), QHFlow2 degrades to 33,750.53 meV/molecule energy MAE and 4,470.92 meV/Å force MAE (vs. 13.32–16.38 and 24.65–29.72 for GEM-FIELD), and on SCFBench OOD (Table 4), all GEM-FIELD variants (59.53%/57.50%/56.79%) beat QHFlow2 (61.22%).We did not retrain them on SCFBench (Table 4) because initial-guess Coulomb construction makes them slower end-to-end than MINAO, even when they reduce SCF cycles. Because they lack a standard atom-centered 3-center Coulomb interface in GPU4PySCF (SCDP uses atom/bond-centered uncontracted functions with scaled exponents; ELECTRA uses floating anisotropic Gaussians; BOA applies nonlinearities to GTO products), our pipeline constructs ΔJμν by contracting grid densities with analytical AO-pair integrals Aμν(rg):
=\int \widehat{\Delta\rho}(\mathbf r') A_{\mu\nu}(\mathbf r') d\mathbf r' \approx\sum_g w_g \widehat{\Delta\rho}(\mathbf r_g) A_{\mu\nu}(\mathbf r_g), \quad A_{\mu\nu}(\mathbf r') =\int\frac{\phi_\mu(\mathbf r)\phi_\nu(\mathbf r)} {\lVert\mathbf r-\mathbf r'\rVert} d\mathbf r.$$ On 51-atom folic acid (RTX 4070 Laptop GPU, QM9 checkpoints), initial-guess construction with this grid-based $J$ takes **33.75–59.53 s** (residual $J$ alone ~30 s)—already matching or exceeding the **entire 36.26 s MINAO SCF run**. Thus, even though SCDP and BOA cut SCF cycles from 19 to 14 and 12, $J$-construction overhead overwhelms SCF savings, causing a **2.08×–2.38× net slowdown (0.42×–0.48×)** vs. MINAO (while ELECTRA rises to 22 cycles). Combined with their OOD degradation (Tables 2–3), retraining them on SCFBench is unnecessary. Conversely, GEM-FIELD's analytical and FMM-numerical $J$ paths take only **4.18–5.82 s** for initial-guess construction, achieving **1.34×–1.44×** speedups on folic acid and up to **1.27×** (21.15% savings) on all 1,050 SCFBench OOD molecules (Appendix C, Table C1). | Initialization scheme | Inference (s) | Initial-guess construction (s) | SCF (s) | SCF iterations | Total wall-clock (s) | Speedup vs. MINAO | |:---|---:|---:|---:|---:|---:|---:| | MINAO (default) | – | – | 36.26 | 19 | 36.26 | 1.00× | | GEM-FIELD (numerical $J$) | 0.065 | 4.18 | 21.01 | 11 | 25.25 | **1.44×** | | GEM-FIELD (analytical $J$) | 0.061 | 5.82 | 21.12 | 11 | 27.00 | 1.34× | | SCDP (density-grid $J$) | 0.096 | 59.53 | 26.59 | 14 | 86.21 | 0.42× | | ELECTRA (density-grid $J$) | 0.069 | 33.75 | 41.69 | 22 | 75.51 | 0.48× | | BOA (density-grid $J$) | 0.136 | 57.05 | 22.77 | 12 | 79.95 | 0.45× |