- Rating
- 2
- Confidence
- 1
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates the different scaling exponents of equivariant neural force fields and unconstrained neural force fields with rotational data augmentation. The authors construct empirical NTK from Jacobians at early training checkpoints and estimate their eigenvalue-decay and target-alignment exponents. In experiement comparing equivariant eSEN with rotationally augmented Orb on the OMol25, early-checkpoint empirical NTK analysis reveals broadly similar spectral decay but stronger alignment for eSEN, consistent with its steeper model-size scaling. Additional experiments with other architectures further examine the connection between early kernel measurements and scaling exponents.
Critical strengths
The experiments provide useful evidence linking target alignment to scaling behavior. After the initial training phase, eSEN consistently exhibits stronger measured target alignment than Orb and a steeper fitted model-size scaling exponent. The comparison across four architectures broadens the evidence beyond a single model pair. These findings may help guide architectural choices and the allocation of training resources for neural force fields.
Critical weaknesses
- The conceptual advance appears limited, and the empirical contribution needs stronger support. The main potentially novel contribution is the connection between early-checkpoint force-NTK measurements and subsequent scaling behavior. However, the novelty of the multi-epoch evaluation is overstated: lines 87–91 characterize [A] as considering only single-epoch training, although Section 4.5 and Figures 8–9 of [A] already compare augmented unconstrained models with eSEN over 100 epochs using 1% of the dataset. The present experiments extend this comparison to Orb and a larger repeated-data subset. The authors should acknowledge this overlap and demonstrate the additional explanatory or predictive value of the NTK analysis beyond the previously observed scaling differences.
- The experimental setup differs from the assumptions of the theory. The cited theory assumes squared loss and gradient descent/SGD, whereas the experiments use absolute energy error, an unsquared force norm, and Schedule-Free AdamW. The analysis also considers only the force-output NTK, although energy supervision contributes to updates of the shared parameters. The authors should justify why the prediction remains applicable to this setup or provide control experiments using force-only squared loss and SGD.
- The practical benefit of NTK-based forecasting is not demonstrated. The paper does not report the runtime or peak memory required for the NTK calculation and spectral analysis. Using an early checkpoint does not establish that the complete forecasting procedure is inexpensive, since these computations introduce additional costs. The authors should report the total computational cost and compare the approach with cheaper forecasting baselines to substantiate its practical benefit.
[A]: Ngo et al. "Scaling laws and symmetry, evidence from neural force fields." ICLR 2026.
Questions for authors
See Weaknesses.
2 comments
Official Comment by Authors
Dear Reviewer,
Thank you again for your time and effort in reviewing our paper.
As the discussion period is coming to a close, we would like to kindly ask whether our responses and additional experiments have satisfactorily addressed your concerns. We would be happy to provide any further clarification if needed.
Best regards,
The Authors
Official Comment by Authors
We thank the reviewer for their valuable feedback. We have accommodated these in the updated revision and would like to address the questions and weaknesses here. We would be happy to address any remaining issues during the discussion period.
Weakness 1
We have updated the contribution section to better acknowledge the prior multi-epoch training results. The reviewer is correct that our main contribution is explaining the different scaling exponents for architectures reported in [1], with the addition of the widely used Orb architecture, for which our analysis also provides a successful explanation/prediction.
Weakness 2:
We have added additional results in Appendix E showing that using SGD or Schedule-Free AdamW with squared error loss on forces only. The trends are similar, and the predicted exponents do not change substantially. We discuss this in detail in Appendix E.
Weakness 3
We now report these quantities in Appendix C, which shows a negligible cost compared to training a single model, let alone a full stack of models at every scale. The rough difference is one day (for multiple random seeds) using our predictions compared to one week of GPU-hours required to train a model such as eSEN at every size.
[1] Ngo et al. "Scaling laws and symmetry, evidence from neural force fields." ICLR 2026.