- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes BondFF, which augments a geometric graph with an atom–bond-state bipartite graph to explicitly represent continuously varying bonding states and charge redistribution. The method uses orientation-invariant and orientation-equivariant bond states, constructs strictly conserved atomic charges through a signed incidence matrix, and decomposes the residual energy into bond, charge-response, and electrostatic energies. The authors report improved prediction accuracy on several molecular and reaction datasets and provide dynamics tests.
Critical strengths
- Incorporating bonding changes and charge conservation into machine-learning force fields is well motivated.
- The reported evaluations cover systems of different sizes and types.
- The numerical results are generally strong.
Critical weaknesses
-
I appreciate the authors for uploading the code, but it does not appear to match the method described in the paper. Sections 3.1–3.2 describe virtual bond-state nodes, along with the aggregation, propagation, and updating of bond states through atom nodes. However, the submitted
PairChargeModuleprimarily feeds radial features and optional features such as element types into a standard MLP, with two hidden layers in the default configuration. I do not see the atom–bond-state bipartite message passing described in the paper in this branch. Section 3.3, Equations (11)–(13), and Proposition 3.1 present directed charge-transfer flows and a charge-conserving readout as core contributions, but in the provided BondFF branch I could not find predictions of relevant properties. The energy readout also does not match the definition in Section 3.4. The README states that the root directory containssetup.cfg,pyproject.toml,MANIFEST.in, andLICENSE.md, and instructs users to runpip install -e .. However, all four files are missing from the provided directory, preventing installation as instructed. -
The latent bond strengths and charges are not supervised or physically validated, so the chemical interpretation is currently unsupported.
-
The dynamics results do not establish the claimed reliability. The tests in Section 4.2 and Appendix E.3 focus mainly on a single held-out Transition1x molecule. In an NVT trajectory with a target temperature of 300 K, BondFF produces an average temperature of 395.5 K. Although this is closer to the target than the other listed methods, it is still a substantial deviation and undoubtedly indicates an error in the simulation. I do not consider this an acceptable result to present in a paper.
-
I do not think the existing ablations adequately explain why the method works. Appendix E.4 contains parameter sensitivity analyses, and Appendix E.5 and Table 7 report results from removing each of the three energy terms and from two structural variants. These comparisons are valuable. However, removing energy terms one at a time mainly establishes their roles within the full configuration; it does not adequately distinguish the benefit of an additional energy correction from the benefits of explicit bond-strength and charge modeling. The two structural variants also change several design choices at once. The orientation-independent variant removes the orientation initialization and all associated components, while Full BondFF removes the geometric backbone and randomly initializes atom features. The current results therefore make it difficult to separate the contributions of bipartite graph propagation, bonding representations, and the charge-conservation mechanism. A directly relevant control would compare a standard pairwise MLP energy correction with the full method, using the same backbone and similar parameter counts. This comparison is particularly necessary because the provided code closely resembles the former model, while several core mechanisms ablated in Table 7 are absent from that implementation.
Questions for authors
See weaknesses.
2 comments
[2/2] Response to Reviewer YPAX
Response to Weakness 3 [Molecular dynamics reliability]
The dynamics results do not establish the claimed reliability. The tests in Section 4.2 and Appendix E.3 focus mainly on a single held-out Transition1x molecule. In an NVT trajectory with a target temperature of 300 K, BondFF produces an average temperature of 395.5 K. Although this is closer to the target than the other listed methods, it is still a substantial deviation and undoubtedly indicates an error in the simulation. I do not consider this an acceptable result to present in a paper.
Response:
We would like to clarify that the single held-out Transition1x molecule was used for the illustrative MD trajectory. The quantitative evaluations in Tables 1–3 were conducted on the complete test sets, not on that single molecule.
The reported average was calculated over a 100 ps trajectory. We conjecture that the deviation may be due to insufficient equilibration. We therefore re-evaluated BondFF and the baselines with an explicit equilibration phase.
The new figure shows that BondFF has a mean temperature of 298.9 K over the displayed 100 ps trajectory, closest to the target among the methods compared. We have included this figure in the revised paper and moderated our claims accordingly.
To assess stability across a broader set of held-out systems, we evaluate the stability metric with MD simulation on AIMD-Chig, 3BPA, th Transition1x testing set, and HORM testing set. The table reports stability time in ps.
| Method | AIMD-Chig | 3BPA | Transition1x | HORM |
|---|---|---|---|---|
| MACE | 59.87 | 100 | 45.80 | 51.05 |
| EquiformerV2 | 81.65 | 100 | 52.44 | 62.24 |
| PaiNN | 39.79 | 48.87 | 34.86 | 39.08 |
| GemNet-OC | 23.49 | 59.32 | 39.38 | 36.03 |
| Neural P³M | 74.05 | 100 | 38.24 | 41.96 |
| BondFF | 89.12 | 100 | 58.41 | 68.50 |
BondFF has the longest reported stability time on AIMD-Chig, Transition1x, and HORM, and matches the longest reported time on 3BPA.
Response to Weakness 4 [Ablations and matched pairwise control]
I do not think the existing ablations adequately explain why the method works. Appendix E.4 contains parameter sensitivity analyses, and Appendix E.5 and Table 7 report results from ...
A directly relevant control would compare a standard pairwise MLP energy correction with the full method, using the same backbone and similar parameter counts ...
Response: Our existing ablations in Appendix E.5 and Table 7 remove each of the bond, charge, and electrostatic energy terms in turn. Relative to the default model, each removal worsens the reported errors across HORM, Transition1x, and Chignolin, with the size of the effect depending on the metric and dataset. The orientation-agnostic and Full BondFF variants also test broader structural changes, while Appendix E.4 examines parameter sensitivity.
To alleviate the reviewer's concern, we added a capacity-matched pairwise MLP energy correction using the same MACE backbone. Full BondFF achieves lower errors across all seven metrics. We also evaluated a generic pair-state control and variants retaining only the bond, charge-response, or electrostatic term. Full BondFF achieves the lowest error on every reported metric across these comparisons. Together, these controls show that the full combination of bonding and charge-related components yields the strongest performance and provide a more focused assessment of their contributions.
| Model | Description | HORM energy | HORM force | HORM Hessian | Transition1x energy | Transition1x force | Chignolin energy | Chignolin force |
|---|---|---|---|---|---|---|---|---|
| Backbone only (MACE) | No correction branch | 0.148 | 0.098 | 0.192 | 0.071 | 0.083 | 1.027 | 0.389 |
| Backbone + pairwise MLP | Generic pairwise energy correction, matched in capacity to BondFF | 0.149 | 0.102 | 0.198 | 0.083 | 0.085 | 1.290 | 0.498 |
| Generic pair-state control | Generic pair-state control | 0.839 | 0.582 | 0.983 | 0.482 | 0.428 | 1.293 | 0.375 |
| Bond only | Bond term only | 0.165 | 0.091 | 0.225 | 0.125 | 0.099 | 0.904 | 0.322 |
| Charge response only | Charge-response term only | 0.153 | 0.113 | 0.179 | 0.113 | 0.096 | 0.907 | 0.341 |
| Electrostatic only | Electrostatic term only | 0.153 | 0.131 | 0.207 | 0.126 | 0.087 | 0.609 | 0.241 |
| Full BondFF (default) | All proposed components | 0.129 | 0.051 | 0.097 | 0.063 | 0.081 | 0.564 | 0.153 |
[1/2] Response to Reviewer YPAX
We thank the reviewer for the thoughtful assessment. We appreciate the recognition that incorporating bonding changes and charge conservation into machine-learning force fields is well motivated, as well as the positive assessment of the evaluation across diverse systems and the numerical results. Below, we address each concern and provide clarifications and additional results, which have been incorporated into the revised manuscript and highlighted in blue.
Response to Weakness 1 [Code–paper consistency and installation]
Response: Because the paper had not yet been published, we initially chose not to release the full implementation and uploaded an incomplete code branch. We have now uploaded complete scripts implementing the framework described in the paper. We have also added the missing installation files and updated the README.
Response to Weakness 2 [Physical validation of latent quantities]
Response: We agree that the latent bond strengths and charges are not physically validated, and we do not claim that they reproduce physical bond strengths or atomic charges. Our objective is to construct a predictive force field; the reported evaluations therefore focus on energy and force predictions.
To illustrate how the learned quantities respond to changing geometries, we have added an exploratory analysis of pair-level responses along Transition1x test reaction paths. In the illustrated examples, several responses vary for pairs with large distance changes, while those of pairs with small distance changes remain comparatively stable. These results suggest that the learned representations capture diverse responses to geometric changes, without establishing a physical interpretation of the latent quantities. The revised manuscript includes the corresponding figures and discussion.