- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper focuses on Molecular Ground-State Conformation Prediction, aiming to predict the ground-state three-dimensional conformation of a molecule from its two-dimensional molecular graph topology. The core idea is to enhance the model’s ability to capture molecular 3D structures by incorporating additional geometric inductive biases into the attention mechanism of a Graph Transformer. Specifically, the authors propose integrating two types of geometric information—Bond Angle Variance and Molecular Curvature—into the attention mechanism. The main technical contribution lies in the design and implementation of mechanisms that effectively incorporate these two geometric features into attention computation. Experimental results demonstrate that the proposed method achieves significant performance improvements on both the QM9 and Molecule3D datasets.
Critical strengths
- The main experimental results demonstrate significant performance improvements.
- The ablation studies and efficiency evaluations further validate the effectiveness and computational efficiency of the proposed method.
- Incorporating Bond Angle Variance and Molecular Curvature as geometric constraints into molecular geometry modeling offers a certain degree of novelty and research value. Their potential benefits may extend beyond the current task, suggesting broader applicability to other 3D molecular modeling tasks.
Critical weaknesses
- Although incorporating the two geometric constraints improves the model’s performance to some extent, the overall novelty and academic contribution of this work remain relatively limited. From a methodological perspective, the proposed approach primarily extends the existing GTMGC framework by introducing two additional geometric constraints, without offering substantial methodological innovation.
- The discussions of Bond Angle Variance and Molecular Curvature in the fourth- and fifth-to-last paragraphs of the Introduction lack sufficient support from the literature. The authors should cite relevant studies on molecular force fields, clarify the physical definition of angular strain, and provide a theoretical justification for using bond angle variance as a proxy for molecular strain. If such theoretical or empirical support is unavailable, the authors should explicitly acknowledge the heuristic nature of this design choice or provide experimental evidence demonstrating its correlation with actual bond-angle strain energy.
- In Equation (2), the authors use bond angle variance to quantify the extent to which local molecular geometry deviates from an ideal configuration. However, this metric measures the dispersion of bond angles around their mean rather than their deviations from equilibrium bond angles. For example, the two sets of bond angles, and , both have zero variance, even though they may correspond to different degrees of angular strain.
Questions for authors
- Why did the authors choose not to incorporate these geometric constraints directly into the loss function as additional optimization objectives? Would such an approach be feasible, and have the authors explored this possibility?
- Regarding the optional iterative decoding mechanism, why does the model’s performance deteriorate when the number of decoding iterations exceeds two? Could the authors provide any plausible explanations or insights into this phenomenon?
- Have the authors experimented with using multiple decoders with independent parameters, rather than sharing the same decoder parameters across iterations, to implement iterative refinement?
Post-Rebuttal Update: I appreciate the authors’ detailed rebuttal, which largely addresses my concerns regarding Bond Angle Variance. The additional experiments and explanations also provide useful answers to my questions. Although my concern about limited methodological novelty remains, I have decided to raise my rating from 2 to 3.
6 comments
w2:
Thank you for your suggestion. We have revised the two relevant paragraphs in the Introduction, added references on molecular force fields and discrete geometry, and clarified the distinction between physical energy terms and the geometric descriptors used in our method. The revisions are detailed below.
(1) Added references and clarified the physical definition of angular strain. We have cited UFF[1] and MMFF94[2] to explain that angular strain in molecular force fields is associated with deviations of actual bond angles from reference angles determined by the chemical environment. The corresponding energetic penalties depend on parameters and force constants for angle bending. These references provide the physical background for the relationship between angular deformation and energy.
(2) Clarified the geometric role and heuristic nature of bond angle variance. We have replaced “physically grounded measure of angular strain” with “a geometric descriptor of local angular nonuniformity” and explicitly stated that this descriptor serves as a heuristic geometric inductive bias for encoding local angular distributions. We have also added a citation to [3] to provide background on the use of angular distortion statistics in coordination geometry analysis.
(3) Added the geometric motivation for molecular curvature and clarified its interpretation. We have cited the work of [4] to explain the use of angle deficits for estimating discrete Gaussian curvature on triangulated surfaces. Our molecular curvature descriptor is now explicitly described as a geometric quantity inspired by angular defect, computed from the intermediate conformation and incorporated into positional encoding for global conformational modeling.
[1] A. K. Rappé, C. J. Casewit, K. S. Colwell, W. A. Goddard III, and W. M. Skiff. UFF, a Full Periodic Table Force Field for Molecular Mechanics and Molecular Dynamics Simulations. Journal of the American Chemical Society, 114(25):10024–10035, 1992. DOI: https://doi.org/10.1021/ja00051a040.
[2] T. A. Halgren. Merck Molecular Force Field. III. Molecular Geometries and Vibrational Frequencies for MMFF94. Journal of Computational Chemistry, 17(5–6):553–586, 1996. DOI: https://doi.org/10.1002/(SICI)1096-987X(199604)17:5/6<553::AID-JCC3>3.0.CO;2-T.
[3] K. Robinson, G. V. Gibbs, and P. H. Ribbe. Quadratic Elongation: A Quantitative Measure of Distortion in Coordination Polyhedra. Science, 172(3983):567–570, 1971. DOI: https://doi.org/10.1126/science.172.3983.567.
[4] M. Meyer, M. Desbrun, P. Schröder, and A. H. Barr. Discrete Differential-Geometry Operators for Triangulated 2-Manifolds. In H.-C. Hege and K. Polthier (Eds.), Visualization and Mathematics III, pp. 35–57. Springer, Berlin, Heidelberg, 2003. DOI: https://doi.org/10.1007/978-3-662-05105-4_2.
w3:
Thank you for highlighting this important distinction.
GeoGT combines bond angle variance and a curvature descriptor to capture complementary aspects of molecular geometry. Bond angle variance characterizes differences among angles within an atomic neighborhood, while the curvature descriptor directly incorporates actual bond angle values and local spatial scales, providing angular information that variance does not retain. For the two sets of angles provided by the reviewer, when the local spatial scale is held fixed, their different angle values yield different curvature descriptors, even though both sets have zero variance. Thus, identical bond angle variances do not imply identical geometric information available to GeoGT.
Within this framework, bond angle variance contributes to attention computation through learned atomic geometric embeddings, while the curvature descriptor participates in global conformational modeling through positional encoding, linking local angular organization to the representation of the overall molecular structure. Together with atomic attributes, molecular connectivity, and distance information, these descriptors support ground state conformation prediction. The model learns to use these features through supervision from interatomic distances in ground truth conformations and does not directly equate zero variance with an ideal geometry or a minimum energy state. Accordingly, we interpret these two descriptors as complementary geometric inductive biases rather than direct estimates of angular strain energy.
p1:
Thank you for your suggestion. Incorporating these geometric descriptors into the loss function is feasible. To evaluate this possibility directly, we conducted an additional experiment on QM9 by adding auxiliary losses for both bond angle variance and curvature to the original training objective:
Here, is the original distance supervision applied to the intermediate and final conformations, while and denote the auxiliary supervision terms for bond angle variance and curvature, respectively. The coefficients and control their contributions. The results are reported in Table R.4.
Table R.4: Evaluation of auxiliary geometric losses on QM9. The auxiliary-loss variant adds both bond angle variance and curvature losses to GeoGT. Lower values are better; the best results are highlighted in bold.
| Validation | Test | |||||
|---|---|---|---|---|---|---|
| Variant | D-MAE↓ | D-RMSE↓ | K-RMSD↓ | D-MAE↓ | D-RMSE↓ | K-RMSD↓ |
| GeoGT + auxiliary geometric losses | 0.172 | 0.350 | 0.275 | 0.174 | 0.353 | 0.277 |
| GeoGT | 0.125 | 0.289 | 0.201 | 0.130 | 0.298 | 0.210 |
As shown in Table R.4, adding the two auxiliary losses increases all three prediction errors on both the validation and test sets. On the test set, D-MAE increases from 0.130 to 0.17357, D-RMSE from 0.298 to 0.35293, and K-RMSD from 0.210 to 0.27696. Thus, the additional geometric supervision does not improve conformation prediction under the evaluated configuration.
Geometric descriptors can be useful for representation learning without requiring their errors to be optimized as separate objectives. Bond angle variance and curvature summarize particular aspects of molecular geometry. Adding losses on these descriptors changes the relative emphasis placed on different geometric errors during training. Reducing descriptor discrepancies does not necessarily yield a corresponding reduction in the distance and coordinate errors of the complete conformation. The distinction is therefore between using geometric information to guide prediction and assigning it additional weight in the optimization objective.
GeoGT incorporates these descriptors into geometric embeddings, positional encoding, and attention computation, allowing them to guide representation construction and information aggregation. The original distance objective supervises both the intermediate and final conformations, directing learning toward the target molecular geometry. The additional experiment supports retaining this combination of internal geometric modeling and distance supervision for the current model configuration.
p2:
Thank you for your question. Table 10 of the submitted manuscript shows that, within the evaluated settings, a moderate increase in the number of decoding passes improves prediction accuracy, with two passes achieving the best results. An additional pass allows the model to recompute geometric features from the previously predicted conformation and further refine local structures and the overall spatial arrangement using the updated geometric reference.
However, additional iterations also lengthen the sequence of updates, increasing the effective computational depth of the unrolled decoding process. Each iteration involves recomputing geometric features, positional encodings, and attention scores. As the number of iterations increases, residual errors in the preceding conformation may repeatedly influence subsequent predictions through these geometric features. When the gains from further refinement diminish, continued updates may introduce unnecessary adjustments to structures that are already reasonably accurate, potentially increasing prediction errors. We consider this a plausible explanation for the performance degradation observed with excessive iterations. Moreover, this mechanism performs learned conformational updates without imposing a constraint that prediction errors must decrease at every iteration. Greater computational depth therefore does not guarantee continued improvements in accuracy.
These results indicate that the number of iterations should balance prediction gains against computational cost. Two decoding passes can further improve accuracy, whereas a single pass provides higher computational efficiency. GeoGT therefore uses a single decoding pass by default and retains additional iterations as an optional refinement strategy, with the number of passes selected according to validation performance and the available computational budget.
w1:Thank you for your comments. GeoGT introduces methodological innovations in both geometric representation construction and the mechanisms through which geometry guides conformation prediction. Its central contribution is a unified modeling approach that connects local angular organization with global conformational representation by jointly designing geometric descriptors, positional encoding, and attention computation.
Existing approaches incorporate structural information through attention biases based on adjacency and pairwise distances, or modify molecular connectivity through force-based graph rewiring, as in ReBIND. GeoGT advances a different modeling direction: angular geometry explicitly conditions both the positional representations of atoms and their information exchange. Our methodological innovations are detailed below.
(1) An explicit computational mechanism connecting angular distributions to geometric attention. We transform bond angle variance into learnable atomic geometric embeddings and combine them with geometric positional representations to compute interaction weights between atoms. These weights enter the geometric residual attention term, allowing the angular organization of atomic neighborhoods to directly influence attention scores and information aggregation. This design extends the geometric conditioning of atom interactions from pairwise connectivity and distance to the organization of angles involving neighboring atom triplets. The resulting mechanism establishes a concrete connection between local angular statistics and the computation of interatomic interactions during ground state conformation prediction.
(2) A curvature descriptor constructed from angular geometry and local spatial scales. To construct a curvature descriptor directly on molecular graphs, we combine an angular-defect-inspired quantity with normalization by a local area scale:
mci=4πRi2+ϵ4π−∑θ∈Θi2π(1−cos2θ).
Here, 2π(1−cos(θ/2)) is the solid angle of a spherical cap with angular radius θ/2. Aggregating these angular terms and incorporating the local spatial scale Ri provides a geometrically motivated construction that jointly describes angular organization and spatial extent without requiring an explicit molecular surface mesh. The descriptor is invariant to translations and rotations because its constituent bond angles and distances are invariant to these transformations. It also preserves information complementary to bond angle variance: identical variances can produce different curvature descriptors because the latter depend on actual angle values and local scales. These analytical properties underpin the construction of the geometric representation used by GeoGT.
(3) A coupled mechanism for global positional modeling and local geometric interaction. We further design how this atomic curvature descriptor participates in global conformational modeling. Curvature-dependent weights are integrated with molecular connectivity, intermediate distances, and graph positional information to construct geometric positional representations. These representations participate in attention computation and are jointly used with variance embeddings in geometric residual attention. The curvature branch therefore conditions the positional representation across the molecular graph, while the variance branch introduces local angular organization into geometric interaction weights. Their coupling enables local and global geometric information to jointly guide the decoder.
These designs establish a unified computational pathway from bond angle distributions to curvature construction, positional representation, and attention-based information aggregation. This coordinated design of geometric representations and their integration mechanisms constitutes the core methodological innovation of GeoGT for ground state conformation prediction.