- Rating
- 2(−1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes EquiSolv, an O(3)-equivariant graph neural network for predicting continuous molecular solvation energy fields derived from Grid Inhomogeneous Solvation Theory (GIST). Unlike voxel-based methods that predict values on a fixed three-dimensional grid, EquiSolv predicts atom-specific coefficients of a radial-basis-function and spherical-harmonic expansion and aggregates the resulting local expansions to reconstruct the field at arbitrary spatial coordinates. The model combines molecular graph features, optional ESM-C protein sequence embeddings, and equivariant message passing using Gated Convolution and SE(3)-Transformer layers. The paper also presents an asymptotic approximation-error analysis under smoothness assumptions, without analyzing finite-sample statistical error. Experiments on 1,100 peptide systems from DBAASP and 94 protein targets from DUD-E evaluate field prediction, compare EquiSolv with a 3D U-Net and DeepGIST, and assess the recovery of strongly bound water sites. The results suggest that EquiSolv can accurately predict GIST-derived energy fields with substantially lower inference cost than generating the corresponding labels through molecular dynamics simulations.
Critical strengths
- The paper addresses the high computational cost of obtaining solvation thermodynamics through explicit-solvent molecular dynamics and GIST simulations. Directly predicting solvation energy fields from molecular structures is a promising approach for large-scale screening.
- The use of O(3)-equivariant layers is appropriate for molecular geometry, while atom-centred expansions and spherical harmonics enable continuous field reconstruction. The global positional-awareness term based on displacement from the molecular centre of mass is also a specific architectural design choice that complements local message passing.
- The paper reports inference time and memory consumption, describes the simulation and training setups, and provides extensive appendices covering features, hyperparameters, ablations, evaluation metrics, and baseline comparisons. Releasing the generated GIST data and implementation would further support reproducibility and future comparisons.
Critical weaknesses
- The paper compares EquiSolv with a 3D U-Net and DeepGIST, but DeepGIST predicts a target that includes an entropy term and is not retrained specifically for the eGIST target used by EquiSolv. Therefore, the substantial RMSE difference against DeepGIST does not provide a controlled comparison of model architectures. Although the 3D U-Net is a more directly comparable baseline, further comparisons using consistent targets, data splits, preprocessing, and hyperparameter selection would better isolate the benefits of the proposed approach.
- A central advantage of EquiSolv is its ability to evaluate the field at arbitrary coordinates rather than only at fixed grid points. However, the main regression results are evaluated on a 1.0 Å grid. Although the paper investigates different grid-coarsening settings, direct evaluation at off-grid coordinates or at resolutions different from the training grid would provide stronger evidence for the practical benefits of continuous reconstruction over voxel-based prediction.
- The training objective assigns greater weight to voxels with larger log-space target magnitudes to emphasize non-bulk regions. Although the paper includes ablations of loss weighting and related hyperparameters, further analysis of how these choices affect prediction errors across different molecular systems would help establish the robustness of the selected configuration.
- The paper reports aggregate regression metrics and evaluates non-bulk regions separately, but these results do not fully reveal where prediction errors occur within molecular structures. An analysis of errors around different residue types, charged groups, or regions with complex solvent interactions would provide a clearer understanding of the model's strengths and limitations.
Questions for authors
The questions and concerns I intended to raise have already been outlined in the Weaknesses section above.
3 comments
The authors have addressed some of my concerns, but I have a few remaining questions about their response. It would be helpful to clarify whether the 3D U-Net was tuned using the same validation set as EquiSolv. Comparing EquiSolv with another baseline trained on the same eGIST target and data split would help assess the benefits of the proposed architecture. The values of 0.831 and 0.766 in the main text do not appear to match the RMSE values of 0.522 and 0.269 in Table 17.
Thank you for your response.
To answer your questions:
- The 3D U-Net was indeed tuned with the same validation set as Equisolve, we used the same training/validation/test split.
- Thank you for pointing our the error, these were the wrong numbers in the text. We correct them and upload a revision.
Rebuttal to Reviewer rLTg
We thank the reviewer for their detailed and positive comments. We now address the weaknesses point-by-point.
W1: DeepGIST did not expose training code nor did they publish data, so it was not possible to get a same training comparison with it. The 3D U-Net was trained and scored on the same train/eval/test split, following the same preprocessing.
W2: Off-grid ground-truth is not available, since solvers are run on grids. Though the proposition of training on coarser and testing finer grid resolutions is possible (at 0.5 distance increments, as this is the radius of our truth grid), we have now run inference using our model trained on 1.0 coarseness against 0.5 and 2.0 coarseness grids and find: Predictably 1.0 (0.176 ± 0.026) and 2.0 (0.139 ± 0.028) are close, as there are no extra points added but rather a mean is drawn to create the coarsening. While 0.5 (0.279 ± 0.048) shows a slightly poorer RMSE as we already discovered through ablations. We include this table in Appendix Q, and upload a revised PDF.
W3: If we correctly understood what you mean by molecular systems, this would require retraining the loss ablation on additional datasets which is beyond what we can provide for this revision. The weighted loss was already removed on both systems we study. Validation MSE gets worse on DBAASP peptides and on DUD-E proteins (0.0101 to 0.0144 on DUD-E, with the rest of the configuration held fixed). Within DBAASP, the selected model also keeps its top-1000 F1 lead in every size tercile (Appendix J), so the result is not confined to one peptide size.
W4: These are insightful and inspiring suggestions about refining our model’s settings and potentially improving its performance on specific tasks, especially for future downstream applications, these directions will definitely help tailor the model to better solve more concrete problems. We already have aggregate regression metrics in Table 1 and the all-region rows of Table 2. Pooled RMSE, 99th-percentile absolute error, and max absolute error are in Table 13 in Appendix N. Non-bulk regions separately are in Table 2, rows under “non-bulk region …“. The native grid version is in Table 6 in Appendix H. Per-residue errors on these same voxels are in Table 16 in Appendix O. The coarser split, ionisable residues {R, K, H, D, E} against neutral residues, is Table 15 in Appendix N. Errors for voxels within 4 Å of one residue type, and of two or more residue types, are in Table 17 in Appendix P.