- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies whether transition-state (TS) structures available during training improve reaction-barrier prediction from reactants and products alone. It curates four existing datasets and evaluates supervised RPTS pretraining followed by encoder transfer and endpoint-only fine-tuning across six encoders.
Critical strengths
The distinction between direct TS access and benefits retained after removing TS inputs is useful. The evaluation across four datasets and six encoders, together with paired uncertainty estimates and dataset-specific barrier definitions, helps substantiate the findings.
Critical weaknesses
-
Limited incremental contribution and modest performance gains. The method adds TS inputs to barrier-supervised training and subsequently transfers a shared encoder. This is a straightforward and intuitive extension, and its methodological contribution appears limited. Tables 2 and 3 show substantial gains with direct TS access, but only a modest benefit is retained through RPTS pretraining. The limited endpoint-only improvements leave the practical effectiveness of the proposed approach insufficiently established.
-
Insufficient access to supporting materials and documentation. Page 15 refers to exact identifiers and integrity metadata in a machine-readable release without providing an access location. Pages 14–15 similarly defer construction scripts, and p.22 defers checkpoint lineage. I could not locate these resources. Machine-readable resources should be accompanied by clear, reviewer-accessible documentation.
Questions for authors
-
Where can reviewers access the release referenced on pp.15 and 22?
-
Could the authors explain why training-time TS access yields only modest endpoint-only gains, and discuss how more of this benefit might be retained at inference?
4 comments
Brief Follow-up on Our Rebuttal and Additional Results
Dear Reviewer tEzQ,
Thank you again for your thoughtful feedback. We would like to briefly follow up on our responses regarding the practical benefits of TS-informed learning, the scope of our contribution, and access to supporting materials.
Our responses provide the anonymous repository and reproduction instructions, clarify the framework’s applicability across encoders and pretraining objectives, and present additional generated-TS experiments using our existing frozen predictors without further training or fine-tuning.
If your schedule permits, we would greatly appreciate a brief indication of whether these additions address your concerns, or which points would benefit from further clarification.
Thank you for your time and consideration.
Best regards, The Authors
Thank you for the response. The additional materials and experiments address some of my concerns. However, my major concern remains. The general benefit of pretraining for downstream prediction is well established in the community, while the incremental gains from TS-informed encoder transfer remain small.
Overall, the revisions do not sufficiently change my assessment of the contribution, and I am inclined to maintain my rating.
Clarifying the Benchmark and Framework Contributions
Thank you for following up and for acknowledging that the additional materials and experiments address some of your concerns. We would like to clarify the overall scope of our contribution: we formulate the question of how TS information can benefit endpoint-conditioned prediction, establish a diagnostic benchmark and extensible framework, and develop two deployment strategies, with generated-TS prediction delivering substantial gains on both Grambow test splits. Encoder pretraining and transfer constitute one component of this broader contribution.
The benchmark asks a more specific question. It separates the direct predictive value of TS structures from the benefit accessible when only R/P structures are supplied at deployment. Across four audited datasets and six encoders, we evaluate these questions with leakage controls, alongside complementary grouped-random and unseen-family evaluations on Grambow. The gap between direct TS access and encoder transfer is itself an informative finding: it motivates examining how different strategies make TS-related predictive benefit accessible.
The framework accommodates different TS-information transfer strategies. Encoder transfer is one such strategy and can incorporate different supervised and self-supervised pretraining objectives. Our endpoint-only comparison uses an RP-pretrained control, so it examines the incremental benefit of TS-informed initialization over RP pretraining. Table 5 extends this comparison to five additional objectives, showing compatibility with both supervised and self-supervised pretraining. These objectives are alternative components of the framework, rather than competitors to a single prescribed pretraining method.
We also introduce a generation-based prediction strategy within this framework. It combines an existing TS generator with the trained RPTS encoder and prediction head, keeping all components frozen. This strategy requires no additional training or fine-tuning and is instantiated with both React-OT and TS-DFM. Both variants yield lower mean MAE than encoder transfer across all six encoders on the Grambow grouped-random and unseen-family test splits (Tables 3–4). This strategy also outperforms all six established baselines evaluated on the Grambow grouped-random test set, using only R/P structures as external inputs at deployment. With ClofNet and TS-DFM, it achieves an MAE of 6.912 kcal/mol, compared with 10.870 kcal/mol for the strongest external baseline, a 36.4% reduction (Table 16). Thus, the framework supports both encoder transfer without TS generation and explicit structural recovery using existing generators.
Our contribution therefore combines a diagnostic benchmark, an extensible framework, and two practical strategies for using TS-informed learning. We do not position the work as another standalone 3D predictor whose contribution rests solely on state-of-the-art MAE, nor as a demonstration that pretraining generally helps. We would appreciate your reconsideration of the work based on these contributions together, rather than the encoder-transfer gains alone.
Response: Benchmark Release, Transfer Effectiveness, and Further TS Recovery
We sincerely appreciate your valuable feedback. We have conducted additional experiments in response to your comments and will incorporate the corresponding results into a future version of the paper.
We have updated the materials in our anonymous repository. They are available now.
Reproduction instructions and checkpoint details are provided in
docs/REPRODUCIBILITY.mdandREVIEWER_DEMO.md.To understand why encoder transfer yields such gains and how more of the TS benefit might be recovered, we therefore explore an extension of our current transfer strategy: supplying generated TS structures to the existing RPTS encoder and prediction head, without additional training or fine-tuning.
We evaluated this extension on Grambow using React-OT and TS-DFM to generate TS structures from R/P.
All columns use the same 1,159 Grambow validation reactions; MAE (kcal/mol) is mean ± SD over three downstream seeds. A0 (RP-pretrained) and A1 (TS-informed encoder transfer) use only R/P.
Percentages indicate the fraction of the A0-to-reference-TS MAE gap recovered.
Both generation routes yield lower mean MAE than A1 across all six encoders. TS-DFM closes 82.0–88.4% of the MAE gap for four encoders and 28.6–31.7% for ClofNet and MACE.
These results suggest that the transfer gains may partly reflect how TS information is used. Encoder transfer carries training-time TS knowledge into an endpoint-only model through its parameters, whereas generation supplies an explicit TS structure for each reaction. The larger gains through generation are consistent with useful TS-related information not being fully captured by encoder transfer alone. Our existing RPTS encoder and head can exploit this additional route without retraining, extending the framework beyond endpoint-only encoder transfer.
Encoder transfer retains its practical advantage: it improves endpoint-only prediction without running a TS generator. While the approach is simple, our experiments demonstrate its effectiveness across multiple datasets and encoders, as well as its compatibility with different pretraining objectives. Our aim is to establish compatibility with different pretraining objectives, rather than claim that barrier-supervised pretraining is the best objective. This will be explained in the following part.
We appreciate you raising this important concern. We agree that the approach is relatively simple. However, our experiments demonstrate its effectiveness across multiple datasets and encoders, and its compatibility with different pretraining objectives. Our contribution is a general TS-informed pretrain-and-transfer framework, evaluated across different encoders and pretraining objectives. The results are summarized below:
The following two tables report test MAE in kcal/mol.
Endpoint-only transfer. Across four datasets and six encoders, all 24 pairs show lower mean MAE after TS-informed transfer. Two Grambow examples are:
Compatibility with different pretraining objectives. On Grambow–ClofNet, every evaluated objective has lower mean endpoint-only MAE when TS is included in pretraining:
The Table 5 comparison is within each objective: these supervised and self-supervised alternatives are components of our strategy. Together, the results of Table 5 support applicability beyond one encoder or objective.