- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2(+1)
Read review
Paper summary
CatalyState does not retrain a generic reaction model; it specializes the geometry that model produces toward a particular active site. With no supervision available for enzyme-specific transition regions, the critic is trained on solved enzyme–ligand complexes to tell native arrangements from deliberately perturbed ones, and the search is bounded twice over: hard checks from atom-mapped bond changes and clashes discard inadmissible candidates, while a trust region and a displacement cap limit how far it can drift from the starting proposal. Three experiments follow: the critic separates controlled context perturbations, the search raises its own utility on all three upstream priors, and against an external GFN2-xTB evaluation used neither in training nor in search, two of the three priors show lower reaction-coordinate error while the third does not reach significance. The authors characterize the preference as a local ranking signal rather than a calibrated energy, and separately report wrong-pocket, foreign-pocket and uniform-sampling controls.
Critical strengths
1. There is an external evaluator, and there are proper negative controls.
A wrong-pocket search, a size-matched foreign-pocket contrast, an external evaluator used neither for training nor during search, and uniform sampling sitting in the same table as the proposed solver. Few papers in this area run all of that. Fewer report it when it comes out badly, and the appendices here do so plainly — one proxy, in the authors' own words, "does not establish an independent physical advantage for native context". The terminology is disciplined in the same way: nothing the method produces is called a transition state.
2. Specialize a frozen generator instead of retraining it.
When supervision in a domain is scarce and a strong generic generator already exists, retraining is expensive and liable to discard transferable structure. The alternative taken here is to leave the generator alone, let domain evidence define a preference over its output, and use explicit support and movement limits to bound how far adaptation can go. The discussion states this as a general principle, and it is one: nothing in it depends on enzymes or on transition states.
Critical weaknesses
1. Nothing outside the critic's own score shows that the enzyme matters.
The headline context result permutes chemistry inside a fixed pocket, which is one of the counterfactual families the critic is trained on. Appendix G supplies the contrast it was not trained on — a size-matched foreign pocket — and on the enzyme-OOD split the frozen critic sits near chance; the dual-critic variant stays near chance there as well, and the authors note that it does not update the critics actually driving search. Appendix E arrives at the same place from the other direction: against the independent evaluator, native context has no advantage over a wrong pocket and the interval crosses zero. Section 6.4 puts the critic's agreement with that evaluator a little above a coin flip, and the per-fold critics doing the refinement discriminate noticeably worse than the figure shown in the main text. The paper is called enzyme-conditioned. Once the judge is anything other than the critic itself, the identity of the enzyme stops making a measurable difference.
2. On the one metric it does not optimize, the method does not beat uniform sampling.
Table 2 reports the quantity the search optimizes, so it can only establish that the objective is optimizable, and even there a fixed-temperature baseline sits almost level with CPT-CEM. On the independent evaluator the picture changes: REPS is indistinguishable from uniform sampling, and a single projected gradient step is clearly better. Appendix F is more direct still — at the matched downstream initializer stage, the xTB path that serves as the evaluator is itself a better initializer than the refined output. The same appendix reports that the material-gain fraction falls sharply in the largest substrate bin, where the sample is small.
Questions for authors
-
Section 6.1 concludes that endpoint supervision carries a transferable enzyme-context signal. But the headline context result permutes chemistry inside the same pocket, which is one of the counterfactual families the critic is trained on, and Appendix G reports that the untrained foreign-pocket contrast sits near chance on the enzyme-OOD split. Do the critics that actually drive refinement separate native from foreign pockets any better, and if not, what is being conditioned on?
-
Section 6.2 reads the wrong-pocket control as evidence that refinement stays sensitive to the enzyme environment. That control is scored on the learned utility. Appendix E runs the same control against the independent evaluator and finds no advantage for native context. Which of the two supports the claim?
-
Table 3 shows REPS indistinguishable from uniform sampling and worse than a projected gradient step on the independent evaluator, while Table 2 reports the quantity the search optimizes. What result establishes that the enzyme preference, rather than bounded perturbation under hard constraints, produces the reaction-coordinate improvement? Reporting the independent error with the critic removed — support and trust region kept, selection on feasibility alone — would settle this directly; please state the selection rule so the full model cannot re-enter through a final rerank.
-
The independent evaluator is an endpoint-restrained scan, the utility carries an endpoint actor term, and the feasible set is built from endpoint-derived intervals. In what sense is the evaluation independent of the supervision?
-
The discussion argues that upstream generation and enzyme-context modelling can be improved separately and composed at inference. Appendix F reports that the xTB-path initializer outperforms CPT-REPS at the matched downstream stage. What does the composition add once that path is available?
6 comments
- Independence of the physical evaluation
The GFN2-xTB evaluator provides a separate physical objective based on the interior maximum of a restrained reaction-coordinate scan. Its energies and reaction-coordinate errors are not used to train the critic or score candidates during inference.
The evaluation shares the mapped reaction, endpoint structures, and molecular environment used to construct the refinement problem. This is necessary to compare the predicted reaction geometries against a common reaction-coordinate reference. The resulting metric measures agreement with an energy-derived semiempirical reference and is interpreted accordingly.
We additionally conducted a quantum-chemical assessment on five enzyme systems, examining stationary-point convergence, the expected imaginary reaction mode, and bidirectional connectivity. CatalyState satisfies these criteria in 3/5 systems, compared with 1/5 for Geometry-only and 0/5 for the raw proposals.
This assessment provides complementary evidence concerning the physical relevance of the refined geometries.
- Value of composition when a physical reaction path is available
The xTB-path initializer achieves stronger performance at the matched downstream initialization stage, as reported in Appendix F. We retain this comparison.
CatalyState is designed for enzyme–reaction systems where an upstream generator is available but a reaction-specific physical path has not been computed. Its endpoint-trained preference can be applied to React-OT, TS-DFM, and MolGEN without retraining the generators or computing a new xTB reaction path for each inference.
The practical contribution is the ability to specialize transferable reaction geometries using enzyme-context information under explicit chemical and geometric constraints. The cross-prior physical improvements and matched ablations establish the utility of this approach in the evaluated setting. When a reliable physical path is already available, it remains a strong initialization option.
Thank you for the detailed response. I consider Q4 and Q5 settled.
Two things still open:
-
[W2 / Q3] Critic-free removes critic-based selection entirely, while Uniform in Table 3 keeps it and already ties REPS. So the 79.7% win rate does not separate CPT from reranking uniform samples with the same critic, and Appendix E rules out reconstructing that contrast from the existing rows. Could you report CEM against Uniform directly on the independent metric?
-
[W1 / Q2] Swapping the pocket also changes the steric support, not only the critic score. Could you run the foreign-pocket comparison under the critic-free configuration?
I noticed the posted PDF is still the original submission. Could you upload the revised version so I can go through the changes in context?
We thank the reviewer for the careful assessment and for highlighting the importance of establishing whether enzyme conditioning contributes to physical refinement. We have extended our evaluation with matched critic ablations, native-versus-foreign-pocket comparisons, and additional physical validation across three reaction priors.
We evaluated the contribution of enzyme conditioning on 59 systems with catalytic-actor annotations and eligible physical references, using matched proposals, feasibility constraints, and refinement budgets.
Across React-OT, TS-DFM, and MolGEN, CatalyState reduces mean reaction-coordinate MAE relative to Geometry-only by 0.026, 0.015, and 0.021 Å, respectively, with 41/59, 40/59, and 40/59 system wins. The lower bounds of the corresponding 95% confidence intervals are +0.008, +0.003, and +0.005 Å.
Replacing the native enzyme pocket with a matched foreign pocket increases mean MAE by 0.025, 0.018, and 0.018 Å across the same three priors. Native conditioning achieves 41/59, 40/59, and 40/59 wins, with positive lower confidence bounds in all three comparisons.
We also evaluated native-versus-foreign-pocket discrimination on enzyme-, substrate-, and double-OOD endpoint views, obtaining native preferences in 202/287, 193/274, and 211/302 cases, respectively. This follow-up is evaluated separately from the original frozen-checkpoint experiment.
These physical comparisons provide additional evidence that catalytic-environment information contributes to refinement beyond the geometric preference learned from endpoint structures.
The original 104-system React-OT/CPT-REPS comparison showed no significant native-pocket advantage. That evaluation covered a broader cohort and used a different refinement configuration. The new comparisons isolate the effect of correct enzyme conditioning within the actor-annotated physical-reference cohort and extend the evaluation to three reaction priors.
We further tested 30 independent enzyme–reaction systems. CatalyState achieves a mean MAE reduction of 0.025 Å over Geometry-only, with 23/30 system wins, and 0.020 Å over Wrong-pocket, with 22/30 wins.
The results indicate that enzyme-specific refinement provides measurable physical benefits when catalytic-site information is available. The 104-system analysis and the new matched evaluations are reported with their respective populations and protocols.
To isolate the learned preference, we performed a Critic-free ablation retaining the same initial proposals, hard constraints, displacement limits, and search budget. Feasible candidates are sampled and selected uniformly, with no learned-critic evaluations or final learned reranking.
Relative to Critic-free, Full CatalyState reduces mean reaction-coordinate MAE by 0.08366, 0.03627, and 0.03995 Å on React-OT, TS-DFM, and MolGEN, respectively. The corresponding 95% confidence intervals are [0.06257, 0.10470], [0.01954, 0.05334], and [0.01798, 0.06333] Å. System-level win rates are 79.7%, 66.1%, and 67.8%.
We also evaluated CPT-CEM directly against raw reaction proposals using the independent physical metric. The median MAE reductions are 0.04956 Å (React-OT, n=111), 0.02466 Å (TS-DFM, n=76), and 0.02452 Å (MolGEN, n=86), with positive bootstrap confidence intervals. CEM additionally improves upon Uniform and REPS on React-OT and TS-DFM; the corresponding differences on MolGEN remain statistically uncertain.
For the projected-gradient comparison, we corrected the displacement-budget mismatch and repeated the evaluation with the same 0.25 Å reacting-atom RMS limit. At nearly matched critic-operation budgets (514 versus 513 units), CEM is 8.28 times faster than Gradient128 (0.079 versus 0.653 s/system) and achieves higher feasible-selection coverage (77.91% versus 72.71%). Gradient128 achieves lower reaction-coordinate MAE on React-OT by 0.0209 Å.
These experiments identify complementary contributions from the learned preference, chemical feasibility constraints, and local search. The optimizer comparison also characterizes the trade-off between physical accuracy, feasible coverage, and computational cost.