- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This work proposes EnergyRetro, which feed Reaction knowledge graph (RKG) and bond dissociation energy (BDE) into an agentic single-step model and uses Retro* like algorithms for multistep retrosynthesis search. It further utilized round-trip consistency as well as RKG support to ensure the proposed reaction is chemically valid.
Critical strengths
- Integration of Bond Dissociation Energy (BDE) into Retrosynthesis Planning This work proposes to use BDE to ensure proposed reaction in retrosynthesis planning is chemically valid, which is quite interesting and it did improve the performance as the ablation study shows.
Critical weaknesses
-
The experimental design does not isolate the claimed contribution. EnergyRetro simultaneously changes single-step candidate generation, reaction scoring, retrieval, memory reuse and search during retrosynthesis planning. However, the experiments do not establish which component accounts for the reported improvement. In particular, the paper does not specify which single-step model was used by the conventional baselines or compare those using the same scoring function (energy risk, round-trip, RKG support). Consequently, the results support the performance of the entire system as a whole, but do not establish the benefit of energy guidance or the proposed constrained multistep planning algorithm.
-
Key implementation and evaluation choices are insufficiently specified for a controlled comparison. Although sec 3.4 and appendix B.4 describe and A*-like partial route search, its implementation relationship to Retro* and the substantive differences from existing planners remain unclear. Those baseline model configurations are also underspecified. Moreover, the reported planning budget uses model-specific units, where EnergyRetro may invoke LLM multiple times for one valid expansion and others may just expand a molecule or an entire route. need to explicitly state such difference. The provided repository in anonymous.4open.science is empty with only a readme, makes it harder to reproduce and interpret.
Questions for authors
- What is the single-step model used for other baselines and how does the "Agentic Single-step Expansion" module perform compared to other single-step models?
- RKG construction is filtered by matching either reactants or products against reactions in USPTO-190 and Chembl-1000. However, as pointed by prior RAG-driven single-step or multi-step methods [1][2][3], similar molecules may still serve as important reference to the current molecule. Could the authors provide a similarity analysis or reactions in the RKG against test set molecules?
- What makes the constrained multi-step search algorithm differ from Retro*? Is it possible to provide an ablation study on energy scoring, RKG retrieval and route memory while keeping single-step model, planner, and budget fixed?
- What is the actual value of depth limit and does accounts those multiple LLM calls during one "Agentic Single-step Expansion"? What is the intuition behind current settings for the reaction cost?
- Is it possible to provide a self-contained repo instead of a single readme file?
[1] Single-step retrosynthesis prediction by leveraging commonly preserved substructures [2] How Well Can LLMs Synthesize Molecules? An LLM-Powered Framework for Multi-Step Retrosynthesis [3] LLM-Augmented Chemical Synthesis and Design Decision Programs
4 comments
Rebuttal by Authors(Part 2)
Q3. Difference from Retro* and fixed-configuration component ablations
Like Retro*, EnergyRetro uses best-first search over an AND-OR representation. Our contribution is not a claim that the underlying AND-OR search principle is new. Rather, the implementation connects BDE-derived energy risk, RKG support, and round-trip consistency to reaction costs, applies molecular validity/depth/ancestor-cycle constraints, and reuses completed subroutes through Route Memory. The reaction cost is
The component ablations above use the same EnergyRetro model configuration and search budget and quantify the impact of removing energy guidance, RKG, or Route Memory. A planner-only comparison using identical single-step candidates, identical scores, and identical budgets would isolate the contribution of the search procedure relative to Retro*. Given the limited rebuttal period, this comparison has not yet been completed. We will complete it as soon as possible and update the manuscript with the results.
W2/Q4. Search depth, expansion units, LLM calls, and reaction-cost weights
We agree that expansion counts must be distinguished from external LLM calls. In Table 1, N denotes method-specific planning expansions (which may be single-step or route-level); for EnergyRetro, a complete Agentic Single-step Expansion may involve multiple LLM calls. N_LLM separately counts external calls and is therefore the more direct measure for comparing agentic computation budgets.
On USPTO-190, under 100 and 300 external LLM-call limits, EnergyRetro achieves 84.21% and 88.95% solve rates; AOT* achieves 83.16% and 90.53%. EnergyRetro averages 132.6 calls across all targets (68.4 for solved targets) and consumes 48.3 million tokens. We will show both expansion and call budgets clearly, without suggesting that EnergyRetro wins at every budget.
In our experiments, we set the maximum route depth to d_max = 15 for USPTO-190, ChEMBL-1000, PaRoutes-n1, and PaRoutes-n5. Route depth counts reaction steps along a synthesis branch; it is not the number of internal LLM calls. Each invocation of the complete single-step module counts toward E_max, while its external calls contribute to N_LLM.
We use fixed weights λ_E = 0.3, λ_G = 0.5, and λ_RT = 0.5. The base cost of 1 penalizes extra reaction steps, while the additional terms incorporate assessed energy risk and lack of RKG/round-trip support. These are fixed heuristic weights; we do not claim they have been shown to be globally optimal.
W2/Q5. Code repository availability — clarification
We appreciate the reviewer's attention to reproducibility and apologize for any confusion caused by the repository state at the time of inspection. We had submitted the code repository with the paper, but the repository was still being updated, and the version visible when the reviewer accessed it may not have reflected the complete implementation. We understand why a README-only snapshot would make reproduction difficult, and we should have communicated the update status more clearly.
The anonymous repository is available at here. We will provide a concise inventory of the available agent workflow, planner, energy-tool interfaces, RKG scripts, prompts, evaluation code, environment instructions, and runnable examples. We appreciate the opportunity to clarify this point and will ensure the review-accessible snapshot is complete and clearly documented.
Thanks for the rebuttal. However, this still does not isolate different components in multistep retrosynthesis, and the provided ablation is only for its single-step part. Atop of many other ambiguity in the manuscript, I am keeping my original score. I would suggest a much more detailed and controlled ablation.
Thank you for your follow-up and valuable suggestions. We would like to clarify two aspects of our methodology and experimental evaluation.
- Multistep Component Ablations.
The component ablations reported in our previous rebuttal are conducted on end-to-end multistep retrosynthesis planning (SR@500), rather than single-step prediction tasks. Under the same EnergyRetro framework and search expansion budget, the full system achieves 97.40%, while removing the energy-cost contribution, RKG, and RouteMemory yields 82.11%, 63.16%, and 73.68%, respectively. These experiments evaluate the contributions of the corresponding components to multistep route-solving performance.
The previously reported λ_E = 0 setting removes the energy term from the search cost while retaining energy information in agentic candidate generation and refinement. We are conducting an additional w/o Energy experiment that removes energy information from both stages to provide a more fine-grained controlled comparison.
- Relationship to Retro and Planner Contributions.
EnergyRetro adopts a Retro*-like AND–OR best-first search backbone. Our contribution is not a fundamentally new search algorithm, but the integration of BDE-informed agentic reasoning, RKG-supported reaction evaluation, and RouteMemory into multistep retrosynthesis planning. Accordingly, our component ablations are performed within this common search framework to evaluate the contributions of the proposed mechanisms.
We will further clarify the ablation configurations, computational budgets, and methodological distinctions in the revised manuscript.
Rebuttal by Authors(Part 1)
We thank the reviewer for the detailed comments and for recognizing the interest and potential of incorporating BDE information into retrosynthesis planning. We agree that the original manuscript could better separate system-level gains from the effects of individual components, and we appreciate the opportunity to clarify the experimental settings and code availability.
W1. The experimental design does not isolate the claimed contribution
We agree that EnergyRetro combines candidate generation, reaction assessment, retrieval, memory, and search. The reported full-system results should therefore be interpreted as the performance of the integrated framework. To provide more granular evidence, we conducted the following component ablations on USPTO-190:
These ablations indicate that each component contributes within the EnergyRetro implementation. We agree they do not, on their own, isolate the benefit of the planner under a fixed set of single-step proposals and identical reaction scores. We will narrow our claims accordingly and distinguish the full energy-guidance pathway from the isolated effect of the ΔBDE descriptor.
Q1. Single-step baseline configurations and Agentic Single-step Expansion
We follow the single-step model configurations benchmarked by Retro-R1: Greedy DFS and Retro* use the template-based MLP with V1 weights; EG-MCTS uses V2; PDVN uses V4; Retro-R1 uses V1 for candidate generation and V4 for reranking; and RetroAgent uses pretrained DESP weights. V1–V4 refer to pretrained variants of the same MLP architecture.
For additional context, on USPTO-50K without reaction-class labels, our energy-guided single-step module with GPT-5.5 obtains Top-1/3/5/10 accuracies of 65.7/74.1/78.2/82.8%. Published Top-1 results for LocalRetro, Graph2Edits, and EditRetro are 53.4%, 55.1%, and 60.8%, respectively. These comparisons are informative but not fully controlled, since model pretraining and retrieval resources differ. We will clarify these configurations and limitations in the paper.
Top-k exact-match accuracy (%) on USPTO-50K without reaction-class labels.
Q2. Similarity between RKG reactions/products and test molecules
We agree that reaction-level filtering does not remove all structurally related precedents. Our additional canonical-product audit found target overlaps of 5.26%, 5.60%, and 3.59% and unique-intermediate overlaps of 6.35%, 9.56%, and 7.83% on USPTO-190, PaRoutes-n1, and PaRoutes-n5, respectively.
Excluding identical molecules, the median maximum Tanimoto similarity between each test target and retrieved RKG products is 0.713/0.673/0.676, respectively. The fractions with a retrieved non-identical product of similarity ≥ 0.9 are 4.21/4.31/3.99%. These analyses quantify the retrieved structural context but do not prove complete independence from benchmark-related knowledge. We will add the statistics and explain the remaining limitation.