- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes an approach to inorganic synthesis based on pairwise reactions, i.e. the observation that solid-state reactions happen with pairs of precursors. The authors use an LLM to augment the dataset with additional reactions, use another LLM as the single-step model, and fine-tune the entire system with RL on synthesis routes. The method is evaluated with traditional synthesis metrics (top-k accuracy and frontier top-k), in addition to plausibility assessment based on stoichiometry and thermodynamical behavior.
Critical strengths
- The paper identifies pairwise reactions as an important inductive bias under-utilized by previous methods.
- The authors create a benchmark dataset based on pairwise reactions augmented with AI-generated samples which opens the way for future methods in this same line of work.
Critical weaknesses
-
(W1) Novelty compared to organic synthesis planning: This is the biggest weakness of the work, and the main reason for my rejection. The paper seems to borrow the idea of "a search algorithm running a single-step model recursively to produce a synthesis tree with purchasable leaves" directly from organic synthesis. While I understand inorganic chemistry traditionally generates the synthesis plan as a set of precursors, the search + single-step model was already fairly established in organic synthesis and seems to be borrowed verbatim with minor engineering efforts. The tree-RL fine-tuning was also already covered in organic synthesis [1,2] and not cited in this work. I can change my score if the authors show (both theoretically and empirically) what scientific contributions emerged from adapting this approach to inorganic chemistry.
-
(W2) Missing empirical results: Empirically, the evaluation does not isolate the effect of neither pairwise reaction prediction nor the search algorithm. If these are signficant components, they should be evaluated through the following ablations: 1) use the same single-step model you put in search to generate the precursors in a single-shot, and 2) run a search-based approach where the single-step model is trained on reactions with an arbitrary number of precursors. Additionally, traditionally baselines are cited but never compared empirically including [3], [4] and [5] to only name a few.
-
(W3) Secondary presentation concerns: below is a list of things to improve in the presentation of the paper.
- framing: this is related to the novelty issue. If the paper's main contribution is the new dataset, it should be reframed around a dataset and evaluation contribution. Right now it reads more as a method's paper with many missing elements.
- illustrative figures missing: Figure (1) should use a larger font. The authors could also add extra figures illustrating routes and precursor sets recovered by different baselines.
- rewriting some sections: sections 5.1. to 5.3. mix evaluation setup with result reporting, when section 4.4 is supposed to have already described the experimental setup. I suggest rewriting to have all metrics' definitions and justifications in one place, preferably before presenting the results.
Questions for authors
- What is the use of frontier top-k, beyond being a more relaxed version of precursor topk?
- What would you say are the key lessons the ML community can learn from adapting search-based synthesis planning to inorganic synthesis?
References
[1] Liu, Xue et al. Retrosynthetic Planning with Dual Value Networks. ICML 2023. https://proceedings.mlr.press/v202/liu23as/liu23as.pdf
[2] GRASP: Navigating Retrosynthetic Planning with Goal-driven Policy. NeurIPS 2022. https://papers.neurips.cc/paper_files/paper/2022/file/42beaab8aa8da1c77581609a61eced93-Paper-Conference.pdf
[3] Prein et al. Retro-Rank-In: A ranking-based approach for inorganic materials synthesis planning. 2025. https://arxiv.org/abs/2502.04289
[4] Aykol, M., Montoya, J. H., and Hummelshøj, J. Rational solid-state synthesis routes for inorganic materials. Journal of the American Chemical Society, 143(24):9244–9259, 2021. doi:10.1021/jacs.1c04888.
[5] Szymanski, N. J., Nevatia, P., Bartel, C. J., Zeng, Y., and Ceder, G. Autonomous and dynamic precursor selection for solid-state materials synthesis (ARROWS3). Nature Communications, 14:6956, 2023. doi:10.1038/s41467-023-42329-9.