- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes MARS, an LLM-based framework for molecular structure elucidation from mass spectra. MARS combines retrieval-based initialization (IP-CoT), spectrum-grounded reflection (SD-CoT), and Monte Carlo Tree Search to iteratively refine candidate structures. Experiments on NPLIB1, MolPuzzle, and MassSpecGym show improvements over several existing baselines. The paper also includes component ablations, robustness analyses, and qualitative examples on real wastewater spectra.
Critical strengths
-
The paper addresses a challenging and practically relevant problem. Reformulating molecular structure prediction as an iterative search process is well motivated. In particular, using spectral discrepancies to guide structural edits is a sensible approach to grounding LLM reasoning in external evidence.
-
The experimental evaluation is reasonably comprehensive. The authors evaluate MARS on multiple benchmarks and provide component ablations, robustness analyses, and comparisons under shared candidate initialization. These experiments offer useful evidence for the benefits of iterative structural refinement.
Critical weaknesses
-
The comparison with existing methods is missing an important baseline. Table 1 compares MARS mainly against earlier methods such as DiffMS and MS-BART. However, FRIGID (Bohde et al., 2026) [1], which is already cited in the paper, reports substantially higher accuracy on NPLIB1 (25.03% Top-1 and 33.37% Top-10) than MARS (8.91% and 15.87%). Although differences in evaluation settings need to be considered, I would expect a direct comparison with the full FRIGID method, rather than only using it in the separate refinement experiment.
-
I am not fully convinced of the methodological novelty over existing work. K-MSE (Zhuang et al., 2025) [2] already combines external molecular knowledge, spectrum-based evaluation, and MCTS for structure elucidation. The main difference appears to be the specialized spectral-diagnostic prompting used to guide candidate edits. Moreover, Table 3 shows relatively modest improvements over FRIGID refinement (+1.52 Top-1 and +2.02 Top-10 points). I think the paper needs to establish more clearly what SD-CoT contributes beyond existing search and refinement mechanisms.
-
Some experimental comparisons are difficult to interpret. Several supervised baseline results in Table 1 are taken from previous work, and DiffMS is evaluated on a halogen-free subset of MolPuzzle. It is therefore unclear whether all reported comparisons use equivalent evaluation conditions. I also noticed that MARS achieves 60.00% Top-10 accuracy in Table 4 but 66.35% in Table 5. The difference in evaluation settings, if any, should be clarified.
-
The inference cost is quite substantial. MARS requires 372 seconds and approximately 20.6k tokens per molecule, considerably more than the supervised baselines. The reported 12.4 seconds with 30-way parallelization reflects improved throughput rather than lower single-sample latency. Given that MCTS accounts for much of the performance improvement, a compute-matched comparison would help assess whether the additional search cost is justified.
-
The evidence for real-world generalization remains limited. The wastewater experiment presents only three qualitative examples, without aggregate quantitative results. Meanwhile, MARS achieves just 2% Top-1 and 3% Top-10 accuracy on the full MassSpecGym evaluation. These results suggest that reliable identification of challenging unseen molecules remains difficult, and I would be cautious about drawing strong practical generalization conclusions from the current evidence.
[1] Bohde M, Liu H, Manjrekar M, et al. FRIGID: Scaling Diffusion-Based Molecular Generation from Mass Spectra at Training and Inference Time[J]. arXiv preprint arXiv:2604.16648, 2026.
[2] Zhuang X, Wu B, Cui J, et al. Boosting LLM’s molecular structure elucidation with knowledge enhanced tree search reasoning[C]//Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025: 22561-22576.
Questions for authors
-
Could the authors compare the complete MARS framework against FRIGID under the same evaluation protocol on NPLIB1?
-
How does MARS compare with K-MSE and FRIGID when controlling for the number of generated candidates, search iterations, and computational budget? Are the improvements in Table 3 statistically significant?
-
Could the authors clarify the different results reported in Tables 4 and 5, including the evaluation subsets and search configurations?
-
Can the authors provide quantitative evaluation on a larger set of real-world wastewater spectra to support the generalization claims?
-
Citation formatting needs some attention. Several references appear in the textual citation format even when they are not grammatically integrated into the sentence (e.g., “Kind et al. (2018); Wen & Zhu (2015); Wang et al. (2016)” in the Introduction). These should instead use parenthetical citations, such as “(Kind et al., 2018; Wen & Zhu, 2015; Wang et al., 2016),” typically produced by
\citep{}in LaTeX. Could the authors check and correct the citation formatting throughout the paper?