- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
TAG-XMM is a formula-conditioned molecular elucidation system combining ¹H NMR, ¹³C NMR, HSQC, IR, and MS/MS to recover exact molecular connectivity without stereochemistry. A chemically supervised multimodal encoder produces a token bank, which a resampler uses to condition an autoregressive SMILES decoder and generate a candidate pool. Graph-SSI uses confidence and spectral-fit features to decide whether to repair a pool, selects local regions using bond disagreement among candidates, and proposes new graphs through bond swaps and spectrum-conditioned discrete graph diffusion.
Critical strengths
- The paper separates missing-candidate failures from ranking failures and provides a concrete spectrum-conditioned repair mechanism for the former. When the true structure is absent from the beam, reranking that pool cannot recover it.
- Detailed diagnostics and controls reveal where the system improves and fails.
Critical weaknesses
- Some mass differences can be calculated from observations and a formula, but compositions assigned using the true structure cannot automatically be treated as available from experimental spectra alone. The paper lacks retraining results without these fields and does not establish that equivalent features can be obtained without accessing the unknown structure.
- Important design claims remain confounded, and the necessity of the complex system’s individual mechanisms is unclear. The 97.85% versus 73.41% joint-encoding/late-fusion comparison is a central argument, but Appendix C explicitly states that the encoder was trained only on all five modalities, while late fusion combines its out-of-distribution single-modality outputs. This mixes fusion design with training-input distribution and cannot establish the same advantage under fair training.
- Table 11’s 90.04% variant without two in-domain energies further shows that gains along one sequential build-up do not establish each scoring module’s necessity. Fairly trained fusion baselines and analyses separating newly recovered structures, pool-standardization effects, and additional search computation would clarify the methodological advance relative to the system’s resource investment.
Questions for authors
- For each MS/MS field and related summary descriptor in Table 4, which are determined solely by observed spectra and the permitted molecular formula, and which read true-structure simulator annotations? After removing the latter and retraining the affected components, or predicting them with an independent spectral annotation model, what are the stage-wise full-system Exact@1 results?
- Beyond the disclosed shift-head overlap, what are the test-molecule overlaps with the encoder, MolForge decoder pretraining, diffusion model, and forward predictors? What are the final Graph-SSI results and gained/lost counts on a rigorously defined non-overlapping subset?
- Which Test A metrics had been inspected before adopting the isotonic rule? Is there a new frozen evaluation unused in any design decision that confirms the final rule’s gain over the inverse solver?
- How much of the joint-encoding advantage remains when late fusion uses adequately trained single-modality encoders, or when both approaches use the same modality-subset training?
2 comments
Thank you for the revision. I maintain my score, because the authors disclose that all Test A results were inspected before adopting isotonic scoring and the inverse solver, and their pre-specified primary comparison was null, so the 91.19% headline is not an estimate of expected performance on unseen data, and no end-to-end evaluation on measured spectra exists.
Response to Reviewer 1RC9
We thank Reviewer 1RC9 for the detailed review. References below use the revised manuscript, with changes marked in blue.
W1/Q1: MS/MS provenance and stage-wise retraining. Table 4 now distinguishes observed quantities (m/z, intensities and their summary), the formula-dependent precursor fraction, and annotation-derived neutral loss, parity, fragment/loss compositions and 11 descriptors. The other 407 descriptors use no MS/MS. We retrained the encoder and decoder with annotation-derived fields retained, removed (including their fill value and all 11 descriptors) or recomputed from masses and formula alone (App. G, Table 14).
The first three accuracy columns use all 39,224 molecules; the remaining columns use the frozen 6,653, with gains/losses relative to each variant's solver. Data, schedule and seed are matched; the gate, verifier, isotonic map and solver weights remain fixed. Recalculation assigns the nearest ion subformula within max(10ppm,2mDa), agreeing with the simulator on 629,552/629,561 jointly assigned peaks across 12,720 simulated molecules. Removal reduces solver accuracy (p=6.7×10−7); recalculation recovers most of the difference (p=0.074 versus retained fields).
W2/Q4: fusion under matched training. Figure 3 replaces the confounded comparison with independently trained single-spectrum encoders and joint encoders using the same 715,840 records, seed and schedule. All-five joint encoding reaches 97.66% versus 93.99% for late fusion: +3.66 points [2.96, 4.35]. Spectrum-subset training gives 97.39%, or +3.39 [2.68, 4.08]. Its average advantages with three and four spectra are +1.64 [1.20, 2.12] and +2.80 [2.27, 3.37] points; late fusion leads with one or two (App. C, Table 8a).
W3: new candidates, reranking and module necessity. Graph-SSI's net gain of 456 consists of 519 out-of-beam recoveries and 63 net in-beam losses. Added graphs displace 126 correct answers; reranking among original candidates gains 135 and loses 72 (p=1.4×10−5; App. F).
Each post hoc solver ablation was refitted on validation (App. E, Table 11a):
The five views grouped in the last row each change accuracy by at most 0.09 points when removed individually, supporting partial redundancy. Wider search is also effective: width 320 plus the solver recovers 940 originally out-of-beam structures, while missing 139 of Graph-SSI's 519 recoveries (Table 10a). Graph-SSI takes 4.68 seconds per pool sent on one H100, for 34.9% of pools.
Q2: component overlaps. Table 2a reports constitution overlaps with encoder/decoder training (1,340 records), IR fine-tuning (418), shift heads (2,076), diffusion (0), published HSQC lists (262), and the list distributed with MolForge (3,643). Excluding constitution or first-InChIKey-block matches with the training data of the four models we trained leaves 35,983 molecules: TAG-XMM reaches 90.63%, with 645 gains and 194 losses over the inverse solver (p=2.8×10−57). Further excluding the MolForge-associated list leaves 32,804 molecules and 595 gains/172 losses (p=2.4×10−55). That list is not a verified pretraining manifest.
Q3: inspected results and frozen confirmation. We had inspected all Test A results, including the isotonic sensitivity analysis, controls, secondary analyses and test-label diagnostics, before adopting isotonic scoring. Both that choice and the move to the inverse solver were test-informed; the map itself was fitted on validation. Test A's primary comparison, using the offset rule and six-view solver, was null: 510 gained, 491 lost on 32,571 molecules (p=0.57). We therefore scored the 6,653 test molecules Test A did not cover, after every setting was fixed, once with the final system: Graph-SSI gains 134 and loses 53 over the inverse solver (88.83% vs 87.61%; p=2.8×10−9). Within the strict subset and outside the first 2,048 test molecules, on which the MS/MS minimum-peak setting was chosen, it gains 118 and loses 49 (p=9.5×10−8), and the gain recurs in all three retrains above (80/30, 73/27, 95/28).