- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a spectrum-to-spectrum framework for directly predicting product IR from reactant and reagent spectra without intermediate molecular-structure reconstruction. Experiments on simulated and experimentally measured spectra show that the proposed method consistently outperforms reaction baselines across diverse reactant settings and remains robust to spectral perturbations.
Critical strengths
- The motivation is straightforward. The method appears to be effective.
Critical weaknesses
- The generalization capability requires further validation. For example, by directly transferring from simulated spectra to real-world scenarios.
Questions for authors
-
The baseline models rely on methods from 2019 to 2022. It is difficult to support the method effectiveness.
-
Please explain the core differences between simulated and real spectra. I wonder if the method can extract the ability from the simulated spectra that are applicable to real data.
-
I think it's a good way to test the model generalizable ability by training on simulated spectral data and directly transferring to real scene data. But, note that there is no data leakage issue between the two settings.
5 comments
Q2. Core differences between simulated and experimental spectra, and transferability.
Simulated IR spectra reflect idealized isolated-molecule harmonic vibrations with clean baselines, whereas experimental NIST spectra contain anharmonic shifts, intermolecular interactions, instrumental noise, baseline drift, and heterogeneous measurement conditions[4,5]. Despite these discrepancies and the much smaller experimental sample size, the underlying functional group vibrational characteristics and reaction-induced spectral transformation rules remain physically consistent across both domains.
As shown in the table below, SpecReact achieves 0.680 CosSim and 0.637 Peak F1 on simulated spectra, and maintains 0.561 CosSim and 0.517 Peak F1 on experimental spectra, resulting in a moderate performance gap of only 0.119 in CosSim and 0.120 in Peak F1 (smaller than the 0.129–0.170 CosSim and 0.134–0.174 Peak F1 drops observed across all seven baselines). Although experimental variations and limited real-world data inevitably increase the difficulty of fine-grained peak alignment and cause a slight performance drop, this modest gap supports that SpecReact effectively extracts transferable molecular and reaction features applicable to real-world spectra.
| Setting | CosSim | Peak F1 |
|---|---|---|
| Simulated Spectra | 0.680(0.005) | 0.637(0.007) |
| Experimental Spectra | 0.561(0.013) | 0.517(0.015) |
| Performance Gap () | -0.119 | -0.120 |
Thank you again for your careful review and constructive feedback. We hope our responses have clarified the key concerns, and we would be happy to address any further questions. If you find our explanations satisfactory, we would sincerely appreciate your consideration of a revised rating.
Reference
[1] Jin, T., Zhao, Q., Schofield, A. B., and Savoie, B. M. Deductive Machine Learning Models for Product Identification.
[2] Xu, L.-C., et al. A Unified Pre-trained Deep Learning Framework for Cross-task Reaction Performance Prediction and Synthesis Planning.
[3] Sagawa, T., and Kojima, R. ReactionT5: A Pre-trained Transformer Model for Accurate Chemical Reaction Prediction with Limited Data.
[4] Merrick, J. P., Moran, D., and Radom, L. An Evaluation of Harmonic Vibrational Frequency Scale Factors.
[5] Stein, S. E. Evaluated Infrared Reference Spectra. NIST Chemistry WebBook. https://webbook.nist.gov/chemistry/coblentz/
Official Comment by Authors
Dear Reviewer qN6F,
Thank you again for your careful review and for raising important questions regarding the sim-to-real generalization capability, recent baselines, domain discrepancies, and data leakage prevention.
In our response, we added a direct zero-shot sim-to-real transfer evaluation on the experimental NIST test set, comparisons against three recent reaction modeling baselines (Deductive-Spec, RXNG-Spec, and ReactionT5-Spec), a detailed analysis of the physical differences and transferability between simulated and experimental spectra, and clarification of our strict cross-domain product-disjoint filtering setting. Together, these additions demonstrate that SpecReact learns transferable spectral transformation representations without cross-setting data leakage and consistently outperforms recent baselines.
If time permits, we would be grateful if you could review these additional results and clarifications and let us know whether they address your concerns. Any remaining questions would be very helpful for us to clarify before the discussion period ends.
Thank you once again for your time and valuable feedback.
Best regards,
The authors
Rebuttal
We thank the reviewer for this constructive suggestion. To directly evaluate the zero-shot generalization capability of our model trained solely on simulated spectra, we test the simulated-trained checkpoint directly on the experimental NIST test split without any fine-tuning (
Zero-Shot), and compare it with the fine-tuned setting (SpecReact):Zero-Shot Transfer Analysis: SpecReact boosts the performance to
0.561in CosSim (+16.6%) and0.517in Peak F1 (+19.4%), demonstrating that models perform worse when directly transferred compared to when they are fine-tuned before testing, highlighting the importance of fine-tuning with experimental data.No Data Leakage Between Simulated and Experimental Settings: We strictly enforced cross-setting product and reaction disjointness during dataset construction. Specifically, all target product molecules and reaction records appearing in the experimental
valandtestsplits were filtered out from the simulatedtrainandvalsplits prior to pretraining and reaction training. Thus, there is no data leakage.We add three recent reaction prediction architectures adapted to the spectral domain using the same pretrained spectrum encoder and decoder: Deductive-Spec [1], RXNG-Spec [2] and ReactionT5-Spec [3]. The results across reactant topologies and reactant counts are reported below:
Simulated Spectra
Experimental Spectra
Performance Across Reactant Counts on Simulated Spectra
While these newer baselines improve over earlier 2019–2022 baselines,
SpecReactstill consistently outperforms the strongest baselineReactionT5-Specacross all reactant categories and reactant counts on both simulated and experimental spectra.