- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper introduces QuantaMind, a chemistry language model obtained by LoRA instruction tuning of a quantized Qwen-2.5-32B backbone on QuantumChem-200K. The corpus augments molecular structures primarily drawn from QM9 and OMG with computed and model-derived property annotations. Given a SMILES string and a chemistry instruction, the model generates a structured numerical property profile. The primary benchmark evaluates seven properties: two-photon absorption cross sections at 780 nm and at the spectral maximum \sigma_{\mathbf{max}}$, the singlet–triplet energy gap , toxicity, synthetic accessibility, boiling point, and solubility. Using photoinitiator screening as a case study, the authors evaluate property prediction and multi-objective candidate ranking on an externally sourced 3,000-molecule testbank. Comparisons include other LLMs, pretrained molecular encoders, and GNNs. The authors report an overall wMAE of 0.1287 and recovery of 35 of the reference top 100 candidates.
Critical strengths
- Relevant problem and potentially useful supervision resource. The paper addresses molecular screening using a combination of photophysical properties and practical constraints, including toxicity and synthetic accessibility. QuantumChem-200K brings these annotations into a common supervision format, with TPA and singlet–triplet gap targets providing potentially useful coverage beyond common molecular descriptors.
- Broad and reasonably motivated comparison design. The evaluation includes the untuned Qwen backbone, a similarly fine-tuned Gemma control, pretrained molecular encoders, and GNNs. Combining property-prediction metrics with downstream candidate-ranking metrics is useful for examining whether improved numerical predictions translate into screening benefits.
Critical weaknesses
- The evaluation does not yet reliably establish the reported performance and generalization gains. Only 108 of the 3,000 released test records contain all seven reference properties, and the released prediction table contains usable singlet–triplet gap predictions for only 220 of the 744 records with valid reference labels. The released wMAE implementation excludes missing predictions and computes ranges and weights from model-dependent valid subsets, potentially rewarding incomplete predictions. Although its correspondence to the main tables remains unconfirmed, this prevents independent verification of the reported advantage. Moreover, 41 test molecules overlap with training, despite the description of a disjoint testbank, and no results excluding these molecules are reported. Together, these issues affect the central empirical evidence and require substantive reassessment.
- The practical benefit of using a 32B LLM is insufficiently established. The model uses standard LoRA instruction tuning, and the main benchmark measures agreement with labels generated by existing computational tools and predictors. While a unified property profile is useful, the paper does not quantify inference speed or resource costs relative to the original annotation workflows, or isolate the benefit of the model’s scale. The reported reference-based rankings also do not establish improved experimental photoinitiator performance. Consequently, the additional value of this large language model remains unclear beyond its ability to approximate the supplied supervision.
Questions for authors
- Which inference and training protocols actually produced the reported results? Appendix A.2 describes few-shot evaluation for Haiku and DeepSeek, but their released scripts contain no answered demonstrations. Other inference examples also use different prompts. The public training configuration differs from Table 5 in epochs, learning rate, and dataset identifier. Please identify the actual configurations and checkpoints, and provide the prompts, demonstrations, model versions, and decoding settings used for the reported comparisons.
- How were the molecular baselines and final model selected? Please clarify target standardization, task-loss balancing, hyperparameter search budgets, and checkpoint selection for the molecular encoders and GNNs. Which independent validation data were used to select learning rates, training duration, checkpoints, and prompts? These details would help assess whether the comparisons reflect reasonably optimized models without test-set-dependent selection.
- What explains the difference between the five-property and seven-property screening results? QuantaMind’s normalized hypervolume regret changes from 3.26% to 71%. Please specify the five properties, their weights and directions, the percentile-normalization procedure, the Pareto tolerance, and the hypervolume reference point. Are these results computed using comparable candidate sets and conventions?
- Are the auxiliary validation sets independent of training? Does the released 100testbank.csv, whose 100 SMILES all occur in the public training corpus, correspond to the checkpoint analysis in Appendix A.8? Separately, were any molecules in the known-photoinitiator sanity check among the 50 photoinitiators added to training? Please clarify the membership and role of these sets so that training-fit evidence can be distinguished from independent validation.