- Rating
- 4
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper introduces SkeleMol, which adapts general-purpose vision encoders for molecular property prediction using skeletal images. It combines multiple stages in pretraining, including image–SMILES alignment, distillation from a 3D molecular model, and chemistry-informed curriculum learning. It outperforms molecule-specific baselines on physical properties (ESOL, LD50), and a couple of drug discovery-related properties including BBBP and HIV.
Critical strengths
- The framework makes good use of molecular data in diverse forms, including skeletal images, SMILES, and representations from a 3D molecular model.
- Chemistry-informed curriculum learning seems an interesting way to help the encoder learn basic chemical structure patterns before introducing more complex molecules. Further, the curriculum ablations provide useful evidence of its downstream benefits.
Critical weaknesses
- The authors do not include a performance comparison with image-based property prediction models such as ImageMol [1], which are their most direct baselines. Further comparison with these baselines would help demonstrate the efficacy of the proposed training recipe over existing image-based approaches.
- Table 13 reports large error shifts when images are rendered with PIKAchU rather than RDKit. This raises concerns about its generalization to images drawn from other renderers or published papers, and limits its broader applicability.
References
[1] Accurate prediction of molecular properties and drug targets using a self-supervised image representation learning framework, Nature Machine Intelligence (2022).
Questions for authors
- What motivates using teacher distillation to transfer 3D information? PCQM4Mv2 also provides 3D coordinates for training molecules, so a straightforward alternative would be to add an auxiliary coordinate prediction head and supervise it directly with the reference structures, which does not necessitate employing a teacher model.
Summary. ImageMol is now a row of Table 5. It pre-trains on 10 M molecules and SkeleMol on 2 M. Table 14 measures sensitivity to the renderer. We distil from Uni-Mol because its embedding is already invariant to frame and atom order.
We thank the reviewer for the positive assessment and for two concrete requests, both now in the paper.
ImageMol as the most direct baseline
ImageMol is now a row of Table 5 with the scaffold-split values its paper reports (its Supplementary Table S5), and App. C.4 records the split behind the row. Like every row of Table 5, it is a comparison of reported values. ImageMol trains a molecule-specific image encoder on 10 M molecules, and SkeleMol adapts an off-the-shelf vision encoder with 2 M. Section 2 also places MaskMol and VideoMol.
Sensitivity to the renderer
The depiction table (Table 14) quantifies it by scoring the same encoder and heads under six RDKit variants and under PIKAchU on 1,000 held-out molecules. Within RDKit, predictions are stable under layout and typography. Bond width, rotation, type size and explicit methyls each remain within 10% of the default MAE (for example rotation 35° +2.2% on Δε, explicit methyls −0.1%). The element colours and the training resolution carry signal the encoder uses, and Table 14 gives each value. PIKAchU changes bond layout, label sizing and ring rendering at once and lies outside the training depictions, and its Δε error is 47.7% higher on the 992 molecules it drew. The encoder is specific to the drawing style it trained on, and we validate it on drawings from its training pipeline (App. D.3). Depiction-augmented pre-training (sampling renderers, palettes and resolutions) is the natural extension and changes only the rendering step.
Why distil from a teacher and not regress coordinates directly?