- Rating
- 4
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper challenges a common view in multimodal molecular learning: specifically, it asks whether aligning multiple learned views of the same molecule (such as 3D and SMILES) truly improves representation learning and predictive performance. The authors show that in certain scenarios, cross-modal improvements can occur even when the auxiliary encoder has learned no molecular information, and that some of these gains persist even without a second molecular view (e.g., with random graph encoders or fixed random codes). Based on these findings, they recommend including a frozen random auxiliary encoder as a baseline before attributing performance gains to learned cross-modal information.
Critical strengths
- The paper is well written and clear.
- The main idea and message of the paper are very simple, but the observation is relevant and important for multimodal molecular representation learning, especially since the performance gains of multimodal molecular models are usually marginal.
- The experimental evaluation is sound and comprehensive. The authors test random molecular encoders and fixed random codes, and ablate the second molecular view across various datasets and models.
- The GraphMVP results, where learned targets outperform random ones, show that in certain scenarios using multiple modalities can be beneficial, further motivating the recommendation to include random targets as baselines when developing multimodal architectures.
Critical weaknesses
- The connection to self-supervised learning is somewhat limited, as most experiments retain a supervised objective during training. It would be interesting to include more self-supervised methods in the analysis. At the very least, methods such as [1], [2], [3], [4] should be included in the related work discussion.
- The paper offers limited discussion and guidance on when random targets are likely to be helpful.
- Apart from QMugs, the datasets contain relatively small molecules. Evaluating on MARCEL [5], which includes larger molecules represented as conformer ensembles, would strengthen the analysis, especially for the 3D view.
I believe that the paper is interesting and offers an important discussion regarding multimodal molecular representation learning. I recommend acceptance.
Questions for authors
- The regularization controls and geometry diagnostics are informative (Appendix E2), but the mechanism remains unresolved. What is the authors' hypothesis regarding the performance gains when using random features or random encoders as the second view? Could it be just a regularization effect? Do you believe that this is a property specific to molecular representation learning?
- Can the authors expand the scope of the paper and include more self-supervised methods? This is especially interesting since with GraphMVP, the only fully self-supervised method studied, learned targets outperform random ones on all three datasets.
Dear Reviewers,
The author-reviewer discussion phase is ending soon. If you have not done so yet, please read the author rebuttals and respond.
Please recall that, as a reviewer, you have agreed to engage in discussion with the authors to clarify and improve the paper. Failure to do so may result in penalties on your own submissions, as per the official ICLR policy. Given the high volume of submissions, your participation is crucial.
Thank you for your time and help.
Best regards,
Your AC