- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates the effectiveness of Agentic CoM, which performs iterative molecular editing using external tools for constrained molecular optimization. The authors define and compare four paradigms that take target molecular properties and a reference molecule (SMILES) as input and generate optimized molecules. Experimental results suggest that Agentic CoM achieves the best performance in terms of constraint satisfaction and molecular diversity.
Critical strengths
-
The authors make an effort to clearly distinguish the four paradigms by providing intuitive figures and detailed explanations.
-
Although the paper adopts independent experimental settings, the authors make an effort to ensure fair comparisons through consistent data splits and experimental configurations.
-
The authors openly and honestly acknowledge the limitations of their work.
Critical weaknesses
-
The motivation for the paradigm categorization and its novelty are unclear. The paper does not sufficiently justify the classification into four paradigms or explain how they relate to existing molecular generation/optimization methods. In particular, given the presence of prior studies on agentic molecular generation, the authors should clarify what distinguishes Agentic CoM from existing approaches and why it should be considered a new paradigm.
-
The experimental analysis and interpretation of the results are insufficient. The paper adopts experimental settings that differ from prior work, making direct performance comparisons difficult. Moreover, the reported advantages of Agentic CoM and the verifiability of its trajectories appear largely expected, with limited additional insights. Although the paper reports findings on the benefits of intermediate molecular states, the importance of structural control, and the effects of scaling, SFT, and RL, it provides insufficient analysis of why these effects occur. In particular, the scaling experiments, which only consider 1M and 20M settings, are too limited to support general conclusions about scaling trends.
Questions for authors
Major Questions
-
Is the primary contribution of this paper the proposal of a new methodology or an empirical comparison of four molecular generation paradigms? What is the key message that Agentic CoM aims to convey to the molecular generation community?
-
What specific hypotheses are the SFT and RL experiments intended to validate? In particular, what is the motivation for including settings without SFT?
Minor Questions and Suggestions
-
Section 2.5 (Evaluation Metrics) would be more appropriately placed in the experimental section. Additionally, important details for reproducibility, such as dataset construction, training configurations, and tool specifications, should be sufficiently described in the main text rather than being mostly deferred to the appendix.
-
The authors should clearly distinguish experimental settings adopted from prior work from those newly introduced in this paper. For example, the rationale behind the training data size and the number of samples (128) should be provided.
-
How is the candidate pool of atoms or functional groups used for addition operations in the molecular editing trajectory defined?
-
Sections 4 and 5 could be combined into a single section for better organization.
Withdrawal statement
Dear Reviewers,
Thank you for evaluating our work. While your score-based assessments hurt a bit, we value your suggestions for improvement and believe we learned valuable lessons from your feedback.
We understand from all three reviews - and reviewer 1DyG raises exactly the right question (Question 1) - that we apparently failed to make our research question sufficiently explicit. Our goal is not to propose a new SOTA molecular optimization method. Rather, we present an empirical study of whether explicit reasoning in chemical space can be genuinely helpful for molecular optimization. While we understand reviewer 1DyG's perspective that some of the results may seem expected, we found that making a reasoning model work from scratch in a domain different from natural language is far from straightforward, and we believe that demonstrating its feasibility is already a meaningful contribution. Perhaps including some of our unsuccessful experiments would have helped to illustrate this challenge.
With this research question in mind, we believe it becomes clearer why direct molecular generation is the baseline we primarily care about. In fact, many established molecular optimization approaches, such as REINVENT, rely on direct SMILES generation models under the hood. We therefore see our work as largely orthogonal to approaches investigating which optimization algorithms perform best. Instead, we ask: Which type of generative model is a suitable backbone for molecular optimization? For example, REINVENT primarily provides an RL-based optimization framework using direct feedback from a scoring function. Our results suggest that using a CoM-style model instead of a direct generation model could be beneficial. In principle, these two directions could be combined.
Nevertheless, we understand the reviewers' rationale that comparisons against established external baselines are important to demonstrate the practical relevance of our approach.
Lastly, including information about computational costs is certainly feasible, and we will take this suggestion on board as well.
Taken together, we believe that clarifying our research question, restructuring the narrative accordingly, and including additional baselines and analyses would require substantial changes to the manuscript. As we want to respect best practices during the rebuttal period, we do not think it would be appropriate to ask the reviewers to evaluate a substantially revised version of the paper at this stage.
We have therefore decided to withdraw our submission, take the lessons learned from your feedback, and use them to improve our manuscript.
Thank you again for your time, thoughtful reviews, and constructive feedback.
Best regards,
The Authors