- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes CovMOLAgent, an agentic framework for multi-objective covalent lead optimization. CovMOLAgent comprises CETRA, an execution-grounded trajectory construction strategy based on deterministic tool execution, and WCPO, a warhead-constrained policy optimization objective. CovMOLAgent shows superior performance to other general LLMS without any fine-tuning.
Critical strengths
Comprehensive experiments: The experiments are sufficiently comprehensive, including joint optimization and property changes (I personally think Table 1 and 2 do not really need to be that large tables, though), a case study, and an ablation study. Specifically, the ablation study in Table 3 makes each component’s contribution clearly visible (WCPO and CETRA).
Critical weaknesses
- Novelty based on a conjunction of established elements: The paper claims three-fold contributions: source-conditioned optimization, multi-property improvement relative to the starting molecule, and retention of source warheads. Source-conditioned editing that modifies a local site while retaining the rest of the molecule under similarity and property constraints is established in fragment-based optimization [2], and substructure-constrained multi-property objectives already appear in deco_hop, scaffold_hop, and valsartan_smarts of the PMO benchmark [1]. What remains specific is that the retained label set varies per source, but this is a benchmark design choice rather than a methodological advance.
- The covalent constraint is a simple add-on rather than a design principle: Warhead preservation enters at two points: 1) the feasibility predicate that filters CETRA’s candidate neighborhood and 2) the penalty term in the WCPO reward. Both would accept any substructure constraint unchanged other than covalent. CETRA, which performs one-step edits, caches the outcomes, and reconstructs them into failure-aware trajectories, is agnostic to covalency and applies to tool-based molecular editing in general. The paper should state which component is specific to covalent chemistry.
[References]
[1] Gao, W., et al. Sample efficiency matters: a benchmark for practical molecular optimization. NeurIPS 2022.
[2] Lee et al. Molecule Generation with Fragment Retrieval Augmentation. NeurIPS 2024.
Questions for authors
- How does CovMOLAgent work compared to other fragment-based or covalent-based methods? I understand that other covalent-based methods are not applicable to the same task as they are mostly de novo, but fragment-based approaches' setting are exactly same so it is still applicable.
- What would be the significant design principle difference for covalent lead optimization compared to other fragment-based or lead optimization tasks?
3 comments
W2, Q2: Which Designs Are Specific to Covalent Molecules, and Which Mechanisms Are Generalizable?
The design principle for covalent optimization is to treat reaction-relevant structures in each source molecule as instance-specific preservation targets, so that property gains and preservation requirements jointly guide data construction, policy training, and endpoint evaluation. Global similarity captures overall resemblance, while local reaction-related fragments require explicit checks. Candidate selection must therefore consider both the source-specific preservation set and source-relative property changes. Our framework connects these requirements at three levels:
| Level | Specific design in our work | Role in the optimization process |
|---|---|---|
| Data construction | Extract source-specific recognition labels, identify winners within feasible neighborhoods, and retain failed/non-improving trials | Supervises candidate selection under structural constraints and property trade-offs |
| Policy training | CETRA reconstructs action–observation–adjustment; WCPO combines source-relative utility with label-loss and degradation penalties | Learns subsequent tool actions and endpoint selection from execution experience |
| Endpoint validation | Joint Full-WH/JIR evaluation, plus instance-count, local-connectivity, and paired-adduct audits | Assesses property gains, source-structure preservation, and local geometric compatibility |
The chemistry-specific component is the identification, preservation, and validation of reaction-relevant structures for each source; CETRA/WCPO's execution-learning mechanisms are more general. Unlike PMO's fixed-task substructure scoring or f-RAG's hard fragments for molecular construction, we define a preservation set and property reference for each complete source, then learn to adjust actions in that task context. Source labels guide CETRA neighborhood filtering, label-loss penalties guide policy training, and Full-WH/JIR jointly evaluate structural preservation and property improvement.
Our experiments support this design at two levels. At the decision level, after removing detailed recovery and stopping instructions, CovMOLAgent retains a JIR≥2 of 51.48%, versus 25.64% for the base model with the same simplified prompt (Reviewer 2, Table B), showing that its tool-decision capability persists with fewer procedural instructions. At the structural level, among 429 Full-WH outputs, 97.44% preserve the number of source-matched instances, and 75.76% also satisfy the one-hop local-environment compatibility requirements for all labels. Across five paired covalent-adduct searches, three have a common-scaffold RMSD≤2 Å, and four preserve at least 85% of source-contacting residues (Reviewer 1, W3). These results support learned execution capability, source-specific local-structure preservation, and geometric compatibility under the tested adduct hypotheses.
Therefore, our contribution connects source-specific chemical requirements, execution-experience supervision, and low-query policy optimization, supported by joint improvement, query efficiency, and structural audits.
Thank you for the response. The authors state that CETRA and WCPO are general, which confirms rather than resolves my concern. My question asked what design principle separates covalent lead optimization from general fragment-based lead optimization, and the answer is just the definition of fragment-based lead optimization itself. I appreciate the new fragment-based baselines (that handled weakness 1) but the concern 2 remains unresolved, so I maintain my rating.
W1, Q1: Comparison with Fragment Optimization, PMO, and Other Non-LLM Methods
Thank you for pointing out these related works. The key distinction lies in what is learned: CovMOLAgent converts failures, property trade-offs, and endpoint verification from actual tool executions into policy supervision, teaching the agent how to choose subsequent actions and when to stop on new inputs. We clarify its relationship to prior work and validate the benefits through additional experiments.
Relationship to Gao et al.'s PMO (NeurIPS 2022). [Sample Efficiency Matters: A Benchmark for Practical Molecular Optimization] evaluates molecular optimization by oracle-query efficiency, covering 23 scalar objectives and primarily measuring the AUC of top-10 scores over query counts. The reviewer's examples,
deco_hop,scaffold_hop, andvalsartan_smarts, indeed incorporate substructure requirements. We study source-conditioned policy execution: defining a preservation set for each source, measuring property changes relative to that source, and evaluating simultaneous multi-property improvement under structural constraints. PMO provides an evaluation principle for query efficiency, whereas CETRA/WCPO train deployment-time search policies from execution experience. Our contribution is therefore policy learning and measurable query-efficiency gains, not substructure constraints themselves.Relationship to Lee et al.'s f-RAG (NeurIPS 2024). [Molecule Generation with Fragment Retrieval Augmentation] uses hard fragments for molecular construction and soft fragments to guide new-fragment generation. It freezes SAFE-GPT, trains a fragment-injection module, and combines dynamic vocabulary updates with genetic modification. Its core mechanism is learning how retrieved fragments enter a molecular generator. In contrast, CovMOLAgent learns how tool actions should respond to execution observations: CETRA fixes actual trial outcomes before reconstructing selection, adjustment, and verification, while WCPO trains the tool policy using source-relative endpoint gains. Thus, f-RAG focuses on fragment generation and vocabulary expansion, whereas CovMOLAgent focuses on execution-driven action and stopping-policy learning.
To compare with online molecular search, we added Graph-GA, STONED, BRICS fragment retrieval, and MIMOSA-GNN proposal-adaptation baselines (settings in Reviewer 2, W1/Q1). The BRICS baseline uses 1,985 single-attachment-point fragments built only from training inputs. It retrieves replacements by attachment type, size, and structural similarity, with iterative updates and best-so-far selection. We report it as implemented, rather than as the complete f-RAG framework. Results are shown below (percentages):
With matched total property-query budgets, CovMOLAgent achieves 20.97% JIR_QST versus 2.82% for BRICS. Even with approximately eight times as many queries, BRICS and Graph-GA reach only 11.02% and 14.41%, respectively. Against the higher-budget Graph-GA, the QST difference is 6.57 percentage points, with a source-paired bootstrap 95% CI of [2.47, 10.81] (Reviewer 2, W1/Q1). This supports higher three-property simultaneous improvement with fewer online queries. Paired comparisons on the complete pre-filtering held-out set show the same advantage (Reviewer 1, W1/Q3).
The results are consistent with our training and behavioral analyses. Complete-trajectory supervision achieves higher mean utility (+0.001621 vs. −0.040219) and a lower failure rate (39.62% vs. 46.61%) than winner-only supervision (Reviewer 2, Table A). The example in Reviewer 1, Q2, further shows the agent switching strategies after execution failure, identifying property degradation, and stopping after verification. Together, these comparisons support our contribution: converting offline execution experience into a multi-objective optimization policy that works with limited online property queries.