- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies dual-target molecular generation, focusing on two coupled questions in continual online generation: how evaluated experience should accumulate across stages, and which high-value structures should be reused for parameter updates. The authors propose DualEvo, which organizes molecular generation, fixed dual-target evaluation, cumulative experience archiving, experience selection, and lightweight LoRA updates into a continual loop. The core design separates two functions: reward determines which archived molecules are high-value for the task, whereas scaffold balancing determines how structurally concentrated the selected update set is. The Reward-only condition simply selects the top N records from the high-value pool; DualEvo instead groups that pool by Bemis-Murcko scaffold, preserves reward order within each group, orders groups by their best record, and then selects one record from each nonempty group per round until the same update budget is filled. Experiments show the effectiveness of the modules design.
Critical strengths
- The paper provides thorough ablations of the components it proposes. Experience accumulation, reward direction , scaffold balancing, and the learning interface are each isolated and tested, with all conditions sharing the same base checkpoint, training exposure, and online budget so that one factor varies at a time.
Critical weaknesses
-
All comparisons in this paper are ablations of the authors’ own design. The four conditions in Table 1 (Frozen, One-shot, Reward-only, DualEvo) come from the same pipeline, and REINFORCE-LoRA is also a control built by the authors rather than a published method. No external method is run, which is not sufficient to judge the contribution.
-
The paper claims discovery, but supports it only with diversity measures (successful-scaffold count and Top-10 concentration), never comparing the successful molecules or scaffolds against the ChEMBL actives used to train the predictors. Diversity and novelty are not interchangeable: a set of ~1970 scaffolds consisting entirely of established cores for these target classes would score well on both reported measures and contain no discovery at all. We note that the nearest-neighbor Tanimoto analysis in Appendix O is computed against the authors’ own experience archive, which addresses self-repetition rather than novelty relative to known actives.
Questions for authors
See weakness.
2 comments
Follow-up on our responses
Dear Reviewer,
Thank you for your time and consideration. We would appreciate hearing whether our responses and revised manuscript address your concerns. We would be happy to clarify any remaining questions.
Best regards, The Authors
Response to Reviewer vnHt
We thank the reviewer for the suggestions on external algorithm comparisons and comparison with known active compounds. The common-query-budget benchmark and ChEMBL reference analysis show higher unique predicted-success yield and broader coverage of reference-unseen scaffolds with DualEvo.
1. External-method benchmark
All methods use the same fixed dual-target oracle and property gates. We report the fraction of distinct molecules meeting the predicted-success criteria among the first 2,000 distinct canonical-molecule oracle queries, averaged over five seeds per task.
Values are mean unique predicted-success yields over five seeds. REINVENT4 uses its native
IdenticalMurckoScaffoldfilter, with results aggregated from the original logs under the same distinct-query definition. Each method retains its own model and optimization configuration. The DualEvo query stream includes candidates generated by the final fixed model.Under the common evaluation criteria and query budget, DualEvo achieves the highest unique predicted-success yield among the listed methods on both tasks.
Revised manuscript: Appendix L, p. 25, Table S11b.
2. Structural novelty relative to known ChEMBL actives
The reference set is the union of ChEMBL training and validation active molecules for the two targets. Novelty is defined relative to this set, using canonical SMILES for molecule matching and Bemis–Murcko scaffolds for scaffold matching.
Results cover six tasks and three seeds, with 5,000 independent samples per final fixed model per seed.
Consensus success requires the same valid canonical molecule to pass the original QED thresholds for both targets, the SA upper bound, and the logP interval, and to meet both target-specific thresholds under each of the original ECFP and PSICHIC-XL evaluators. All four activity comparisons must pass, using scores at least equal to the corresponding threshold selected by maximum validation MCC. Molecules are deduplicated by canonical SMILES. Unseen consensus scaffolds are distinct nonempty Murcko scaffolds from this intersection that are absent from the reference active set.
DualEvo increases reference-unseen successful scaffolds by 28.6%, with a 30.0% increase retained in the consensus-success intersection. These results demonstrate broader coverage of predicted-success structures beyond the known target-active reference set.
Revised manuscript: Appendix O, p. 29, Table S14b.