- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2(+1)
Read review
Paper summary
MolLingo is a multi-agent framework for molecular design with three parts. BFE splits molecules into frequent BRICS blocks, each written as SMILES plus a common name. Chemist, Literature and Orchestrator agents share a memory and call docking and ADMET tools. A docking-guided hit-to-lead stage conditions fragment growth on per-atom hotspots. Experiments cover ADMET optimization on Withdrawn 2.0 (67 DILI and 33 hERG molecules), hit-to-lead on 30 targets, TOMG-Bench, and hit identification against DrugGEN. The paper claims that block input beats raw SMILES under the same LLM (GPT-5.4 Imprv×Sim goes from 266.37 to 476.93) and that docking context raises mean docking improvement from 2.4% to 10.4%.
Critical strengths
- The paper is upfront about what its evidence does not show. It concedes that the BFE vs. full-fragment gap is only 0.569 (§3.2), that no significance test was run (App. E), and that the InChI and IUPAC variants failed (App. M.2). This made the paper easier for me to assess.
- The ablations say something useful about agentic search on their own. Memory brings repeated edits from 16.7% to 0%, and five iterations trace a clear trade-off between property improvement and similarity (Tables 12, 15, 16). I found this more convincing than the representation claim.
Critical weaknesses
- The representation claim does not hold up at matched budget. Table 16 is the only matched comparison (16 oracle calls). There, block SMILES scores 1031.94 against 1003.9 for raw SMILES, about 2.8% apart, with a per-molecule std of 12 to 17 pp on n=67, and Graph-GA reaches 1044.1 under the same budget. Table 14 also shows that k=40, the setting used for the headline Table 1, is the worst of the four candidate counts (476.9, vs. 794.9 at k=20). The paper does not say why it was chosen.
- There are no statistical tests, and the samples are small. DILI has 67 molecules and hERG has 33, with no paired tests, CIs or repeated runs. Several gains sit inside one std (hERG, Gemini-3-Pro: −0.56 ± 1.40 to 0.68 ± 3.22). The Orchestrator gain in Table 13 also comes with a larger generation budget.
Questions for authors
- [Clarification] Is the block vs. raw gap in Table 16 significant under a paired test or bootstrap over the 67 molecules? The same question applies to Tables 1 and 8.
- [Clarification] Why was Table 1 run at k=40? Does the block vs. raw gap survive at k=20?
- [Clarification] How much do the evaluation molecules and their optimized analogs overlap with the TDC data used to train the ADMET oracles?
- [Clarification] Improvement is measured as relative change in the oracle logit (App. L.1). Do the rankings change under probability or a thresholded success rate?
- [Suggestion] Graph-GA is competitive at equal budget. What does the LLM pipeline add for property optimization? If the answer is little, the abstract should say less.