- Rating
- 2(+1)
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
- The paper introduces SynGuide a synthesizability guided molecule generation scheme built on GenMol. SynGuide steers GenMol with AiZynthFinder proxy model leading to higher ratio of planner suceeding molecules.
- The predictor is trained on noisy SAFE strings and while generation the predictor is provided a GenMol generated token probability distribution. The predictor gradient is then used to steer the token logits of SAFE string. Pracitically, the syntehsizability predicotr and docking predictor is balanced while generation.
- Paper includes experiments on three targets (ACAA1, c-MET, BRD4) and evaluated by planner succes, docking score, and hit ratio. SynGuide improves hit ratio and syntehsiabaility.
Critical strengths
None
Critical weaknesses
- Limited methodological novelty and insufficient validation of the proposed modifications: The paper primarily combines a frozen GenMol backbone with a planner-supervised predictor and gradient-based guidance. Learning surrogates of retrosynthesis planners has been explored in RAscore [1], while using a learned synthesizability classifier to guide molecular diffusion has been studied in SYNC [2]. Predictor-based guidance for discrete diffusion and flow models is also introduced in prior works. However, the specific design choices in SynGuide (guidance through a soft clean prediction and gradient normalization) are not sufficiently isolated in the experiments. Overall, the paper demonstrates the practical utility of a combinations of existing techniques, but does not sufficiently show a distinct methodological contribution.
[1] Retrosynthetic accessibility score (RAscore) – rapid machine learned synthesizability classification from AI driven retrosynthetic planning (Chemical Science, 2021)
[2] SYNC: Measuring and Advancing Synthesizability in Structure-Based Drug Design (ICLR, 2026)
Questions for authors
- Regarding evaluation and the docking threshold: The main evaluation uses a relatively mild docking threshold (42.15th percentile; Figure 7). Target-guided molecular generation aims to generate molecules with favorable docking scores, as measured by metrics such as Top-1 and Top-10. Is there a reason the authors chose this threshold? Moreover, under stricter docking thresholds in Figure 7, SAFE-GPT appears to achieve a higher Joint hit rate than the proposed method. Could the authors provide a quantitative comparison under stricter thresholds?
3 comments
Response to the Reviewer DgsE [2/2]
Q1— the threshold sweep
The quantitative comparison confirms that SAFE-GPT overtakes SynGuide at stricter thresholds. Joint hit rate (%) by threshold percentile:
(Table J in the General Comment above.)
The crossover is between the 25th and 10th percentile: we lead at the operating point and at p25 on all three targets, and below about p10 SAFE-GPT overtakes us on c-MET and BRD4(2), with ToolMol also ahead in the extreme tail. We will therefore delete the §5.3 sentence claiming that method ordering is stable across the threshold sweep and revise the main text to match.
On why 42.15: it is the 42.15th percentile of our 22,792-molecule label pool's docking distribution for each target, applied identically to all methods, chosen as a percentile rather than a fixed energy because AutoDock4 scores are not comparable across pockets. We agree it is mild, and the revision will report this full sweep in the main text instead of a single operating point.
The conclusion is regime-dependent. SynGuide is preferable when the goal is many candidates that are both routable and acceptable binders; SAFE-GPT is preferable for the extreme-affinity tail, because its docking distribution has a much heavier tail (BRD4(2) mean −8.54 vs our −8.12, Top-1 −12.48 vs −10.47) at a lower solve rate (58.0% vs 70.4%). We will state this trade-off.
Thank you for the detailed experiments. The additional ablations clarify the effects of the design choices and provide stronger support for the practical usefulness of the proposed method. However, my concern about the limited methodological contribution remains. Considering the additional experimental evidence, I have raised my score.
Response to the Reviewer DgsE [1/2]
We thank the reviewer for the insightful feedback and valuable comments!
W1 — prior art and isolation of the design choices
We agree that both pieces of prior art are relevant. We also agree that the reviewer's concern about isolating the design choices is central.
Prior art. RAscore did learn a planner surrogate, and SYNC did guide molecular diffusion with a learned synthesizability classifier — its Eq. (7) is the same posterior-mean (x̂₀) approximation we use, with the same justification. We had missed SYNC; it is now in the bibliography and will be discussed in the text. Differences: (Table B in the General Comment above.) The axis that matters most is the state space. SYNC operates on continuous-coordinate 3D diffusion, where the intermediate state is a noisy coordinate field. Masked discrete diffusion has no such state: the intermediate object is a partially masked token sequence, so the predictor must be defined on something differentiable that does not exist a priori, and the guidance must act on logits at masked positions only.
RAscore. the comparison that matters is against using such a surrogate the way RAscore is used — as a post-hoc filter. We ran it. Filtering unguided generations by the RA predictor gives Joint rates of 20.9 / 18.5 / 18.7 (ACAA1 / BRD4(2) / c-MET), and filtering docking-only generations gives 39.4 / 23.2 / 25.5, against 52.2 / 45.6 / 47.4 for guidance at λ_syn=0.3. The reason is arithmetic: filtered yield is keep-rate × purity, so to match our unfiltered yield while keeping a quarter of the samples a filter would need purity above 209%. A surrogate used as a filter cannot create molecules the backbone never proposed; used as guidance it changes what gets proposed.
Isolation. Contribution of each design choice: (Table H in the General Comment above.) The last two ablations are the ones raised in the review. Both were run at the paper's operating point (λ_syn = 0.3, γ = 2.0, guidance scale 0.028) as single-factor changes from the main arm, paired over the same nine (target, seed) groups, with 100% AiZynthFinder label coverage on all 7,348 newly generated molecules, so Solve and Joint are comparable to Table 1. Mean ± sd over 3 seeds: (Table I in the General Comment above.) They fail in two different ways, separated by the probability-shift column.
Normalization controls whether guidance acts at all. Removing normalization leaves the per-step probability shift at 0.0014 versus 0.260 — a 186× collapse — and the sampler becomes statistically indistinguishable from the unguided backbone on docking: mean dock −6.93 vs −6.93 (paired p = 0.388), % ≤ τ 33.6 vs 33.3 (p = 0.444). Solve rises by only +0.52 pp over unguided. Guidance is not reweighted but numerically inert.
Two effects contribute to this result: one is a tuning artefact; the other is not. The raw gradients have RMS values of approximately 2–5 × 10⁻³. At the tuned γ and scale, they add a perturbation of only ~1.9 × 10⁻⁴ to backbone logits of order 1–10—298× smaller than the normalized perturbation of 0.056. Increasing the guidance scale could compensate for this effect.
A single global scale cannot correct the second effect: the ratio of the two objectives’ raw gradient RMS values varies by target (syn/dock = 2.45 for ACAA1, 2.40 for BRD4(2) and 1.49 for c-MET). Thus, a nominal λ_syn = 0.3 corresponds to effective values of 0.512, 0.507 and 0.389, respectively—a spread of 0.123. After normalization, the effective value is 0.300 for all three targets by construction. λ is therefore interpretable as a trade-off only after normalization.
The soft relaxation controls the direction of guidance, not its strength. The hard-argmax arm has probability shift 0.254, essentially identical to the main arm's 0.260, yet reallocates that same perturbation: Solve rises to 79.36 (+5.68 pp, p < 0.0001, better in 9/9 groups) while % ≤ τ falls 69.3 → 49.7 and the joint objective drops 9.80 pp (p < 0.0001, worse in 9/9). Straight-through argmax discards the softmax Jacobian, so after renormalisation each term is still unit-RMS but points elsewhere — empirically at the synthesis objective at the expense of binding. This isolates the soft relaxation specifically, as distinct from conditioning on a clean-sequence estimate, the choice SYNC shares.
Revised contribution. We do not claim a new guidance family. We claim a fixed-budget, declared-configuration planner label as the supervision target; a predictor trained to read partially masked sequences so it is usable mid-trajectory; and a normalised multi-objective rule for masked discrete diffusion — each isolated by a paired ablation, with the joint objective shown necessary (both single-objective endpoints are worse) and the label obtainable 29.7× cheaper (AUROC 0.865 at B=1 vs 0.958 at B=500). We will rewrite the contributions and the abstract to claim exactly this and no more.