- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
CtrlMol addresses 3D molecular generation with variable numbers of reference ligands and target pockets. It uses a hybrid diffusion model, separate encoders for molecular and pocket conditions, pooled feature modulation, and two independently adjustable classifier-free guidance scales. The model is trained using ChEMBL and BindingDB, evaluated against 15 baselines on 18 TarPass targets, and examined through retrieval-count and guidance-scale sweeps on ADRB2. Its strongest reported result is improved agreement with the chemical distribution of known target actives, measured by FCD and molecular-property distances, while its docking scores remain behind the optimization-based baselines.
Critical strengths
-
Variable, independently adjustable conditioning is a useful design objective. CtrlMol accommodates empty or multiple ligand and pocket reference sets and supplies separate guidance coefficients for the two sources. This directly addresses a practical mismatch between fixed-input conditional generators and heterogeneous information available in early drug discovery (Sections 3.1–3.4).
-
The distributional results are competitive. In Table 1, CtrlMol obtains FCD Ref = 16.351 versus 22.982 for the strongest baseline on that metric, and Wass. Ref = 0.497 versus 0.629 for the best baseline. Tables 2–3 also show substantial changes in ADRB2 FCD as references and guidance scales are varied. These are substantive experimental observations, even though they need a more controlled interpretation.
Critical weaknesses
-
The evaluation may reuse the chemical information it measures. Section 4.1 states that ChEMBL and BindingDB supply both training examples and retrieved conditions at inference, whereas TarPass evaluates proximity to approximately 1,000 known active compounds per target. The manuscript does not specify whether the evaluation actives, their close analogues, or their scaffolds are excluded from training and from the retrieved ligand sets. Nor does the common TarPass scoring protocol in Appendix B.3 establish that the baselines receive comparable target-active reference information. Consequently, the FCD improvement could partly reflect access to the reference chemical distribution rather than a generalizable gain in target-aware generation. This is an unresolved information-exposure and comparator question, not a demonstrated leakage finding.
-
The new components have not been isolated from simpler alternatives. Tables 2 and 3 vary the number of reference conditions and the two guidance scales; neither removes or replaces ACCE, SACM, or IDA-CFG. At gM = gP = 1, adding one pocket to 100 ligand references changes ADRB2 FCD from 19.25 to 19.63 (Table 2), whereas at K = 300 the favorable gM = 2, gP = 1 setting improves upon gM = 2, gP = 0 (17.52 versus 19.19; Table 3). The pocket effect is therefore setting-dependent, and the sweeps alone do not establish the proposed mechanisms as the source of the headline gains. There is also a concrete formulation ambiguity: the two-branch average in Section 3.4.2 gives z + (γM ⊙ z + βM)/2 when the pocket branch is absent, rather than the full single-condition modulation claimed immediately below the equation. The implementation and the value added beyond simpler pooled conditioning and standard guidance need to be distinguished.
Questions for authors
-
For each TarPass target, how many evaluation active molecules (or matching scaffolds) also occur in the training corpus and in the ligand sets retrieved at inference? Are molecules used to compute the target-reference FCD explicitly excluded from retrieval?
-
Which baselines, if any, had access to the same retrieved active-ligand and pocket references as CtrlMol, and how were proposal counts and rejection/postprocessing budgets matched?
-
Do the authors have comparisons that replace SACM with simple pooling/FiLM or remove either conditioning branch while keeping the same retrieved references? If not, can Tables 2–3 be described as parameter sweeps rather than component ablations?
-
In Section 3.4.2, is the single-condition residual intentionally halved by the two-branch average, or is there an additional rescaling or masking step in the implementation? Please also clarify how zero-valued conditions map to zero modulation parameters.
2 comments
Response to Reviewer b7Nu (2/2)
Q2: Which baselines, if any, had access to the same retrieved active-ligand and pocket references as CtrlMol, and how were proposal counts and rejection/postprocessing budgets matched?
A2: We thank the reviewer for the question. None of the baselines had access to the same conditions as CtrlMol. The baselines support at most one pocket and at most one ligand as conditions, corresponding to K=0/1 and L=0/1 in Table 2. This setting cannot bring out the full advantages of CtrlMol.
Following the rule of TarPass Benchmark, we should generate 1,000 molecules for each target with each model. The count of "1,000 molecules" is directly subject to the output of each model, neither more or less. We did not apply any rejection/postprocessing.
Q3/W2: Do the authors have comparisons that replace SACM with simple pooling/FiLM or remove either conditioning branch while keeping the same retrieved references? If not, can Tables 2–3 be described as parameter sweeps rather than component ablations?
A3: We thank the reviewer for the question and weakness on ablation studies. Tables 2–3 appear to be parameter sweeps, but imply component ablations. As described in Section 3.4.2, the advantage of SACM over FiLM lies in adaptively supporting zero-condition input at any time, rather than higher performance. The ablation study on retrieval conditions (Table 2) demonstrates that SACM is necessary for near-optimal performance, which requires a zero-condition scenario . In a similar way, the advantage of IDA-CFG over standard CFG or standard conditioning lies in supporting heterogeneous guidance scales. The ablation study on guidance scales (Table 3) demonstrates that IDA-CFG is necessary for optimal performance, which requires heterogeneous guidance scales.
Q4/W2: In Section 3.4.2, is the single-condition residual intentionally halved by the two-branch average, or is there an additional rescaling or masking step in the implementation? Please also clarify how zero-valued conditions map to zero modulation parameters.
A4:
We thank the reviewer for pointing out this ambiguity. The single-condition residual is not intentionally halved in our implementation. The 1/2 factor in Section 3.4.2 applies only when both condition branches are present.
In Section 3.4.2, it has been described the three scenarios. When both condition types exist, the modulation averages the two branches $z \leftarrow \frac{1}{2}\big[(1+\gamma_{\mathcal{M}}) \odot z + \beta_{\mathcal{M}} + (1+\gamma_{\mathcal{P}}) \odot z + \beta_{\mathcal{P}}\big]$.
When either condition type is absent, the corresponding parameters become zero, reducing to single-type modulation .
When both are absent, it naturally degenerates to identity .
Response to Reviewer b7Nu (1/2)
Q1/W1: For each TarPass target, how many evaluation active molecules (or matching scaffolds) also occur in the training corpus and in the ligand sets retrieved at inference? Are molecules used to compute the target-reference FCD explicitly excluded from retrieval?
A1: We thank the reviewer for the question and weakness on data leakage. 90% of TarPass set occur in the training set, and 74% of TarPass set occur in the retrieval set. To investigate data leakage in CtrlMol, we kept the TarPass testing set unchanged to ensure fairness and used it as a blacklist, removing all blacklisted molecules from the training set to obtain CtrlMol-. Additionally, we removed all blacklisted molecules from both the training and retrieval sets to obtain CtrlMol--. We re-trained CtrlMol- and CtrlMol--, and re-evaluated the performance of CtrlMol- and CtrlMol-- addedin∗∗Table1∗∗. The target-aware advantage slightly decreased but remained consistently better than baselines. Compared with the second-best DeepBlock, CtrlMol- and CtrlMol-- were still improvements of 20% and 12% in FCD Ref, respectively.
We have appended the details of data exclusions at the end of Appendix B.1, and added the performance of data leakage evaluation in Table 1. Details in the Shared Concern 1 of General Response.