- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
TACFormer generates PROTAC-like molecules for a target protein by gating pooled ESM-2 features into a decoder pretrained on 79,406 molecules (Section 3.3, Eq. (1)). Across 20 seen targets, held-out likelihoods and neighbor purity show clear chemical steering, but transfer fails on unseen WDR5 and DHFR. Section 6.1 limits claims to chemical distributions rather than bioactivity, yet I lean toward a weak reject until the conditioning and split questions are resolved.
Critical strengths
Chemical steering on seen targets rests on several checks. Table 1 shows positive mean on all 20 POIs with a macro mean, and macro purities of at and at (and at ) while accounting for alternative target labels in Section 4.3 and Appendix B.8.
I also appreciate that the authors are candid about failure modes. Figure 3 checks target clusters inside separate CRBN and VHL subsets to rule out an E3 ligase confound, while Table 1 reports METTL14 mode collapse and weak SMARCA4 purity, and Table 2 shows negative on unseen targets.
Critical weaknesses
- My main worry is that the paper never tests whether ESM-2 features beat a simple target ID. In Sections 3.2 and 3.3, each seen POI is a fixed projected vector, so the decoder can learn per-target distributions without sequence information. The unconditional baseline in Section 5.1 does not test this. Since Table 2 transfer fails and Chen and Bajorath (2024) already conditioned SMILES transformers on protein embeddings, I wasn't convinced ESM-2 does the work without a target ID or random vector control.
- I also couldn't tell if the splits rule out memorizing close analogs. Appendix B.3 uses a random 80/10/10 split of molecule and POI pairs without stating if shared canonical molecules stay in one split or if test molecules were removed from the 79,406 ZINC and ChEMBL pretraining set. Even disjoint molecule splits put close analogs across train and test sets under random splitting, which matters given the tight clusters in Figure 3 (and the anonymous repo link returned HTTP 403).
- Table 3 does not show new target-specific warhead chemotypes. String uniqueness in Eq. (2) and the unseen warhead rate only check against training warheads for that one target, so copying a training warhead from another target still counts as new while purity is only checked on whole PROTACs. Also, Section 5.1 mismatches pooled unconditional diversity () with within-target conditional diversity (), and Appendix B.8 uses 20 reference targets in Table 1 versus two in Table 2.
Questions for authors
- How do and target purity change when replacing ESM-2 features with learned POI ID or fixed random vectors?
- Does Appendix B.3 keep each canonical molecule in one split and exclude validation and test molecules from pretraining?
- How do Table 1 metrics change under splits that separate scaffolds or chemical series?
- In Table 3, what is the unseen warhead rate against all training warheads pooled, and what is the Appendix B.9 decomposition survival rate alongside target purity on warheads alone?
2 comments
I am still not convinced that ESM-2 is necessary for the proposed conditioning mechanism. The new comparison with unconditional generation shows that the model learns target-dependent chemical distributions, but this was not really my concern. As I understand it, the same behavior could be achieved using a learned target ID or a fixed random vector, since each POI is represented by a single fixed embedding during training. The authors also acknowledge this possibility. I agree that ESM-2 could potentially help with zero-shot generalization, but the current zero-shot results do not support this claim. I think the random-vector baseline is important for establishing what the protein representation actually contributes.
We thank Reviewer wPM9 for the constructive feedback. We address the comments and concerns below.
We chose ESM-2 because its representations encode sequence-derived biological relationships between proteins. These representations can also be computed for unseen POIs, unlike arbitrary target identifiers, which do not encode such relationships. If an unseen protein shares relevant features with proteins encountered during training, its embedding may allow the model to transfer learned chemical preferences. This was our main motivation for using ESM-2. Following your feedback and that of reviewer fUbM, we are testing the contribution of ESM-2 by training a random-vector baseline. Each training POI receives a fixed 1,280-dimensional random vector. The model architecture and training procedure remain unchanged. Random vectors may perform as well as, or even better than, ESM-2 on seen POIs. After all, both provide a fixed representation that allows the model to learn the chemical distribution of each training target. However, random vectors only identify proteins, whereas ESM-2 also captures relationships between their sequences. The main question is whether these relationships help TACFormer generalize to unseen POIs. We are also investigating residue-level cross-attention as an extension of this question. Mean pooling compresses residue-level information into one vector and may obscure sequence regions important for protein recognition. This may be particularly limiting to zero-shot generation. New experiments are trained on a scaffold-disjoint data split. Results from these experiments are not yet available.
We deduplicated molecule–POI pairs, but the same molecule can appear in different partitions under different POIs. We have since enforced molecule-disjoint partitions and retrained the TACFormer. The new results are consistent with the submitted results.
We will report results on the scaffold-disjoint split (currently running) in the revised manuscript, and under the new split, there are no test molecules that overlap with pretraining data. There was 1.70% overlap with pretraining in the submitted version.
The 89.18% warhead novelty reported in the submission was calculated separately for each POI, using its training warheads as the reference. We are extending this analysis to measure novelty against the pooled training warhead repertoire as suggested. We also clarified in the manuscript that the purpose of our warhead analysis is to assess structural exploration at the POI-binding end. As discussed in Section 6 and Appendix D.1, warhead novelty alone does not establish target relevance and should be interpreted alongside whole-molecule conditional-fidelity measures. PROTAC-Splitter successfully decomposes 99.99% of unique valid generated PROTACs, and parent-warhead processing succeeds for 99.97%. Finally, we clarify the diversity comparison. The unconditional diversity reported in the submission (0.790) is calculated globally across generated molecules, whereas conditional diversity (0.637) is calculated separately for each POI and then averaged. These values therefore describe different aspects of the generated distributions and should not be interpreted as a direct comparison of diversity. We will clarify the above points in the revised manuscript.