- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes VersaPep, a structure-aware protein language model for receptor-conditioned peptide generation. Built upon SaProt, the method introduces Gated Cross-Chain Attention (CCA) to integrate receptor information and Binding-Site FiLM (BS-FiLM) to guide peptide generation toward specific binding regions. Experiment on the test set shows improved predicted complex quality compared to the baselines. Ablation studies demonstrate the complementary benefits of receptor sequence and structural information, while binding-site conditioning provides a directional bias toward target regions without substantially affecting overall complex confidence.
Critical strengths
-
Well-motivated problem. The paper addresses an important limitation of existing protein language model-based peptide generation methods by incorporating structural information and explicit binding-site guidance. The distinction between global structural conditioning and local binding-site guidance is meaningful and well motivated.
-
Reasonable and flexible framework design. The proposed framework integrates receptor sequence, structural tokens, and binding-site information into a unified language modeling framework. The use of gated cross-chain attention and BS-FiLM provides a flexible way to incorporate both global and local conditioning signals.
-
Comprehensive ablation studies. The paper includes extensive ablations to investigate the contributions of receptor sequence, receptor structure, peptide-side structural information, and binding-site guidance. In particular, the experiments with true, predicted, and incorrect binding sites provide useful insights into how local conditioning affects peptide localization.
Critical weaknesses
- Limited improvements without peptide structural priors.
The performance gains appear to depend on the availability of peptide-side 3Di tokens. When these tokens are not provided, the improvement in mean ipTM over PepMLM decreases from 0.023 to only 0.003. Moreover, the variants without peptide 3Di do not outperform PepMLM in the independent DockQ evaluation. Since peptide structural information is generally unavailable in practical de novo design, these results raise concerns about the effectiveness of the proposed method in realistic generation settings.
- Uncontrolled training-data differences and potential benchmark bias.
Although all methods are evaluated on the same test set, the paper does not clarify whether the baselines were retrained on the proposed training split or evaluated using their original checkpoints. The original PepMLM and DiffPepBuilder models were trained on datasets constructed using different sources and filtering criteria. Since the test set is derived from the same data construction pipeline as VersaPep's training set, potential differences in training-data distributions may confound the reported performance comparisons.
- Limited effectiveness of binding-site guidance.
The effectiveness of binding-site guidance remains questionable. Table 4 shows only a marginal reduction (0.20 Å) in peptide-to-pocket distance with true binding-site conditioning, while peptides guided by incorrect sites still remain closer to the true pocket. Furthermore, Fig. 4c shows that predicted binding-site guidance underperforms no guidance at several thresholds. The unusually short inter-chain heavy-atom distances (1.30 Å and 1.97 Å) in Fig. 5 also raise concerns about potential steric clashes. More rigorous localization and structural validity evaluations are needed.
Questions for authors
-
Are the peptide 3Di tokens used during inference derived from native bound structures? How can the performance gains be interpreted when such structural information is unavailable in practical de novo peptide design?
-
Are PepMLM and DiffPepBuilder retrained on the same training set as VersaPep? If not, are potential distribution differences examined?
-
How do the authors explain the marginal improvement in binding-site localization (0.20 Å in Table 4) ? Do the unusually short inter-chain distances in Fig. 5 indicate steric clashes?
I am open to reconsidering my rating if the authors can adequately clarify or address the concerns raised above during the rebuttal.