- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper introduces BindSafe-PepBench, a benchmark for evaluating target-specific peptide generation under joint binding and safety constraints, and Pepti-drift, a one-step generative framework intended to eliminate expensive inference-time guidance.
The authors identify peptide length as a major confounding factor in predicted binding–safety trade-offs and introduce exact-length-matched enrichment alongside raw Safe–Active yield. Pepti-drift uses frozen ESM-2 representations, an attraction–repulsion objective, and a non-autoregressive Transformer decoder. On 88 held-out targets, the method achieves 18.37% predicted Safe–Active yield, comparable to PepTune's 18.45%, while reporting approximately 468× lower generation cost. The experiments include comparisons with existing generators, component ablations, alternative prediction oracles, and predicted structural analyses.
Critical strengths
1. A useful joint binding–safety benchmark.
BindSafe-PepBench evaluates binding and multiple safety constraints on the same candidates under a fixed generation budget. The length-confounding analysis is particularly valuable, and the robustness checks across alternative prediction oracles strengthen this observation.
2. Competitive predicted performance with substantially lower generation cost.
Pepti-drift achieves nearly the same predicted Safe–Active yield as PepTune while requiring much less generation time. Avoiding repeated inference-time guidance is practically appealing for large-scale candidate generation.
Critical weaknesses
W.1 Limited methodological contribution. Removing the drifting block barely changes Safe–Active yield (17.80% vs. 17.31%, Table 2), questioning whether the proposed mechanism provides meaningful improvements.
W.2 Questionable repulsion mechanism. The distance normalization and temperature in Equations 20–21 make hard-negative weights nearly uniform, weakening the claimed distance-adaptive repulsion.
W.3 Unreliable evaluation. The benchmark relies entirely on computational predictors with limited accuracy. Even length-matched random peptides achieve 10.27% Safe–Active yield, raising concerns about the endpoint's biological relevance.
W.3 Insufficient experimental evidence. The reported gains are modest (+2.65 percentage points over length-matched random controls), and the main comparisons lack multiple training seeds and statistically convincing evidence of superiority.
Questions for authors
Q.1 Can the authors explain why removing the drifting block has almost no effect on performance (17.80% vs. 17.31%)?
Q.2 Given the distance normalization in Equations 20–21, how does the repulsion mechanism effectively distinguish hard negatives?
Q.3 How reliable is the Safe–Active benchmark when random peptides already achieve 10.27% success? Can the authors provide independent validation?
Q.4 Can the authors provide multi-seed experiments and stronger statistical evidence to support the modest performance improvements?