- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposed PepSAGE target at pocket-conditioned all-atom peptide design. In this method, peptide residues are decoupled into translations, rotations, amino sequence and a 6-dimentional continuous local geometry states. FSQ and Mamba are used in auto encoder, and BFN is used in generative model. And PepSAGE outperformed PepFlow, PepGLAD and PepBFN in RMSD, atom collision rate and recovery rate of dihedral angles of side chains in 120-target strict filtered test set.
Critical strengths
- In traditional all-atom representation of peptide, inconsistent dimensions of side chain dihedrals remains as a problem, PepSAGE resolved this problem by encoding it into a 6-dimensional continuous state, which significantly reduced atomic clashes without introducing complex auxiliary loss functions.
- Data leakage exists in previous benchmarks. Test set is strictly filtered in this work and all models are re-trained in same data pipeline and computational budget. The experiment results have high reliability and reproducibility with 10000 pairwise bootstrap statistical tests.
Critical weaknesses
- The method claims that generating a continuous state before FSQ can preserve information lost from discrete tokens, but generated tokens are rounded before decoder refers to S6, S7 and S18. Meanwhile, decoder received information from main network hidden representation. It is hard to discern causal relationships regarding the source of continuous details.
- The paper relies on metrics with rmsd or Rotamer recovery rate compared to conformation in dataset, inhibiting the generation of diverse peptides. The paper also lacks physical functions like rosetta metrics, or co-folding metrics like scRMSD.
Questions for authors
- How does continuous conformational information transmitted to the final atomic coordinates in S7? If we cut input of h_i^L (only use D_\psi(c_i) to decode), does the advantage of "generating continuous pre-quantization state" regarding "generating discrete tokens" still exists?
- In real-world medical chemistry scenarios, specific interactions of short peptides are often severely broken at the 6.0 \AA all-atom RMSD level, can the authors provide more metrics like rosetta or co-folding metrics.
- In tab.1, in side-chain RMSD, PepBFN is 8.509, PepSAGE reaches 6.900. While in tab.S5, -2.61 [-2.98, -2.24] vs PepBFN is filled (I think it should be -1.61), how would you explain this numerical gap? Furthermore, in tab.s6, three loss function components weights are non-zero, but only two are mentioned in S8, which one is actually used in downstream training?
2 comments
Thank you for your candid response, the table clarifications, and the new code_only ablation. The added experiments helpfully demonstrate the benefit of continuous pre-quantization states over discrete tokens, while also showing the substantial role of ; accordingly, refining the naming and discussion around the original (z=0) control will certainly improve clarity in the revised text.
My primary remaining reservation is that biophysical and interface evaluations (such as Rosetta interface scores and complex co-folding self-consistency), which are important for assessing binding quality around 6 Å RMSD, are currently planned for a future revision rather than available during the rebuttal. Since these results and other promised analyses cannot yet be evaluated, I will maintain my current rating for now. Incorporating them will certainly make the manuscript much stronger.
We thank the reviewer for the careful reading. We conducted targeted controls and record audits to clarify the continuous state, FSQ, hidden representation, and the reported numerical details.