- Rating
- 4(+2)
- Confidence
- 2(+1)
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper introduces two techniques for peptides design which are supposed to bind to a given protein target. One of them is Flexibility-conditioned Out-of-Distribution Exploration (FlexOOD), which is supposed to enable wider exploration for peptides which are more flexible. Second technique is Hotspot-Driven Hierarchical Affinity Guidance (HHAG), which guides the generation towards high-affinity peptides and more probable hotspot residues. The authors validated their methods with computational experiments on de novo peptide design. In all cases their method is better than beslines or comparable. Ablation studies shows that FlexOOD improves diversity and HHAG improves quality of generated peptides.
Critical strengths
- The Authors propose novel property-conditioned Out Of Distribution exploration. The authors as conditioning property use flexibility, but the formulation is general, so any property can condition Out Of Distribution exploration.
- The Authors adapt classifier guidance technique to guide the model toward higher overall binding affinity.
Critical weaknesses
-
The Authors don’t measure the impact of “Hotspot-level local guidance” and “Peptide-level global affinity guidance” separately. It seems that “Hotspot-level local guidance” term is always 0 – see Question 2).
-
The Authors propose mechanism FlexOOD, which leverages structural flexibility to explore beyond the training distribution, but they don’t argue why exactly flexibility is the property that should steer beyond the training distribution. It seems arbitrary and unjustified.
In the introduction The Authors say: “Most mainstream approaches overlook peptide flexibility and the dynamic nature of protein-peptide recognition, both of which are recognized as essential for accurate binding. [...] This dynamic interplay is a hallmark of high-affinity binding.” However, FlexOOD does not incorporate flexibility into affinity binding prediction or high-affinity guidance. Instead, flexibility drives OOD exploration specifically, which again appears insufficiently justified.
The authors didn’t sufficiently analyze the importance and behavior of conditioning OOD exploration specifically on flexibility property - see Questions 1)
Questions for authors
- Why is it beneficial to have an adaptive OOD weight conditioned on flexibility specifically? Can you compare it with constant , which equals for example the average flexibility?
-
How does flexibility prediction vary along the generation trajectory for a given target? Does it increase/decrease/is constant? What is the variance of the predictions at the beginning of trajectory or at the end?
-
There is also a drawback that when OOD weight is enlarged then the flexibility predictor also gets OOD samples so its predictions are unreliable. Is it possible to somehow measure such behaviour?
- In the description of equation (11) there is writen that the predicted hotspot residue set is obtained based on the prediction. The input of is , so is a subset of indices , so is a subset of . And because of that and , so the value of (11) is always zero. Is it true?
- If it is not always zero, then why? What is the effect of “Hotspot-level local guidance” and “Peptide-level global affinity guidance” to the overall performance of PhyDiff? It would be good to see this effect in ablation studies, not necessarily setting
- The Authors measure Sequence Validity (SeqValid) as “the proportion of generated sequences containing only valid amino acid identities (no unknown or invalid tokens)”. How is it possible that Decoder outputs invalid amino acid identities?
- Additionally, The Authors report that they follow PepTri (Nguyen et al., 2026) evaluation setup, however in PepTri they have a different definition of Sequence Validity – “fraction of generated sequences passing biochemical criteria”. Why did The Authors change the definition of this metric?
-
Are the values in Table 3 reported with or without relaxation? Without such information it is difficult to compare it to Table 1.
-
Is it correct that the experimental setup in Section 4.2, “Generalization to Unseen Targets,” differs from that in Section 4.1, “Experiments on De Novo Peptide Design,” only in the test dataset used? If so, it would be beneficial to report all metrics from Section 4.1 on the PepPro-96 test dataset as well.