- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3(+1)
- Soundness
- 3(+1)
Read review
Paper summary
This work proposes a model for generating peptide drug candidates by changing some parts of the chain while leaving the rest exactly as is. The positions and properties to change are defined by the user so the binding region can be protected. The model returns a complete complex that any external scorer can evaluate. This allows the user to make edits and keep the best ones and change the objective without retraining the model. Some parts need to be further addressed.
Critical strengths
- The user is able to choose which residues to change and which variables to release.
- The user can change the objective without retraining the model.
- The model performs multiple operations with one set of weights.
- The authors prove that retained parts stay exactly as they were.
Critical weaknesses
- The paper reports results under two different sampling methods. The reader has to track which numbers belong to which.
- The baseline starts from a random backbone so the score is as low as random guessing. EditFlow uses a learned backbone, and the design also goes from sequential to joint. Both change at once so it is not clear which one causes the gap from 4.68% to 40.78%. Table 7 suggests it is mostly the backbone.
- Table 15 compares the methods on the same complexes, but the main comparison does not do this. Therefore, the error bars stay wide and the two methods overlap.
Questions for authors
- What is the percentage of test receptors that have a homolog in the training set?
- Why is PepFlow missing from Table 2?
- What is the error of the Caco-2 predictor? The difference between the methods is very small.
- Can you run ProteinMPNN on your own backbones with the same regions as in Table 2 to check if the gap stays?
4 comments
To Reviewer GhZr Part II
Q1: What is the percentage of test receptors that have a homolog in the training set?
A: Using MMseqs2 [3] on receptor-chain sequences available in the structures (% sequence identity, %test-chain coverage, , matching PepFlow's clustering cutoff), 46.52% of test complexes have a training-set receptor homolog (45.99% under bidirectional % coverage, Appendix G.2).
Q2: Why is PepFlow missing from Table 2?
A: We added locally masked PepFlow [4] (200 steps), adapted PepHAR [5], and shared-backbone MPNN controls to Table 2 under matched segments, context, and minimization (64 candidates). EditFlow (50 steps: 40.78% AAR, 2.55 Å BB-RMSD, 65.10% Contact F1, 99.25% closure) beats PepFlow (30.09%, 2.98 Å, 60.12%, 98.47%) by +10.69 pp AAR, −0.43 Å BB-RMSD, and +4.98 pp Contact F1 (Appendix H.3, Tables 10–12).
Q3: What is the error of the Caco-2 predictor, given the small numerical differences?
A: PeptiVerse's [6] Caco-2 head () has validation RMSE 1.30 and Spearman . Because canonical hydrophilic peptides cluster tightly near −5.85 (SD 0.011), small raw shifts reflect consistent rank-order gains (Appendix I.1). On a held-out PepLand [7] nc-CPP permeability predictor (zero overlap, RMSE 0.9426, ), saved Caco-2 (SPIE) endpoints gain +0.2817 [0.0944, 0.4715] without re-selection (Appendix I.4, Table 26).
Q4: Can you run ProteinMPNN on your own backbones on the Table 2 regions to check if the gap stays?
A: Yes (see W2 above and Appendix Table 12). On the exact 2.55 Å joint EditFlow backbones, ProteinMPNN reaches 26.66% AAR (63.96% Contact F1, 99.25% closure) vs. 40.78% AAR (65.10% Contact F1) for EditFlow, leaving a +14.12 pp paired AAR lead (+1.14 pp Contact F1) on identical coordinates.
References:
[1] Dauparas et al., Robust deep learning–based protein sequence design using ProteinMPNN, Science 2022.
[2] Dauparas et al., Atomic context-conditioned protein sequence design using LigandMPNN, Nat. Methods 2025.
[3] Steinegger & Söding, MMseqs2 enables sensitive protein sequence searching for the analysis of massive data sets, Nat. Biotechnol. 2017.
[4] Li et al., Full-Atom Peptide Design based on Multi-modal Flow Matching, ICML 2024.
[5] Li et al., Hotspot-Driven Peptide Design via Multi-Fragment Autoregressive Extension, ICLR 2025.
[6] Zhang et al., PeptiVerse: A unified platform for therapeutic peptide property prediction, Nat. Commun. 2026.
[7] Zhang et al., PepLand: a large-scale pre-trained peptide representation model for a comprehensive landscape of both canonical and non-canonical amino acids, Brief. Bioinform. 2025.
Thank you for the additional experiments and clarifications. My main concerns have been addressed. I have updated my scores accordingly.
Thank you for your Comment
Thank you very much for your time and for raising your scores. Your constructive feedback helped us strengthen both the soundness and the presentation of the paper, and we will make sure these improvements are reflected in the final version.
To Reviewer GhZr
We thank you for your positive assessment of EditFlow's design and for your constructive comments, which helped us improve the clarity and rigor of our manuscript. In the revision, we clarified the sampling configurations across tasks (W1), added shared-backbone MPNN controls and PepFlow/PepHAR baselines in Table 2 to separate backbone quality from joint design (W2, Q2, Q4), performed complex-level paired analyses for the main comparison (W3), and reported the receptor homology rate (Q1) and Caco-2 predictor error with external validation (Q3). We address your concerns and questions as follows.
W1: Clarifying the two sampling methods across experiments.
A: All EditFlow evaluations share a single set of trained weights and adopt task-specific sampling configurations: joint integration for de novo generation and single-pass local redesign (Tables 1–2), and window refinement for sparse-anchor completion (Table 3) and multi-round lead optimization to iteratively refine local edits given retained context (Section 3.3, alongside a matched joint-integration control in Figure 4g). To make this easy to track, we now describe the sampling configurations in the corresponding experiments and summarize all task setups in Appendix G.2 (Table 6).
W2: Separating backbone quality from joint sequence–structure design in Table 2 (4.68% to 40.78% AAR).
A: We ran ProteinMPNN [1] and LigandMPNN [2] on two sets of EditFlow backbones under the exact Table 2 protocol (64 candidates, Table 2, Appendix G.4, Table 12):
Moving from 3.43 Å sequence-blind backbones to 2.55 Å joint backbones doubles MPNN AAR, confirming the role of backbone accuracy. Yet on the exact same 2.55 Å backbones, EditFlow still beats ProteinMPNN and LigandMPNN by +14.12 and +15.36 pp in paired AAR, showing that the gain comes from both better backbones and joint sequence–structure design.
W3: Complex-level paired analysis for optimization to control inter-complex variance.
A: Mean paired differences across complexes ΔHV (EditFlow minus PepFlow) under matched 200-step integration (64 proposals) control inter-complex variation and are strictly positive across all four policies (Section 3.3, Appendix I.2, Table 24):
Window refinement vs. 200-step PepFlow likewise has paired 95% CIs strictly above zero across all four policies (Appendix I.2).