- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
-
The paper proposes Proteo-AA, a bidirectional refinement framework that connects pretrained backbone generation and sequence–side-chain modeling through lightweight adapters. Side-chain atomic information is fed back into the backbone denoiser to improve structural consistency, while keeping both pretrained models frozen.
-
The framework introduces two complementary feedback pathways: B2C injects backbone residue features into FAMPNN to guide sequence and side-chain generation, while C2B uses residue-level and pairwise atomic information to refine backbone predictions. A single feedback event is performed during diffusion to balance structural refinement and computational cost.
-
Proteo-AA is evaluated on unconditional protein generation, target-conditioned binder design, and side-chain packing. It achieves a mean binder designability of 31.48% across ten targets, compared with 21.19% for PXDesign, and improves several side-chain packing metrics. Ablation studies support the contributions of both feedback directions, although comparisons with other iterative refinement methods would further clarify its methodological novelty.
Critical strengths
-
Consistent performance improvements over strong baselines. Proteo-AA achieves promising results across unconditional protein generation, target-conditioned binder design, and side-chain packing. In Table 1, it reaches 82.2% all-atom codesignability and 92.6% designability with ProteinMPNN redesign (PMPNN@1). In Table 2, it achieves a mean binder designability of 31.48% across ten targets, outperforming PXDesign (21.19%) and A-CODE with ProteinMPNN redesign (20.98%). These results demonstrate the potential of incorporating bidirectional backbone–side-chain feedback to improve protein design quality.
-
Effective bidirectional feedback supported by ablation studies. The ablation results in Table 2 show that removing the C2B adapter reduces mean binder designability from 31.48% to 25.14%, while removing both adapters reduces it to 24.19%. In Table 3, Proteo-AA also achieves the best results on six of seven reported side-chain packing metrics when evaluated on PXDesign backbones. These findings support the contribution of atomic-level feedback to backbone refinement and suggest that the proposed coupling improves both backbone–side-chain compatibility and downstream design performance.
Critical weaknesses
-
Lack of analysis on the number of feedback iterations. Proteo-AA performs a single feedback event during backbone diffusion, where FAMPNN generates an intermediate all-atom structure that is used to refine the backbone. However, the paper does not investigate how the number of feedback iterations affects performance. Although the ablation studies examine the contributions of the B2C and C2B adapters, they do not compare different numbers of feedback iterations. Evaluating multiple iterations would help clarify whether additional refinement leads to further improvements or introduces diminishing returns, while also quantifying the associated computational cost.
-
Lack of direct comparisons with existing iterative refinement methods. Although the paper compares Proteo-AA with multiple strong baselines across unconditional protein generation, binder design, and side-chain packing, it does not directly compare the proposed feedback mechanism with prior protein design approaches that explicitly employ iterative structural refinement, such as FAIR. Such comparisons would help establish whether the performance gains arise specifically from the proposed bidirectional adapter coupling, rather than from the general benefit of iterative refinement. They would also provide a clearer assessment of the method's novelty and practical advantages over existing approaches.
Questions for authors
-
It would be interesting to investigate whether organizing PXDesign and FAMPNN into multiple alternating blocks within a unified iterative framework could further improve performance. In particular, comparing different numbers of refinement rounds would help determine whether repeated backbone–side-chain interactions yield additional gains over the single feedback event used in Proteo-AA, and how these gains trade off against computational cost.
-
Could the authors compare Proteo-AA with at least one existing protein design method that employs iterative structural refinement or coupled optimization, such as FAIR? This would help establish whether the proposed bidirectional adapter mechanism offers advantages over existing iterative approaches in terms of design quality, structural consistency, and computational efficiency.
2 comments
Dear Reviewer,
Thank you again for your thoughtful feedback and constructive suggestions. We would greatly appreciate it if you could take another look at our responses and let us know whether they adequately address your concerns. We would be happy to provide further clarification or discussion if needed.
Thank you for your time!
[Weakness 1, Question 1]: Effect of multiple feedback iterations on designability and computational cost
Thank you for this suggestion on investigating how the number of feedbacks affect performance. We conducted additional experiments varying the number and timing of feedback events during backbone diffusion, evaluating whether repeated backbone–side-chain interactions improve binder designability. Our results show that feedback effectiveness depends more on timing than frequency. The best single-event configuration at step 350 achieves 31.48% mean designability, compared with 25.14% without C2B feedback. Adding an earlier feedback event (step 303) or a later event (step 395) to the default configuration reduces designability to 25.46% and 28.89%, respectively. In contrast, adding an event near the default step (steps 347 and 350) yields 31.18%, nearly identical to the single-event result. Overall, multiple feedback events provide little additional benefit, suggesting that appropriately timed feedback is more important than increasing the number of interactions.
Feedback effectiveness depends on backbone maturity more than feedback events. Earlier diffusion stages produce less resolved backbones, leading FaMPNN to generate potentially unreliable side-chain configurations. Feeding these premature structures back into backbone refinement may introduce misleading structural information that subsequent feedback cannot fully correct. A very late feedback left very few steps for the backbone module to correct results.
We additionally measured complete generation runtime, including backbone generation and all feedback operations:
Increasing feedback from one to three rounds approximately doubles total generation time without corresponding improvements in designability. Together, these findings suggest that carefully selecting feedback timing is more effective than increasing feedback frequency. We will incorporate those results in our final version together with the full Proteo-AA table in the final revision.
[Weakness 2, Question 2]: Comparison with existing iterative refinement methods
Thank you for this suggestion in comparison with FAIR.
To assess iterative refinement baselines, we evaluated the official pretrained FAIR checkpoint as a downstream refinement stage following PXDesign and FaMPNN across all ten AlphaProteo10 targets, conditioning on local target-interface atoms. In total, we generated 1,000 runs by refining 20 candidate structures per target using five independent random seeds. Post-refinement mean designability reached only 0.3%, yielding just a single successful design for IR and two for PDL1. Further geometric inspection revealed that 90.87% of design-region bonds diverged by over 0.25 Å from standard ideal geometry. Because FAIR was originally trained for small-molecule-conditioned pocket generation, these experiments reflect its zero-shot transfer performance on binder design without task-specific fine-tuning, rather than an upper bound on its potential after retraining. We will include these FAIR benchmarks and structural metrics in the final revision, noting the boundaries of zero-shot transfer while expanding our discussion of related iterative optimization frameworks.