- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper addresses the high computational cost of protein generation and structure prediction, where iterative sampling and expensive model architectures limit the throughput of large-scale protein design campaigns. The authors propose Proteina-Pronto, a framework that accelerates both protein generation and folding-based evaluation through distillation, aiming to preserve model quality while substantially reducing inference costs.
For protein generation, the authors first replace low-temperature stochastic sampling with a deterministic ODE using Temporal Score Rescaling (TSR). They then introduce a schedule-coupling formulation that maps the separate denoising schedules of backbone coordinates and residue-level latent variables onto a shared global time, enabling the application of diffusion distillation to multimodal product-space models. Several distillation approaches are investigated, including Terminal Velocity Matching (TVM) and π-Flow. For structure prediction, the authors accelerate Boltz-2 by distilling its diffusion module into a four-step sampler and replacing its computationally expensive Pairformer trunk with a smaller architecture trained through representation distillation.
The framework is evaluated across unconditional atomistic protein generation, target-conditioned binder design, and biomolecular structure prediction. The distilled protein generators achieve performance comparable to their original 256-step samplers using only 16 steps. For structure prediction, the accelerated Boltz-2 retains approximately 99% of the original model's lDDT on the PDB test set while achieving a 3.9 times faster end-to-end inference. By combining accelerated generation with faster structure-based evaluation, Proteina-Pronto enables more efficient inference-time scaling, producing up to approximately six times as many unique successful binder designs per GPU-hour on challenging targets. Overall, the study demonstrates that distillation can substantially improve the computational efficiency of protein design pipelines while largely preserving the predictive and generative performance of the original models.
Critical strengths
- Substantial Computational Efficiency Gains with Strong Experimental Validation
The paper demonstrates substantial inference acceleration across three protein modeling systems: La-Proteina, Proteina-Complexa, and Boltz-2. The distilled generative models reduce sampling from 256 to 16 steps while maintaining competitive protein generation and binder-design performance. For structure prediction, Boltz-2distill achieves a 3.9× end-to-end speedup while retaining approximately 99% of the original model's lDDT. Importantly, the evaluation extends beyond individual model efficiency to complete protein design workflows, demonstrating up to approximately 6× more unique successful binder designs per GPU-hour. The extensive experiments, including ablation studies, structural quality assessments, and downstream evaluations, provide convincing evidence of the framework's practical value.
- Effective Adaptation of Distillation Techniques to Protein Design and Structure Prediction
The paper addresses several practical challenges in accelerating protein generative models. For La-Proteina and Proteina-Complexa, the authors introduce a schedule-coupling formulation that enables distillation of multimodal generation processes with asymmetric denoising schedules. They also propose self-forcing self-conditioning to reduce the training–inference mismatch in few-step generation, supported by clear improvements in binder-design performance. For Boltz-2, they combine diffusion distillation with representation distillation to accelerate both structure generation and the computationally expensive Pairformer trunk. Although the individual techniques build on established methods, their effective adaptation and integration across different protein modeling tasks constitute a meaningful technical contribution.
Critical weaknesses
- Potential Limitations in Structural Diversity Due to Fixed Modality-Coupling Schedules
The proposed multimodal distillation framework restricts the independently conditioned denoising processes of backbone coordinates and residue-level latents to a predefined one-dimensional temporal trajectory. Although the original teacher models also use asymmetric schedules during inference, their two-dimensional time-conditioning formulation allows alternative denoising trajectories. By distilling only a fixed trajectory, Proteina-Pronto may limit the range of protein conformations accessible through different backbone–side-chain generation sequences, particularly for structurally complex proteins. While the authors demonstrate that structural diversity is largely preserved relative to the original sampling baseline, they do not investigate whether alternative coupling schedules could expand the accessible conformational space. A systematic comparison of generation quality and structural diversity across different coupling schedules would help clarify this potential limitation.
- Insufficient Validation of Binder Ranking Consistency in the Distilled Folding Model
The paper demonstrates that Boltz-2distill retains approximately 99% of the original Boltz-2's lDDT while substantially reducing inference time. However, preserving average structure prediction accuracy does not necessarily guarantee that the distilled model maintains the same ranking of candidate binders as the original model. This distinction is particularly important because Boltz-2distill is used as a reward model for inference-time search, where the relative ordering of candidates directly influences which designs are selected. Although the authors provide downstream evaluations using independent folding models, they do not directly assess ranking consistency between Boltz-2 and Boltz-2distill. An analysis of rank correlations, top-k candidate overlap, and agreement in selecting high-quality binders would strengthen the evidence that inference acceleration preserves the reliability of candidate prioritization.
Questions for authors
- Impact of Fixed Modality-Coupling Schedules on Structural Diversity
The proposed distillation framework restricts backbone coordinates and residue-level latents to a predefined one-dimensional denoising trajectory. Although the authors demonstrate that structural diversity is largely preserved relative to the original teacher model, could this fixed coupling schedule exclude protein conformations that might be accessible through alternative backbone–side-chain denoising trajectories? Have the authors evaluated different coupling schedules, such as uniform or alternative asymmetric schedules, to determine their effects on structural diversity, co-designability, and binder-design success rates?
- Binder Ranking Consistency Between Boltz-2 and Boltz-2distill
The paper reports that Boltz-2distill retains approximately 99% of the original Boltz-2's lDDT. However, maintaining average structure prediction accuracy does not necessarily imply preserving the relative ranking of candidate binders. Given that Boltz-2distill is used as a reward model during inference-time search, have the authors evaluated whether it produces rankings consistent with the original Boltz-2? In particular, could the authors report rank correlations (e.g., Spearman's ρ), top-k candidate overlap, and agreement in identifying high-quality binders under the same candidate pool?
I would be happy to reconsider and potentially increase my overall rating if the authors can provide convincing evidence addressing these two concerns, particularly through additional analyses demonstrating that the fixed coupling schedule does not substantially constrain structural diversity and that Boltz-2distill preserves reliable binder ranking and candidate selection.
2 comments
I appreciate the authors for the earnest rebuttal. When I consider the scope of this research, my concerns are resolved clearly via the rebuttal. So, I'd like to raise my rate.
Author response I
We thank the reviewer for taking the time to review our work.
We follow the exponential-backbone/quadratic-latent coupling established by La-Proteina. Its extensive schedule ablation (Appendix G.2, Table 8) shows that only tested configurations generating the backbone faster than the latents reach 50% all-atom co-designability, with the selected pairing achieving the highest co-designability while maintaining high structural diversity. This scheduling choice was subsequently adopted by Proteina-Complexa and RFD4-Proteina. These results lead us to expect modest gains, if any, from further tuning within the studied schedule families, although broader gains in conformational coverage remain untested. We acknowledge that our current students are specialized to a fixed coupling path and do not retain the teacher’s flexibility to change paths at inference. A possible extension would condition the student on schedule parameters and distill trajectories across a family of monotone paths. We leave this extension to future work and focus here on accelerating the empirically validated teacher configuration.
We agree that average lDDT alone does not establish ranking consistency. We therefore evaluated the same 1,900 binder candidates, 100 for each of 19 targets, with original Boltz-2 and our four-step distilled model. The candidates were generated using Proteina-Pronto_TSR with 256 sampling steps. We computed Spearman’s rank correlation separately within each target and averaged these correlations across targets. To contextualize the results, we also repeated the original Boltz-2 evaluation with different random seeds, providing a reference for its stochastic repeatability.
These results provide direct evidence of substantial within-target ranking agreement beyond preservation of average structure-prediction accuracy. The teacher–student correlations approach the teacher-repeat reference particularly closely for interface PAE and binder scRMSD, while pLDDT shows a larger remaining gap. We added these results in section H2 “Rank-agreement between Boltz-2 and Boltz-2-distill”.