- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
In this work, the authors ask whether protein generative models learn representations useful for understanding tasks, and whether aligning a generator to such a model improves what it generates. The authors first probe two structure tokenizers (La-Proteina VAE, Kanzi VQ-VAE) and two diffusion models (Protpardelle-1c, RFDiffusion) on EC and GO classification, and find all four behind ESM2 and ProteinMPNN. Citing that gap and the REPA framework from vision, they add an alignment loss to Protpardelle-1c: at layer 5 of its U-ViT trunk an MLP projects the hidden state onto the embedding a frozen encoder assigns to the clean structure, under a squared-L2 loss at weight λ = 2. The head is discarded at inference, so sampling is unchanged. The resulting model, ReaPro-1c, raises the MotifBench score from 39.2 to 47.1, improves on the baseline on both the backbone and all-atom RFDiffusion benchmarks, and lowers Fréchet Protein Distance (FPD) against CATH 4.4-S40.
Critical strengths
- The question is under-explored in proteins, and Section 3 stands on its own as an analysis contribution.
- The main gains are on MotifBench, and hold across two further settings on the RFDiffusion benchmark. Both score unique successes after clustering, so they are not explained by collapse onto a few easily designable folds.
- The method is cheap: one loss term, no architecture change, no inference cost.
Critical weaknesses
- Unconditional generation is assessed only by FPD in ProteinMPNN embedding space, the space the model is trained to match, with no designability, diversity or novelty.
- Of three alignment layers tested, only layer 5 improves on the baseline, which can harm the generalization of proposed method.
Questions for authors
- Why does the baseline appear as both 39.2 and 39.4, and was it evaluated under the same best-of-three-epoch selection and eight-sequence protocol?
- Can you report designability, diversity and novelty for unconditional generation, and FPD in an embedding space other than ProteinMPNN's?
- As a robustness check, can you run motif scaffolding once with an inverse-folding model outside the MPNN family?
- What is FA-MPNN's score, and why are the main results reported with ProteinMPNN?
- Does the gain transfer to a second base model? That is what "a general and effective mechanism" would require.
Thank you for the suggestions on independent evaluation and the scope of the method's generality.
Q1
The baseline MotifBench score is 39.24, which rounds to 39.2. We are sorry for the reporting error of 39.4. We will correct it.
The baseline and ReaPro-1c use the same sampling settings and eight-sequence evaluation protocol. For the baseline, we use the released checkpoint trained for 416 epochs, whose original checkpoint-selection procedure was not explicitly reported. For ReaPro-1c, we selected among epochs 399, 400, and 401 using one sequence per structure before running the eight-sequence evaluation.
We now report eight-sequence results for all three ReaPro-1c checkpoints: 46.08, 45.56, and 47.08, with a mean of 46.24 ± 0.77. Each checkpoint exceeds the baseline, supporting consistency beyond the selected final checkpoint.
Q2
We have added the following evaluations under the same length-matched sampling setup:
Relative to the baseline, designability improves by 14.0%, while diversity decreases by 12.4%. The lower FPD in both ESM3 and ProtDomainSegmentor [1] embedding spaces provides evidence beyond the ProteinMPNN space used for alignment.
Q3
We repeat motif scaffolding with ESM-IF for sequence design, using the same ProteinMPNN-aligned ReaPro-1c model.
Although the absolute scores are lower than with ProteinMPNN sequence design, ReaPro-1c retains a 14.9% relative improvement. This result supports robustness to an inverse-folding model outside the MPNN family.
Q4
Aligning ReaPro-1c with FA-MPNN yields a MotifBench score of 48.77. Our framework is model-agnostic and can use representations from different pretrained protein understanding models for alignment. Our main question is which types of representations benefit protein structure generation, with a particular focus on the difference between sequence-based and structure-based representations.
The FA-MPNN result provides further evidence that structure-aware understanding models can improve structure generation through representation alignment. The comparison with ESM2 also suggests that functional classification performance alone does not determine the most useful representations for generation; the modality gap between sequence representations and 3D structures matters as well.
Among models within the same modality that yield comparable generation performance, their relative ranking is secondary to this broader question. We therefore use ProteinMPNN-aligned ReaPro-1c for the main results and report the higher FA-MPNN score in the ablation on align model choice.
Q5
We agree that evaluating representation alignment on additional base models would strengthen the evidence for its generality. Due to limited computational resources, we leave this extension to future work.
[1] Miao, Yangyang, et al. “Leveraging protein representations to explore uncharted fold spaces with generative models.” bioRxiv (2025).