- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper introduces Proteina Mixta, a multimodal latent flow-matching model for protein and nanobody (VHH) design. The core idea is a shared autoencoder that maps sequence-only, backbone-sequence, and all-atom inputs into a single continuous residue-level latent space, paired with a single flow-matching network that generates across all three regimes. Building on La-Proteina, Mixta replaces its all-atom-only autoencoder with a multi-regime one trained with modality dropout, so structure-free sequences update the same generative field used for all-atom co-design.
The main contributions are: (1) a multimodal latent flow-matching model unifying sequence-only generation and all-atom co-design in one shared representation; (2) framework-conditioned nanobody design learned from pseudo-VHH supervision, where synthetic framework/CDR annotations on general protein interfaces yield framework-constrained VHH design without true CDR or framework annotations at any training stage; (3) co-training of the structure-based generator on sequence-only antibody repertoires (OAS), which improves CDR3 diversity and reduces sequence liabilities without refolding or inferred structural labels.
Critical strengths
- The shared autoencoder and product-space flow-matching design is conceptually clean and empirically supported. Fig. 3 shows that the Mixta autoencoder, unlike La-Proteina's, encodes sequence-only, backbone-sequence, and all-atom inputs into a structured joint latent space; under sequence-only encoding, Mixta preserves near-perfect sequence recovery and competitive all-atom RMSD (11.4 Å for La-Proteina vs. much lower for Mixta).
- The pseudo-VHH construction (Section 3.2, Fig. 2) transforms generic protein-protein interfaces into framework-conditioned design examples by assigning one chain as binder, placing three contiguous pseudo-CDRs in surface-exposed target-proximal regions, and assigning the most-contacting region as CDR3. This yields framework-constrained VHH design without any true CDR or framework annotations during training, which is a practically significant data-efficiency result. The benchmark (Section 4.2) holds targets, framework (hNbBCII10), CDR lengths (11/8/18), sampling budget (1,000 designs per target), and evaluation criteria fixed across methods, and separately reports oracle-free vs. oracle-based methods, sequence redesign, and inference cost.
Critical weaknesses
The primary success metric uses Proteinix-v2 as the evaluator (Eq. 6: iPAE ≤ 6 Å, pTM ≥ 0.83, ipTM ≥ 0.75, pDockQ2 ≥ 0.45), and Mixta's beam search directly optimizes negative mean interface PAE from the same Proteinix-v2 predictor (Eq. 46). The authors acknowledge this in Appendix F.2 ("This creates an advantage specific to this evaluation protocol: its reward directly optimizes one component of the success gate") and note that "an independent-oracle assessment remains necessary to test transfer." However, the main-text claims of 50-fold improvements and state-of-the-art performance rest on this coupled protocol. The oracle-validation table (Table 14) shows Proteinix-v2 rejects 70.28% of known PDB VHH complexes, so computational failure cannot establish absent binding, and passing does not establish binding. Without an independent structural oracle (e.g., AlphaFold3, RoseTTAFold2, or experimental validation) applied to the Mixta designs, the headline success rates are difficult to interpret as evidence of genuine design quality rather than predictor-specific optimization.
Questions for authors
-
Can the authors provide success rates for the reported Mixta designs under an independent structure predictor not used during search (e.g., AlphaFold3, RoseTTAFold2, or OpenDDE with a different protocol)? Given that the search reward directly optimizes one component of the evaluation gate, an independent-oracle assessment would materially change my confidence in the headline 50-fold claim. If experimental validation is unavailable, a cross-predictor comparison on a subset of targets would be a meaningful substitute.
-
Table 2 shows interface success drops from 15.77% to 10.84% while CDR3 diversity rises 26% and liability rate falls 13%. How should practitioners weigh these competing objectives? Is there a mixing ratio or filtering strategy that preserves interface success while retaining the diversity/developability gains?
-
Appendix H shows RL post-training raises PD-L1 success from 0.1% to 83.0% but yields zero successes on four held-out targets. Does this mean sequence-only RL must be run per target, and if so, what is the compute cost per target relative to the structure-based pipeline?
-
Fig. 3c and Appendix B.5 show that latent warm-up improves Mixta's co-designability and diversity but degrades every metric for La-Proteina. The authors suggest this is because the warm-up stage is effectively sequence-only latent generation, which La-Proteina was not trained on. Can this be made more precise—e.g., by measuring the alignment between the sequence-latent trajectory and the all-atom latent trajectory at the handoff point?
3 comments
Answering Questions pt 1
Q1: Cross-predictor evaluation
We thank the reviewer. We have added cross-predictor evaluation to Table 1, including both direct generation and beam search.
-
Evaluation protocol. We rescore every method using ESMFold2, which is not used in Mixta’s main VHH generation or selection pipeline. This evaluation also uses MSA conditioning rather than the template-conditioned protocol of our primary evaluator, testing robustness across both predictor and conditioning protocol.
-
The direct-generation advantage persists. Across seven targets, Mixta produces 396 TNP-clean unique successes, compared with 83 for Proteina-Nanocuerpo, 36 for RFantibody, and 33 for BoltzGen with Boltz-IF—approximately 4.8-fold more than the strongest baseline in this block. [Insert corresponding success rates and evaluation budgets.] These results support an advantage under a second predictor; they do not independently establish the original 50-fold magnitude. We now scope that headline explicitly to its original evaluation protocol.
-
The search improvement transfers across predictors. Under ESMFold2 evaluation, Mixta search produces 546 TNP-clean unique successes versus 396 for direct generation, a 37.9% increase [insert corresponding success rates and budgets]. Thus, the observed search benefit extends beyond Protenix-v2, although its magnitude remains evaluator-dependent. Mixta search also achieves a similar success count to the ESMFold2 gradient-design baseline (546 versus 559), which directly optimizes this evaluator.
-
Scope of the evidence. Protenix-v2 remains our primary evaluator because it performed best among six predictors on 508 experimentally determined complexes under the template-conditioned, MSA-free comparison in Appendix F.2. The new results provide evidence of cross-predictor robustness, not experimental validation of binding.
Q2: Weighing OAS benefits and computational success
We thank the reviewer. OAS co-training offers sequence-level benefits with a computational success trade-off. We distinguish three practical considerations.
-
The benefits persist among designs that pass. Beyond the aggregate diversity and liability improvements in Table 2, our new analysis (Appendix F.4, Table 19) shows that among gate-passing designs, CDR3 families per 100 increase by 13.4%, the largest-family fraction decreases by 24.2%, and sequence liabilities decrease by 15.5%. These benefits therefore extend to the candidates retained by computational screening. Nevertheless, the pass-rate decrease from 15.77% to 10.84% means approximately 31% fewer passing candidates at a fixed generation budget.
-
OAS introduces a distribution shift, and computational confidence has limits. OAS supplies heavy-chain sequences without paired light chains or antigen context, including conventional heavy chains rather than exclusively VHHs. Appendix F.4 characterizes their distribution shift from our benchmark. This shift may challenge the structure-prediction oracle, whose gates also reject 70.28% of known PDB VHH–antigen complexes (Appendix F.2). The lower pass rate may therefore reflect both design limitations and predictor sensitivity; we cannot attribute it solely to either. Sequence-only flow matching nevertheless enables selected repertoire properties to transfer to all-atom generation without first predicting structures for the added corpus.
-
Our mixing sweep suggests configuration-dependent benefits, not a universal optimum. On PD-L1, the checkpoint-sweep results were:
| OAS fraction | Training-corpus filtering | Top-3 / median interface success |
|---|---|---|
| 0% | — | 16.5% / 3.00% |
| 1% | Filtered | 15.6% / 3.85% |
| 10% | Filtered | 20.2% / 8.45% |
| 25% | Unfiltered | 10.9% / 1.40% |
Filtered 10% OAS thus improves computational success in this setting, showing that a reduction is not inevitable. However, this single-target sweep does not establish a generally optimal ratio or simultaneous preservation of all objectives. The 25% setting also changes filtering, so its decline cannot be attributed to mixing ratio alone. These filters apply to the training corpus, not generated candidates.
Practical recommendation. For maximizing gate-passing yield under the Table 2 protocol, the non-OAS model remains the supported default. For prioritizing sequence diversity and fewer liabilities, OAS co-training offers measurable benefits even within the passing pool. Applying interface and liability filters followed by diversity selection is a reasonable triage strategy, but we have not demonstrated that it restores the original yield. We therefore present OAS as a controllable distributional intervention with measured trade-offs, rather than a universal improvement in binding or developability.
Answering Questions pt 2
Q3: Multi-target RL and compute
This is an open question. So far sequence-only RL has been per target: neither checkpoint in Appendix H transfers to the held-out targets (Table 22). We also tried multi-target sequence-only RL, but the improvement did not carry across targets. A likely reason is that a per-target run can concentrate on a narrow successful region for one antigen, whereas a shared model has to balance several targets under the same offline RL objective; we have not isolated the cause, and we note this as future work in Appendix H.
On compute, RL is a one-time cost, after which the updated model can be resampled at the cost of ordinary sampling, whereas test-time beam search does not update the weights and pays its cost again for every design. Because sequence-only generation has a low base success rate, search needs many expensive designs per success, so RL is cheaper per successful design, and this is why we see promise in making multi-target RL work.
Q4: Latent warm-up trajectories and sampling ablations
We thank the reviewer for suggesting this analysis. We have examined sequence-only versus joint latent trajectories, expanded Appendix B.5 with more sampling ablations and intermediate latent readouts, to provide a deeper understanding of latent warm-up generation.
For the latent trajectory comparison between sequence-only and all-atom generation, we generate 100 paired samples per mode at length [50, 150, 250], using identical initial priors and shared per-step latent noise within each pair. At handoff , we compare the cosine similarity and relative displacement (relative distance normalized by the magnitude of all-atom latent) between latent states as below. However, this diagnosis overlooks the fact that the sequence latent in La-Proteina is poorly defined. We therefore report it here as an exploratory analysis rather than establishing causal evidence for latent warm-up improvement.
| Length | Mixta cosine ↑ | La-Proteina cosine ↑ | Mixta relative displacement ↓ | La-Proteina relative displacement ↓ |
|---|---|---|---|---|
| 50 | 0.902 | 0.764 | 0.440 | 0.723 |
| 150 | 0.902 | 0.745 | 0.435 | 0.756 |
| 250 | 0.881 | 0.757 | 0.471 | 0.733 |
In fact, the manuscript ablations show that the current improvement is a useful sweet spot, whereas the widely observed benefit of latent warm-up is improved diversity. In Figure 9a, at warm-up noise , increasing from 0.2 to 0.3 raises co-designability from 75.4% to 84.2% and structural diversity from 65.0% to 71.0%. At 0.4, diversity increases further to 73.8%, while co-designability falls to 74.8%. At 0.5, both deteriorate.
We further provide a more comprehensive ablation in Figure 9b by sweeping the warm-up latent temperature , handoff time , backbone temperature , joint latent temperature , and number of warm-up steps. Across the 117 evaluated configurations, increased diversity is the broader benefit, while co-designability remains similar or decreases. Nevertheless, a favorable range of settings are still shown to improve both metrics, indicating that latent warm-up offers a useful sweet spot rather than a uniform improvement across sampling configurations.
Our interpretation is that latent warm-up provides a noisy but sequence-informed initial condition for subsequent joint denoising. Why particular settings improve both metrics remains unresolved. One possible reason for this ambiguity is that the sampling schedule introduces a transition not explicitly covered during training: the model is never learned to perform joint denoising given partially denoised sequence latent. The revised manuscript therefore presents the sweet spot empirically and motivates future training-time schedules tailored to transitions between regimes in multi-regime diffusion.
Addressing Weaknesses
Weakness: Predictor dependence and experimental validation
We thank the reviewer for highlighting this limitation. We have added the independent-predictor assessment identified in Appendix F.2 and narrowed the main-text claims.
Direct generation and beam search require different interpretations. Direct generation uses no Protenix-v2 feedback during sampling, whereas beam search explicitly optimizes a component of the Protenix-v2 success gate. Both are evaluated using that gate, so their reported success rates remain evaluator-dependent. We now state this distinction prominently and qualify the headline improvement and state-of-the-art claims as computational results under the specified evaluation protocol.
Evaluation with a predictor not optimized by search is now included in Table 1. We rescored every method, including Mixta beam search, using ESMFold2, which is not used in the main VHH generation or selection pipeline. The method ranking is generally preserved, including for the search arm. This supports robustness beyond the optimized predictor, while remaining computational evidence rather than validation of binding.
Oracle validation does not resolve the coupling concern. Protenix-v2 performed best among the six predictors evaluated on 508 experimentally determined complexes (Appendix F.2), motivating its use as our primary evaluator. Nevertheless, its rejection of 70.28% of known complexes demonstrates limited sensitivity. Neither this benchmark nor cross-predictor agreement establishes that passing designs bind experimentally.
Experimental validation remains outstanding. Experiments are in progress but the emphasis on the work presented is our method development and in silico efforts, and we make no experimentally validated binding claim. The revised manuscript distinguishes predictor-defined success, robustness across predictors, and experimental binding.