- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes PROPEL, a 60.1M-parameter autoregressive protein language model with a target-specific latent state. Homologs and fitness measurements can update the same latent while keeping the decoder frozen, and the resulting state is used for both variant scoring and sequence generation.
Critical strengths
-
The writable latent provides a unified interface for incorporating both homolog information and fitness measurements without modifying the target-specific backbone weights.
-
The paper provides extensive analyses of latent inference, supervised adaptation, storage/compute trade-offs, and conditional generation.
Critical weaknesses
-
The necessity of the dedicated latent architecture is not established. PROPEL requires a specially pretrained 60M model with substantial latent-specific machinery, yet Table 5 reports only 0.360 in the label-free setting, essentially identical to the Site-Independent homolog profile (0.359), below ESM-2-650M using only the query sequence (0.414), and substantially below existing homolog-conditioned methods (0.432-0.479). Comparisons with strong pretrained PLMs under standard adaptation are necessary.
-
The matched-budget adaptation comparison does not isolate the benefit of the latent representation. The latent is accessible across all 12 decoder layers, whereas the 12,288-parameter LoRA baseline is applied only to the final attention output projection. Besides, distributed LoRA and matched per-layer prefix controls are not evaluated.
Questions for authors
How does PROPEL compare with existing pretrained protein language models using standard LoRA or prefix adaptation?
3 comments
Thanks for the extra experiments. However, my main concerns about whether the proposed latent architecture is truly necessary, and whether the adaptation baselines were compared fairly, haven't been resolved.
Thank you for the follow-up. We appreciate the distinction between demonstrating useful performance and establishing why a particular architecture is needed. We would like to clarify our technical contribution and the scope of the additional comparisons.
The contribution of the latent architecture. Our aim is to demonstrate the usefulness of an explicit, reusable latent state and competitive performance in the evaluated adaptation setting. The comparison with strong pretrained autoregressive models places these capabilities in context; we do not claim general superiority over those models.
PROPEL provides a variational learning-and-inference mechanism through which unlabeled context constructs a compact, reusable state and limited supervision refines that same state. A frozen decoder consumes the resulting representation for prediction and generation. We demonstrate this capability with a 60.1M-parameter model pretrained on 13.5B non-padding tokens, adapting only 12,288 state values with supervision.
Two results directly support the utility of this mechanism. Increasing inference steps from 16 to 128 improves grouped correlation from 0.2089 to 0.3595, with gains on 189/217 assays, while keeping the checkpoint and context fixed. On the original full-label protocol, combining context and supervision achieves 0.5182, compared with 0.3545 for context alone and 0.3184 for supervision alone.
These controls illustrate the flexibility of the latent-state interface. Activation and prefix adaptation retain the variationally inferred conditioning state and the pretrained decoder, while introducing supervision through different correction mechanisms. Their competitive performance supports using the same inferred representation with latent updates, activation residuals, or per-layer prefixes while keeping backbone weights frozen. The architecture therefore accommodates multiple ways to incorporate supervision into a state-conditioned model.
Fairness of the adaptation comparisons. The original comparison left an important depth-coverage asymmetry: latent refinement acts across all layers, whereas the original LoRA control acts only at the final layer. We addressed this specific concern by adding rank-1 LoRA across all 12 layers.
The native arms share the pretrained backbone, inferred-state conditioning, 12,288 adapted values, 128 available labels including validation, 100 updates, and fixed test subsets. Each method independently selects its learning rate from eight candidates using validation data. The reported results average three seeds varying label subsets and optimizer order.
| Latent minus comparator | Paired difference, 95% interval |
|---|---|
| All-layer LoRA | +0.0569 [0.0194, 0.0997] |
| Final-layer LoRA | +0.0323 [0.0190, 0.0478] |
| Activation refinement | −0.0050 [−0.0211, 0.0134] |
Seeds are averaged within assay before paired resampling. Both LoRA contrasts also remain positive under equal-family weighting. Thus, the advantage over the tested LoRA configurations persists with updates distributed across layers and independent learning-rate selection. The external ProGen3 comparison additionally differs in context inputs and adapted capacity, so we treat it as supporting context rather than an architectural ablation.
Our central claim is therefore a reusable variational inference-and-refinement pipeline with demonstrated information-combination and inference-time benefits, together with effective compact adaptation under the specified limited-label protocol. We sincerely hope these clarifications and additional results address your concerns. Thank you again for your time and constructive feedback.
We thank the reviewer for the thoughtful comments and helpful suggestions. We appreciate the opportunity to clarify our approach and provide detailed responses to the points raised below.
The requested stronger-backbone adaptation comparison is complete. PROPEL latent achieves 0.4538 ± 0.0212 versus 0.3679 ± 0.0179 for ProGen3 LoRA at 100 updates. The paired difference is +0.0859 [0.0389, 0.1374]; the equal-family sensitivity is +0.0768 [0.0433, 0.1102].
This is the additional 128-label protocol described in the common response. The methods share label subsets, validation roles, and fixed test subsets of up to 4,096 examples per assay. PROPEL uses five context-conditioned states and 12,288 adapted values; ProGen3 uses query-only input, bidirectional scoring, and 139,264 adapted values. Table 4's published ProGen3 rows instead report full-weight IRPO under the original full-label/full-test protocol; they are separate comparisons.
All 24 external assay/seed cells use the corrected deterministic runs. Together with distributed LoRA, activation refinement, and per-layer prefixes, these controls address the missing-baseline objection while separating the benefit of the state interface from a claim that latent coordinates are uniquely necessary.