- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
LAVEP uses natural-language assay descriptions to condition a frozen protein language model on the experimental phenotype. It learns the conditioning module across assays and supports few-shot adaptation through kernel-based residual correction.
Critical strengths
- The paper addresses the limitation of assigning identical mutation scores to different experimental objectives.
- Homology-separated evaluation and text-intervention experiments provide useful evidence for assay-aware prediction.
- The framework supports both prediction without target-assay labels and adaptation from limited labeled variants.
Critical weaknesses
- Existing controls do not fully isolate detailed language semantics from supervised transfer.
- Cross-assay support pooling complicates comparisons under nominal few-shot budgets.
- The central multi-assay evidence covers few proteins, and some claims overstate the reported results.
Questions for authors
- The no-text intervention disables conditioning only at inference, so it does not separate language benefits from cross-assay supervised training. Please retrain matched controls with no text and with categorical phenotype labels to establish the value of detailed assay descriptions.
- In Eq. (7), each protein-to-text attention operation has only one text key/value, so its attention weight is always one. Please clarify this operation’s role and how it differs from simply broadcasting a projected text vector.
- Pooling support variants across assays means that a nominal K-shot prediction can use more than K labels per protein. Please report total label budgets and clarify whether competing methods receive the same cross-assay support information.
- Only two proteins in the multi-assay analysis come from the held-out test split. Please report these results separately and verify that the added NUDT15 and LDLR pairs have no protein or homology overlap with training.
- Section 5.3 claims the strongest multi-assay performance across all budgets, but Table 5 favors PRIMO at K = 16: 0.170 versus 0.149. Please correct this statement and add uncertainty estimates for the multi-assay comparisons.
response
Based on the author's response, I believe most of my concerns have been addressed; therefore, I will maintain my rating.