- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates pointwise mutual information (PMI) as a reward for label-free fine-tuning of protein language models (PLMs). The authors' main proposal is that the difference between conditional and unconditional sequence log-likelihoods can measure compatibility with a design prompt, allowing a pretrained PLM to act as an implicit reward model without external supervision. Motivated by Bayes' rule and connections to classifier-free guidance, PMI is proposed as a more transferable measure of prompt fidelity across protein design tasks. The training procedure generates candidate sequences from a pretrained PLM given a design prompt, ranks them by PMI (how much more likely conditioned on prompt vs unconditional), and assigns positive and negative labels to the top and bottom candidates, respectively. These pseudo-labels are used for binarized reward optimization (BRO), which adjusts the log-likelihood ratio between the fine-tuned and reference models to favor positive over negative samples. Experiments across ProGen2 and ESM3 report correlations with experimentally measured protein properties, more consistent reward discrimination across sampling temperatures than raw likelihood scores, and improved conditional generation fidelity after fine-tuning, and generally outperforming the L1 proxy reward across the reported evaluation metrics.
Critical strengths
Simple and broadly applicable reward formulation The proposed PMI reward provides a mathematically motivated way to estimate prompt compatibility directly from a pretrained PLM, without requiring task-specific labels or a separate reward model. Its simplicity and applicability across different conditioning modalities make it a potentially useful approach to label-free post-training.
Encouraging empirical results across multiple settings The experiments span different PLM architectures, functional and structural conditioning tasks, and sampling temperatures. PMI exhibits relatively consistent reward discrimination across temperatures and improves generation fidelity over the base models, generally performing competitively with or better than the L1 baseline. The retrospective correlations with experimentally measured protein properties provide additional evidence that PMI captures biologically relevant information.
Critical weaknesses
Positioning and contributions relative to prior work. The paper would benefit from a more substantive discussion of its relationship to two closely related works that it already cites: ProteinZero (Wang et al., 2025) and Be Your Own Teacher (Li et al., 2026). ProteinZero already explores conditional/unconditional likelihood contrasts as part of a more elaborate reward formulation for protein design, while Be Your Own Teacher establishes the use of BRO with alternative proxy rewards for label-free fine-tuning. The present paper offers a considerably cleaner formulation, which is a strength. However, given these precedents, it is important to clarify what new insights or capabilities the PMI formulation provides beyond demonstrating that it is another effective proxy reward. In particular, I would like to better understand which aspects of the proposed approach are substantively new and which are simplifications or extensions of existing ideas.
Insufficient analysis of why PMI-based fine-tuning works. Given the connections to prior work, the clean formulation presents an opportunity for more targeted ablations and analyses to establish the mechanism behind the improvements. Most notably, the fine-tuning experiments do not compare PMI+BRO against conditional-likelihood+BRO. There are also broader questions about the self-training procedure, such as amplifying existing model biases or narrowing the generation distribution and reducing diversity. These concerns are motivated by observations in prior work: ProteinZero investigates diversity collapse in protein-model reinforcement learning, while Be Your Own Teacher reports diminishing improvements at larger sampling budgets, suggesting that BRO may primarily increase the probability of generating already-accessible successful outputs. More broadly, it begs the question of what capabilities must already be latent in the pre-trained PLM for this approach to work.
Questions for authors
The two weaknesses above are my questions. I am open to increasing my score, pending the authors' response.
Tables 2 and 3: "Novelty values other than PMI are synthetic placeholders; their rankings are illustrative."
#4 of https://researchonresearch.blog/2026/10/20/self-confessed-fabrications-and-rise-of-tbds/