- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes Physio-DPO, an energy-aware post-training method for autoregressive protein language models. Starting from ProGen2-XL, the method constructs preference data using predicted structures and empirical energy scores, and modifies DPO by weighting physically comparable preference pairs according to their local energy gaps. The paper reports improvements over standard DPO and several energy-aware baselines on structural metrics, cross-oracle evaluation, and ProteinGym fitness prediction.
Critical strengths
-
Physio-DPO incorporates local energy-gap magnitude only for structurally comparable pairs, avoiding direct energy comparisons across unrelated folds.
-
Table 2 shows substantial improvements over standard DPO and energy-aware baselines, and the paper further evaluates generalization with unseen computational oracles and ProteinGym.
Critical weaknesses
-
Appendix D constructs hard negatives through side-chain repacking, backbone torsion perturbations, and chirality inversion, which appear to modify structure rather than sequence. Since Eqs. 4-5 optimize sequence likelihoods, it is unclear how these perturbations produce distinct and . If the sequence is unchanged.
-
Eq. 6 still contains , which decays as the preference becomes confidently satisfied. Therefore, the claim in Section 4.3 that the gate supplies gradient independently of model confidence appears inconsistent with the stated objective.
Questions for authors
How are the PyRosetta-perturbed structures in converted into distinct sequence-level and required by the DPO objective?