- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes PottsEnergy, a compact network that converts a protein backbone into explicit Potts fields and pairwise couplings for stability prediction. Residue reconstruction trains these potentials, and mutation effects are subsequently calculated from the same energy. A combined mutation score decomposes exactly into single-mutant effects plus pair corrections, allowing inexpensive scoring after the energy tables are generated. The paper assembles a benchmark of 306k variants with at least three substitutions and demonstrates candidate retrieval using position proposals from a coherent Ising machine (CIM).
Critical strengths
- The proposed a reusable representation based on a learned Potts energy. The same energy support reconstruction, stability scoring, and optimization.
- Although the proposed model is a small one with only ~1M parameters, it achieves comparable performance with larger domain-specific models like SPURS.
- The paper provides comprehensive baseline studies and ablations to further diagnose the performance of the proposed model. Code is also provided for good reproducibility.
Critical weaknesses
- Most critically, the core idea of using the Potts model for modeling energy and related stability tasks has been explored in PottsMPNN, which is cited in this paper. The Potts pseudolikelihood training objective follows the spirit of PottsMPNN, although it adds auxiliary terms/regularizers. PottsMPNN also explores the energy optimization idea. I do not see a significant methodological contribution in this work.
- The motivation of fitting an energy as stability predictor is less justifiable than standand inverse folding tasks, as there is no guarantee that the learned energy actually aligns with physical ddG. Currently, the model also only offer binary labels. The regression tasks in the appendix requires additional affine calibration and no raw RMSE is reported.
- For the same reason, the paper does not provide any comparison with ddG regressors, which offer substantial more information at a finer granularity. Existing works on the same task include [1] (ICLR 2023) and more recent [2], both demonstrating the feasibility of learning the ddG with strong performance.
- Dataset construction may leak stability/mutation information. Although the paper mentions that the test proteins are held out, no structure and/or sequence clustering were run for the dataset construction. This may leak homologs to the proposed model during pretraining or finetuning, making the final results less credible.
- Some baselines including PottsMPNN, ProteinMPNN, and SPURS are directly evaluated using the official checkpoints, whereas the proposed model was trained on a larger vocab, leading to potentially unfair comparison.
[1] Luo, S., Su, Y., Wu, Z., Su, C., Peng, J., & Ma, J. (2023). Rotamer density estimator is an unsupervised learner of the effect of mutations on protein-protein interaction. ICLR, 2023.
[2] Cho, Y., Tsuboyama, K., Litberg, T. J., Jung, M. D., Obisesan, A., Wang, Q., ... & Rocklin, G. J. (2026). Accurate protein stability prediction for small domains using mega-scale experiments. bioRxiv, 2026-05.
Questions for authors
Please refer to the weaknesses.