- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
Authors fine-tune a small ESM trunk on features extracted from MD. Then, they use this MD-enriched representations for several downstream tasks, and show some features do improve the performance over ESM2-35M.
Critical strengths
S1. The paper is generally easy to follow, and the experiments also report negative results on fair benchmarks
Critical weaknesses
W1. Related work is overlooked. You are not the first to think about the potential of leveraging dynamics to enhance protein function prediction. In the structure encoding realm, several papers come to mind [1-4]. But papers also exist in the LLM realm [5-6]. And several papers included structure, which represents a key baseline [7-8].
W2. Does this paper enhance SOTA ? What authors show here is "esm+dynamics > esm", but don't include comparison to sota on the tasks. They only fine-tune a small esm, but I doubt this corresponds to the strongest performance. Maybe fine-tuning ESM-C would have a better chance. If you have computational constraints, you can use PEFT.
W3. On ProteinGym, you only include 10 assays, and only report on one splitting strategy; it's hard to compare to sota from this.
[1] Encoding protein dynamic information in graph representation for functional residue identification
[2] Boosting Protein Graph Representations through Static-Dynamic Fusion
[3] Learning Dynamic Protein Representations at Scale with Distograms
[4] From Static to Dynamic Structures: Improving Binding Affinity Prediction with Graph-Based Deep Learning
[5] Protein Language Modeling beyond static folds reveals sequence-encoded flexibility
[6] ESMDynamic: A Fast and Accurate Prediction of Protein Dynamic Contact Maps from Single Sequences
[7] SaProt: Protein Language Modeling with Structure-aware Vocabulary
[8] Bilingual language model for protein sequence and structure
Questions for authors
See weaknesses.