- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents HiGenIF, a protein inverse folding framework that combines hierarchical structural representations with pretrained sequence modeling. The structural predictor uses backbone geometry and DSSP-defined regions to aggregate information at residue, regional, and protein-wide levels, producing an initial amino acid sequence and continuous structural features. ESM2-650M then takes the predicted sequence as input and incorporates the structural features through an intermediate-layer interface to refine the initial predictions. The authors evaluate the method on CATH 4.2, TS50, and TS500, reporting amino acid recovery and perplexity. Additional experiments examine the contributions of regional modeling and sequence refinement, as well as the combination of HiGenIF with external generators such as DPLM-2 Bit and ADFLIP.
Critical strengths
-
The paper evaluates HiGenIF on CATH 4.2, TS50, and TS500, reporting amino acid recovery and perplexity under the respective evaluation protocols. The results provide evidence of the method's performance across several established inverse folding benchmarks.
-
The authors include controlled experiments examining regional structural modeling and pretrained sequence refinement. The reported improvements of 4.13 and 7.48 percentage points in amino acid recovery, respectively, help establish the contribution of these components within the proposed framework.
Critical weaknesses
-
The methodological novelty is limited. Most of the proposed framework consists of established techniques combined into a larger pipeline. The structural encoder uses an EGNN [1], while the DSSP-based grouping and subsequent regional message passing follow familiar hierarchical graph modeling ideas. Related approaches to multiscale protein representations and secondary-structure-based graph pooling have already been explored in SurfPro [2] and BioPhysPool [3]. The sequence refinement stage also closely resembles existing work. LM-Design [4] already combines structural representations with pretrained protein language models for inverse folding. SPURS [5] uses cross-attention to inject structure-derived features into intermediate ESM2 layers, which is particularly close to the proposed structural injection mechanism, although the downstream task differs. I find it difficult to identify a sufficiently distinct algorithmic contribution beyond the particular combination of these components. The authors should explain more clearly how their regional hierarchy differs from existing hierarchical protein representations and why their refinement mechanism is meaningfully different from previous structure-conditioned language model adapters.
-
The claimed structure guided refinement is not strongly supported by the ablation results. The full model improves over the structure only predictor by 7.48 points, but removing the continuous structural state injection while keeping the same predicted draft and ESM2 reduces AAR by only 0.153 points. This suggests that most of the refinement gain comes from applying a large pretrained sequence model to the predicted sequence draft, while the proposed structural interface contributes only marginally. Since this interface is presented as one of the main methodological contributions, I find its practical role insufficiently established. The reliance on ESM2 also makes it important to clarify how much of the reported transfer performance may benefit from sequence knowledge acquired during large scale pretraining.
-
The current regional ablation does not isolate the benefit of the proposed DSSP based hierarchy. The main control replaces all DSSP regions with a single group, which simultaneously removes meaningful between group communication, reduces the number of hierarchy tokens, and substantially changes the information pathways of the model. The resulting 4.13 point improvement therefore shows that multiple regional units are useful, but does not establish that the proposed structural partition itself is responsible for the gain. A capacity matched comparison against alternative partitions with a similar number and size of groups would be necessary to support the central claim of explicit structural region modeling.
[1] Satorras, V. G., Hoogeboom, E., & Welling, M. (2021). E(n) Equivariant Graph Neural Networks. ICML, 9323–9332.
[2] Song, Z., Huang, T., Li, L., & Jin, W. (2024). SurfPro: Functional Protein Design Based on Continuous Surface. ICML, 46074–46088.
[3] Gu, Y., Zhao, S., Liu, L., & Ding, Y. (2026). A Biophysical Prior-Based Hierarchical Graph Pooling Strategy for Protein Function Prediction. IEEE Transactions on Computational Biology and Bioinformatics, 23(4), 1813–1826.
[4] Zheng, Z., Deng, Y., Xue, D., Zhou, Y., Ye, F., & Gu, Q. (2023). Structure-informed Language Models Are Protein Designers. ICML, 42317–42338.
[5] Li, Z., & Luo, Y. (2026). Generalizable and scalable protein stability prediction with rewired protein generative models. Nature Communications, 17, 891.
Questions for authors
-
The no-injection control reduces AAR by only 0.153 points while the full ESM2 refinement improves much more over the structure-only model. How do the authors interpret this gap? To what extent is the refinement gain coming from the predicted sequence draft and pretrained ESM2 rather than from the proposed continuous structural interface?
-
The main regional control compares DSSP-defined regions with a single group for the whole chain. Since this also changes the number of group tokens and removes between-group communication, what evidence supports the claim that the gain specifically comes from the DSSP-based structural partition rather than simply introducing multiple intermediate groups?
-
Several components of HiGenIF resemble existing hierarchical protein representations and structure-conditioned language-model refinement methods. Could the authors clarify what they consider to be the main algorithmic novelty beyond combining these existing ingredients, and how it differs technically from the closest prior approaches?