- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates the role of residue-level alignment fidelity in retrieval-augmented protein inverse folding. Unlike previous approaches that mainly focus on improving template retrieval, selection, or fusion, the authors argue that accurately aligning retrieved template residues to target backbone positions is a more important bottleneck. To address this, the paper proposes STENCIL, which first retrieves structural templates using Foldseek and then performs structural re-alignment using TM-align. The results are used to construct template sequence evidence, which is incorporated into a graph-based decoder. The main experiments are conducted on CATH dataset, they achieved notable results on it. The authors further conduct several analyses to investigate the importance of alignment fidelity.
Overall, I think the paper addresses an interesting and practically relevant problem, and the controlled experiments provide useful insights into retrieval-augmented protein inverse folding. However, I have several concerns regarding the generality of the central claim, the dependence on highly similar retrieved templates, the methodological novelty, and whether the experimental results sufficiently establish the advantages of the proposed method.
Critical strengths
-
The paper investigates a meaningful aspect of retrieval-augmented protein inverse folding. While existing approaches often focus on finding better templates or integrating more retrieved information, this paper emphasizes the importance of accurately aligning template residues to target positions. I think this is a reasonable research direction, as inaccurate residue correspondences could directly affect how retrieved information contributes to sequence prediction.
-
The paper includes several useful controlled experiments to investigate the role of alignment. In particular, the correspondence corruption experiments and the paired 2×2 comparison of template selection and alignment sources provide evidence that residue-level correspondence is important for downstream recovery.
Critical weaknesses
-
I am not fully convinced that the experiments sufficiently support the central claim that alignment fidelity outweighs template selection. STENCIL's performance strongly depends on the availability of highly similar templates, and it even underperforms the template-free baseline in low-identity settings. Moreover, the ablation uses a checkpoint trained with exact-alignment evidence, which may favor this alignment strategy due to training–inference distribution shift. The correspondence corruption experiments also do not directly establish that TM-align produces more accurate alignments than Foldseek. I think stronger evaluations across different template identity ranges, independently trained alignment strategies, and direct correspondence accuracy measurements would be helpful.
-
The experimental comparisons and overall presentation could be improved. Some closely related methods, such as PRISM and Refold, are not directly re-evaluated, making the performance comparisons less conclusive. In addition, the considerable gap between micro and median recovery, together with the computational cost of exact re-alignment, raises questions about the practical advantage of the proposed method. I also have some concerns about the presentation and formatting. The related work section could be more comprehensive, and the section heading fonts appear slightly different from the standard ICLR template. I think the authors should clarify whether the official formatting requirements have been followed.
Questions for authors
-
Could the authors provide a more detailed evaluation across different template sequence identity ranges? In particular, does STENCIL still outperform retrieval-based and template-free baselines when highly similar templates are excluded?
-
Does the conclusion that alignment fidelity outweighs template selection still hold when models are independently trained with different alignment strategies? I am also curious whether the 517 complete-case queries are representative of the full validation set.
-
Could the authors provide an independent evaluation of correspondence accuracy between TM-align and Foldseek? I think it would be helpful to investigate whether improvements in alignment accuracy correlate with downstream recovery gains.
-
Could the authors further investigate the accuracy–computation trade-off? In particular, how does recovery change when fewer candidates undergo exact re-alignment, and can similar performance be achieved with a smaller computational budget?