- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents GeoSeqAlign, a protein inverse folding framework that combines a frozen protein language model with geometry-aware conditioning. The method uses SE(3)-invariant pairwise geometric features to bias attention, synchronized masking of sequence and structure during training, and a variational information bottleneck to regularize the latent representation. An auxiliary geometry reconstruction loss is also used during training, while inference generates sequences from the target backbone in a single PLM decoding pass. The method is evaluated on CATH+ 4.3, TS50, and CASP15/TS45, with additional tests under coordinate noise, structural self-consistency, diversity, and computational cost. The experiments report improvements over the evaluated baselines and include ablations on synchronized masking, KL regularization, and geometric attention.
Critical strengths
-
The evaluation is fairly broad for an inverse folding paper. In addition to CATH+ 4.3, the authors test zero shot transfer on TS50 and CASP15/TS45, robustness to coordinate noise, structural self consistency, sequence diversity, and computational cost. This makes it easier to judge the method beyond a single in distribution recovery number.
-
The paper includes reasonably well controlled ablations for the two main training choices. In particular, synchronized masking is compared with independent masking under matched corruption rates, and the KL term is removed while keeping the stochastic encoder unchanged. These controls give useful evidence that both components contribute to the reported robustness gains, even if the proposed explanation for why synchronized masking helps is not fully established.
Critical weaknesses
-
The motivation for synchronized masking is not fully justified. In fixed-backbone inverse folding, local backbone geometry is legitimate conditioning information rather than a label leak, and it does not uniquely determine the amino acid identity. The theoretical analysis only shows that synchronized masking removes a co-located information channel, while the appendix explicitly notes that this does not imply that the model learns global topology or avoids overfitting. The experiments therefore support synchronized masking as a useful regularizer, but not the stronger shortcut-removal mechanism used to motivate the method.
-
The empirical comparisons are not fully controlled. GeoSeqAlign is trained on CATH+ 4.3, while several baselines rely on released checkpoints trained on earlier CATH variants or additional external data, so Table 1 does not correspond to a common training protocol. The robustness comparison is also favorable to GeoSeqAlign in a nontrivial way because coordinate noise is already part of its training corruption, whereas the competing checkpoints are not reported to receive matched noise augmentation. This makes it difficult to separate gains from the proposed modeling choices from gains due to the training setup.
-
The experimental section is broad, but much of it is peripheral to the central claim. ProteinGym mutation ranking, Rosetta energy proxies, diversity analysis, and several folding-oracle diagnostics show that the model has useful downstream behavior, but they do not address the main question of whether synchronized masking actually changes the model from relying on local geometry to using broader structural context. A more direct analysis of local versus non-local evidence would be more informative than adding further auxiliary evaluations.
Questions for authors
-
The main motivation argues that synchronized masking prevents the model from taking a local geometry shortcut. Since local backbone geometry is valid conditioning information in inverse folding, could the authors clarify what exactly is considered the undesirable shortcut here, and what evidence shows that independently masked models rely less on broader structural context?
-
In Table 1, GeoSeqAlign is trained on CATH+ 4.3, while several baselines use released checkpoints trained on different CATH versions or additional external data. Could the authors clarify how comparable these training conditions are and whether any representative baselines were retrained on the same CATH+ 4.3 split?
-
The robustness experiments evaluate Gaussian coordinate noise, which is also used during GeoSeqAlign training. Were any competing models trained or fine-tuned with matched coordinate-noise augmentation? If not, how should the robustness gains be interpreted relative to differences in training augmentation?
-
The paper includes several recent baselines, but leaves ADFLIP and CoFlow outside the matched evaluation. Could the authors clarify why these methods were not included and whether their omission affects the claimed positioning of GeoSeqAlign among recent inverse-folding models?