- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper investigates whether adapter parameterization affects sensitivity to output-channel orientation when adapting frozen protein structure predictors under a fixed training budget. The authors introduce Factor, which predicts residue-level factor increments and constructs pairwise residual updates through the predictor’s frozen native operators. They compare it with G+, an anchor-conditioned pairwise MLP with a free output layer. Both adapters are independently trained with native and fixed orthogonally rotated outputs, starting from zero residual updates. The central quantity is the difference between their signed native–rotated performance gaps. A positive interaction is established for a fixed Protenix/ESMC configuration on new evaluation targets and remains positive after doubling the training budget on the same panel; the corresponding new-target OpenFold test is inconclusive. Additional experiments examine injection schedules, output compensation, and reconstruction-based diagnostics, but leave the underlying mechanism unresolved.
Critical strengths
-
A carefully constructed test of the interaction between parameterization and output orientation. The four-cell design independently trains native and rotated versions of both adapters from the same zero-residual function, with matched feature access and training settings. G+ explicitly receives the native anchors and has a free output layer that can absorb rotations at the function-class level. This provides an informative comparator for Factor and tests whether adaptation can compensate for the intervention within the training budget. The resulting interaction is independent of the low-scoring Query baseline, giving the central empirical claim a meaningful basis.
-
New-target validation of a nontrivial empirical effect. For the fixed Protenix/ESMC configuration, the authors evaluate previously trained adapters on 192 targets selected before prediction and establish a positive interaction of 0.02515, with a conditional 95% confidence interval of [0.01832, 0.03213]. The interaction also remains positive after a prespecified budget extension on the same panel. This provides substantive evidence that the observed effect transfers to new evaluation targets and persists beyond the original stopping point, supporting the paper’s value as a focused empirical study.
Critical weaknesses
-
The conceptual significance of the observed interaction remains insufficiently established. The four-cell experiment demonstrates a parameterization-dependent response to rotation, but does not identify what produces this difference. Factor and G+ differ in their function classes, residue-versus-pair organization, nonlinearities, and anchor entry points. The reconstruction diagnostic does not predict the post-training direction gaps, and the preferential benefit of output compensation is not re-established in the repeat. Consequently, the study does not yet provide a validated mechanism, predictive criterion, or actionable design principle. Although a descriptive finding can be valuable, the manuscript does not sufficiently explain how this particular interaction changes our understanding or design of adapters.
-
The evidence supporting a broader adaptation phenomenon is limited. The primary interaction is established for one fixed Protenix/ESMC configuration, whereas the new-target OpenFold test remains inconclusive and AtlasFold shows no established adaptation benefit. The budget extension reuses an observed evaluation panel, and the reported confidence intervals condition on the fitted models rather than capturing variability across new training runs. These limitations are transparently disclosed, but leave substantial uncertainty about the finding’s stability across training configurations and architectures. Since the interaction also does not rank absolute adaptation quality, its broader relevance to the adapter community remains unclear, limiting the significance of the empirical contribution.
Questions for authors
-
Contribution clarification: What specific insight for adapter design is established beyond the observed parameterization-by-rotation interaction?
-
MSA baseline: How does the adapted model compare with standard MSA-enabled Protenix in lDDT and TM-score? Does the adapter provide further improvement when MSA is available?
-
Additional evaluation suggestion: Could you compare against strong baselines on a representative subset of CASP15/16 monomer targets?