- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes a method for predicting protein structures by modeling their flexibilities. The main framework contains two components: FlexFormer and FlexFlow, where FlexFormer predicts the flexibility profile that also considers sequence-level mutations, and FlexFlow uses this profile to steer the starting structures via inference-time guidance. The method shows good performance in flexibility profile (RMSF) prediction and better structure quality.
Critical strengths
- The problem this paper targets is important: modeling the protein's dynamic flexibility and using this to guide protein generation. The two-stage framework is well explained and well motivated, and considering the inclusion of sequence mutation solves some real limitations of current methods
- Experiments are comprehensive and correspond well with the methods and initial motivation.
Critical weaknesses
- Using only the Person correlation coefficient as the objective in inference-time guidance may bring some problems because it's scale-insensitive. RMSF profiles with different scales can still have r near 1, which may make FlexFlow generate proteins that move too little or too much.
- It lacks analysis of what physical states of proteins this model generates. The large sc-RMSD in Table 3 is very large. It can be because either the structure itself is bad or it's just not designable, where the latter can be because the generated protein is not an energy-stable state. Though it's reasonable in the current flexible protein modeling setting, it would be good to clarify what proteins this model generates.
Questions for authors
- Following the first pointed weakness, have the authors tried other objectives in inference-time guidance, like direct MSE loss for RMSF profiles?
- Have you done any energy analysis of the generated proteins? I am curious if they are in the stable/metastable state or the transition state.
- It would be good to clarify the equivariance/invariance of the proposed methods. Based on my understanding, the FlexFormer should be invariant in predicting RMSF profiles, but the FlexFlow should be equivariant. Both are not fully discussed in the current paper.
3 comments
We sincerely thank the reviewer again for the thoughtful and constructive evaluation. We have provided additional MSE-versus-Pearson guidance experiments and clarified the physical interpretation and symmetry properties of our framework. We would greatly appreciate any further feedback on whether our responses address your questions, and would be happy to provide additional clarification if helpful. Thank you so much again!
Thank you for the additional experiments and clarification of the limitations. Please incorporate these explanations and clarify the scope of the claims in the main text. Overall, I maintain my score of 3.
We sincerely thank the reviewer for the thoughtful and constructive evaluation of our work and for recognizing the importance of flexibility-guided protein design. These comments motivated additional experiments and helped clarify the scope of FlexFlow.
Comment 1: Pearson versus MSE guidance
We agree that Pearson correlation is insensitive to positive scaling and constant offsets:
Corr(ξ̂, aξ + b) = Corr(ξ̂, ξ), for a > 0.**
Our current guidance objective is designed to control the relative distribution of flexibility across residues, particularly the locations of flexible and rigid regions, rather than independently controlling absolute RMSF magnitude.
To directly investigate the reviewer's suggestion, we conducted a 24-target factorial ablation using the same frozen MultiFlow generator, independently varying predictor (BackFlip/HierEGT), guidance location (intermediate/predicted clean), and objective (MSE/Pearson). Strengths were calibrated on a separate validation set; generated flexibility was evaluated with GNM, independent of the learned predictors.
All four comparisons have p ≤ 0.0025. Particularly noteworthy is the original BackFlip predictor at intermediate coordinates: changing only the objective yields +0.283. Over a further 32-fold strength sweep, MSE reached at most GNM r = 0.467, versus r = 0.663 for Pearson. These results support Pearson guidance for relative-profile agreement; absolute RMSF control would require an additional amplitude-sensitive term.
Comment 2: Structural self-consistency and physical states
FlexFlow generates candidate backbones; ProteinMPNN assigns sequences and ESMFold refolding assesses sequence–structure self-consistency. The large scRMSD values indicate challenges in recovering the generated backbone. scRMSD alone cannot distinguish geometric inconsistency, sequence incompatibility, and thermodynamic instability.
We therefore additionally examined threshold-based self-consistency and local geometry. At L = 300, 21/100 FlexFlow designs achieve scRMSD ≤ 5 Å, versus 0/100 for FliPS; under the stricter ≤ 2 Å criterion the counts are 8/100 versus 0/100. These results improve long-design self-consistency, although designability remains challenging. FliPS retains better local backbone geometry, so the methods exhibit different structural-quality trade-offs.
In a separate geometry-controlled analysis, reducing λ from 400 toward 200 maintained comparable independent GNM agreement while reducing Cα bond-length distortion and improving geometry-valid yield by approximately 1.5-fold.
We have not performed the free-energy landscape analysis required to distinguish stable, metastable, and transition states. Existing finite-time all-atom MD characterizes flexibility of selected candidates but does not establish thermodynamic-state identity. We will make this limitation explicit.
Comment 3: FlexFormer invariance and FlexFlow equivariance
FlexFormer predicts scalar per-residue RMSF and is designed to be invariant to global rigid-body transformations. Writing backbone coordinates as X, sequence as S, rotation as R ∈ SO(3), and translation as t:
f_FlexFormer(RX + t, S) = f_FlexFormer(X, S).
HierEGT uses equivariant geometric representations to produce invariant scalar predictions; Stage 2 adds ProtT5 sequence features independent of the global coordinate frame.
FlexFlow applies a scalar loss to predicted-clean coordinates:
ℒ(X, ξ*) = −Corr(f_HierEGT(X), ξ*)Because this predictor output and loss are invariant, the coordinate gradient transforms equivariantly:
∇_{RX+t} ℒ = R ∇_X ℒCombined with the equivariant MultiFlow update and its coordinate-centering convention, this preserves the symmetry of the guidance formulation. Guidance changes backbone translations only, leaving the generator's rotational and sequence updates unchanged. We will clarify these mathematical properties in Methods.
We sincerely thank the reviewer again for the valuable suggestions. The new experiments strengthen the rationale for the Pearson objective and clarify the structural and geometric claims, while delineating the limitations of the present method.