- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents ENSEMBLE-IF, a protein sequence design framework that aims to control the equilibrium populations of target conformational states rather than simply designing sequences compatible with one or multiple static structures. The method combines ProteinMPNN with BioEmu in an iterative design loop. At each iteration, it first uses KL projection to reweight conformations according to a specified target population interval. The resulting weights are then used to combine ProteinMPNN logits across the conformational ensemble and generate candidate sequences. BioEmu subsequently predicts the conformational populations of these candidates, and the best-performing sequence is selected for the next iteration. The authors evaluate the method on six target population intervals across three protein domains selected from mdCATH, together with a ubiquitin conformational switching case study. All-atom molecular dynamics simulations are used to assess population shifts and structural integrity.
Critical strengths
-
Extending protein inverse folding from static structural compatibility to controlling equilibrium conformational populations is an interesting and biologically meaningful direction. Existing inverse folding methods largely focus on whether a sequence can adopt a target structure, while many protein functions depend on the relative populations of different conformational states. The problem addressed here is relevant to allosteric regulation and dynamic protein engineering, and I find the proposed design setting worth exploring.
-
The experimental validation goes beyond the usual structure-prediction-based evaluation. The authors systematically identify conformational events from mdCATH trajectories using criteria such as replica consistency, state persistence, and threshold stability. They also perform explicit-solvent all-atom MD simulations to evaluate the resulting designs. This is a meaningful effort, as equilibrium population control cannot be adequately assessed through static structure prediction alone.
Critical weaknesses
-
The connection between the proposed KL projection and actual equilibrium population control is not established. For the binary events considered in this paper, the projection essentially redistributes probability mass between two groups of conformations. After substituting this into the sequence decoding equations, the method reduces to a contrast between the average ProteinMPNN logits of the two states, scaled by the target population difference and a manually chosen guidance strength η. However, ProteinMPNN probabilities are not calibrated against conformational free energies, so reweighting these logits does not establish a quantitative relationship with the equilibrium populations of the generated sequences. The method ultimately relies on repeated BioEmu evaluation and candidate selection to approach the target interval. More importantly, the paper provides no component ablations to isolate the contribution of KL projection, and no analysis of how accurately BioEmu predicts the populations subsequently measured by MD. The current results demonstrate the performance of the overall search pipeline, but do not establish that the proposed projection is responsible for the improvement or that it provides reliable quantitative control over conformational populations.
-
The experimental comparisons are not sufficiently controlled, and the MD results do not convincingly establish reliable equilibrium population control. ENSEMBLE-IF allows unrestricted sequence redesign using full conformational ensembles and multiple rounds of BioEmu feedback, whereas the main Conformational Biasing baseline uses two representative conformations and searches only single-point mutations. Even the additional CB-5 experiment does not match the sequence search space, structural information, or iterative feedback available to ENSEMBLE-IF. The reported performance advantage therefore cannot be attributed to the proposed algorithm itself. The evaluation is also limited to three top-ranked domains selected from 199 filtered domains, with only three of the six target intervals actually reached. For the 2v0cA03 low-population target of 14.40%–20.40%, the final MD occupancy is only 2.33%. Some high-population trajectories remain almost entirely within one state, while other cases show substantial disagreement across MD replicas. These results raise a more fundamental concern about whether the reported occupancies represent converged equilibrium distributions or finite-time trapping in particular conformational states. Given that controlling equilibrium populations is the central objective of the paper, the current validation is insufficient.
Questions for authors
-
How many mutations does each final ENSEMBLE-IF design introduce relative to its native sequence? ENSEMBLE-IF allows unrestricted sequence redesign, while the main CB baseline is limited to a single mutation. How would the results change if both methods were evaluated under matched mutation budgets, BioEmu evaluation counts, and overall search budgets? The CB-5 experiment in the appendix still does not provide a fully matched comparison.
-
For binary conformational events, the KL projection ultimately becomes a state-contrastive logit bias scaled by the target population difference and the guidance parameter η. Given that η must also be adjusted across systems, what is the actual benefit of the KL projection over simpler weighting schemes? How would the method perform with fixed positive/negative state weights, or with BioEmu-based iterative selection alone?
-
How well do the conformational populations predicted by BioEmu agree with those measured by the final all-atom MD simulations? I would like to see a direct comparison of predicted and MD-measured occupancies for all evaluated designs and baseline sequences, including an analysis of systematic prediction errors across proteins and target intervals. Since BioEmu determines which candidates are accepted during optimization, its predictive reliability is essential to the proposed framework.
-
How do the authors establish that the MD trajectories have adequately sampled the equilibrium conformational distributions? Several trajectories show very few apparent state transitions, while others exhibit large differences between replicas. All replicas for a given sequence also originate from the same equilibrated starting structure. I would like to see state transition counts, population convergence across trajectory segments, and simulations initialized from different conformational states. The use of three replicas for ENSEMBLE-IF but four for CB in the ubiquitin experiment also needs an explanation.
-
For the 2v0cA03 low-population target of 14.40%–20.40%, ENSEMBLE-IF achieves only 2.33% occupancy in MD, while its predicted pLDDT drops to 57.17. Why did the BioEmu-based selection procedure fail to identify this design as problematic? Could the authors analyze the discrepancy between its BioEmu prediction and MD outcome, together with the structural quality of the resulting sequence? It would also be useful to examine whether incorporating folding-confidence or sequence constraints could improve the reliability of the design process.
2 comments
Question 3: BioEmu-MD occupancy correlation and prediction reliability.
Regarding prediction reliability, our response to Reviewer kgi4, Weakness 3/Questions 3-4, compares BioEmu and MD for every manuscript design and CB baseline. Across the 12 mdCATH pairs, Pearson correlation is 0.761, and the six Ensemble-IF designs have 4.22 pp mean absolute disagreement, exhibiting high agreement.
Weakness 2/Question 4: MD convergence, state transitions, and starting-structure sensitivity.
Regarding temporal stability and state transitions, the table below compares the two halves of the original 400 ns Ensemble-IF trajectories. Transitions count changes in the binary event between adjacent saved frames.
| Domain | Target band (%) | First 200 ns occupancy (%) | Second 200 ns occupancy (%) | Event transitions per replica, full 400 ns |
|---|---|---|---|---|
| 1divA02 | 31.89-37.89 | 33.67 | 43.33 | 11 / 97 / 56 |
| 1divA02 | 91.89-97.89 | 98.50 | 99.33 | 4 / 6 / 16 |
| 1kwgA03 | 32.56-38.56 | 29.67 | 39.33 | 64 / 53 / 31 |
| 1kwgA03 | 77.56-83.56 | 78.88 | 79.50 | 81 / 79 / 76 / 66 |
| 2v0cA03 | 96.00-100.00 | 97.50 | 97.00 | 20 / 16 / 22 |
| 2v0cA03 | 14.40-20.40 | 2.67 | 2.00 | 22 / 18 / 7 |
High-target 1kwgA03 and 2v0cA03 have similar occupancies in both halves, with repeated event transitions in every replica. The lower targets for 1divA02 and 1kwgA03 show larger shifts. The complementary uncertainty analysis in our response to Reviewer N7W7, Weakness 1/Question 1, gives 107-241 effective samples per replica for high-target 2v0cA03, with nearly identical occupancy intervals using 20 and 50 ns blocks. This design combines persistence near the requested population with repeated transitions and a precise occupancy estimate within the sampled trajectories.
Regarding robustness to MD starts, we provide an ESMFold2 comparison in our response to Reviewer N7W7, Weakness 1/Question 1, using differing predicted structures to initialize MD runs. Ensemble-IF remains closer to the band than CB in 5/6 settings. High-target 2v0cA03 reaches its 96-100% band in all three new replicas; low-target 2v0cA03 favors CB, with both methods outside the band. Keeping the sequences fixed makes this a direct test of initialization sensitivity: the main targeting advantage persists when the starting structures are regenerated.
We also apologize for using 4 replicas for ubiquitin instead of 3; this was an experimental error unchecked by our visualization pipeline. We have updated the manuscript accordingly. Their mean occupancies range from 26.28% to 40.32%, compared with Ensemble-IF's 61.58% and the 64.29-74.29% target. Ensemble-IF remains closer to the target in every comparison with equal replica counts.
Weakness 1/Weakness 2/Question 5: 2v0cA03 low-population target, BioEmu-MD discrepancy, and structural quality.
Regarding the low-target 2v0cA03 design, BioEmu predicted 14.81% occupancy (8/54 conformations), within the 14.40-20.40% band. Selection used population error without a folding-confidence filter, so pLDDT 57.17 did not reject it. BioEmu itself does not have pLDDT or confidence rejection filters. In MD, occupancy is 2.33% despite retaining 83.67% of native contacts. The BioEmu ensemble also shows structural distortion: event-positive conformations retain 37.71% of native contacts, versus 59.68% for event-negative conformations. We see this as evidence that structural integrity is indeed important for ensuring good occupancy performance, but not sufficient per our response to reviewer kgi4 under Weakness 4.
Regarding structural filtering, we applied identical ESMFold2 criteria to the separate high-target 2v0cA03 candidate pools (96-100%): pLDDT ≥ 74.644, native-contact retention ≥ 94.145%, and C$\alpha$ RMSD ≤ 1.522 Å. These thresholds correspond to the native-sequence reference values minus 5 pLDDT points, minus 5 percentage points of contact retention, and plus 1 Å RMSD, respectively. To evaluate the effect in MD, we simulated the three unfiltered sequences and the shared filtered native sequence from one search, using three 200 ns replicas per sequence with a maximum of 3 mutations. The table below gives occupancy with replica/20 ns-block intervals and fold retention.
| Selected endpoint | MD occupancy % [95% CI] | Target-band error (pp) | Native contacts (%) | RMSD (Å) |
|---|---|---|---|---|
| Unfiltered | 33.17 [2.00, 58.34] | 62.83 | 36.66 | 10.61 |
| Unfiltered CB | 20.83 [6.67, 34.67] | 75.17 | 35.32 | 10.60 |
| Unfiltered Ensemble-IF | 95.67 [91.50, 98.33] | 0.33 | 74.44 | 2.99 |
| Quality-filtered native sequence, shared by all methods | 78.83 [72.00, 85.00] | 17.17 | 92.97 | 1.40 |
The unfiltered guided design is closest to the target and retains more native contacts than either unfiltered control, although it lowers native contact % and RMSD. We hypothesize that, after a certain point, structural quality is only a necessary but insufficient condition for adequate event population control.
We thank the reviewer for their feedback and for recognizing the value of population-directed sequence design and MD evaluation. Please see our point-by-point responses below.
Weakness 2/Question 1: η=0 control, mutation counts, and comparisons under matched budgets.
Regarding mutation counts and matched budgets, the manuscript Ensemble-IF designs introduce 25-56 substitutions, compared with one for each CB design; our response to Reviewer kgi4, Weakness/Question 1, lists the counts for every design.
The three-substitution comparison in our response to Reviewer N7W7, Weakness/Question 2, uses the same sampling budgets and gives Ensemble-IF the lowest mean error in 3/3 settings. On 1kwgA03, Ensemble-IF reaches the band in all three searches, compared with none for η=0 and two for CB. The shared mutation ceiling addresses the unrestricted-redesign concern, while η=0 retains the same ensemble-conditioned proposals and screening to isolate the guidance correction. Together, these controls show that guidance contributes to targeting under a common mutation allowance.
Weakness 1/Question 2: KL projection and alternative weighting schemes.
Regarding the role of KL projection, it gives the minimum change in ensemble weights, measured by KL divergence, needed to reach the requested population band. For binary events, it preserves relative weights within each state and changes the two state masses. This produces the state contrast identified by the reviewer,
zˉj(η)=zˉjw+η(uB−u)(zˉj+−zˉj−),
where uB is the closest point in the band to the current population u, and zˉj+ and zˉj− are conditional mean logits. The correction vanishes in band and reverses after crossing it; η sets its strength. This rule directs sequence proposals. Each evaluated candidate receives its own BioEmu ensemble, followed by MD for selected designs.
Regarding fixed weighting, we implemented a fixed-contrast control that holds the signed state-contrast coefficient at its initial adaptive value throughout search. Specifically, at search round t,
=\bar z_{j,t}^{w} +\beta_0\left(\bar z_{j,t}^{+}-\bar z_{j,t}^{-}\right), \qquad \beta_0=\eta\left(u_{B,0}-u_0\right),$$ where $u_0$ is the event population in the initial reference ensemble and $u_{B,0}$ is its closest point in the target band. The ensemble and conditional mean logits are updated as search proceeds, but $\beta_0$ remains fixed. For experiments, we reevaluated all six domain/target settings under unrestricted sequence redesign between $\eta=0$ and fixed contrast. The contrast coefficients were fixed before search using the formula above. We designated the first search seed in each setting and arm for MD before observing outcomes, with three 200 ns replicas per selected sequence and one fresh ESMFold2 structure per sequence. We use 200 ns due to the time intensiveness of running MD given that, for occupancy, most methods' trends stabilized within this time frame. The table below reports the distance of the mean replica occupancy to the target band, in percentage points. Every column uses the first 200 ns of production for fair comparison with the paper-reported numbers (normal Ensemble-IF and CB). |Domain|Target band (%)|$\eta=0$ error (pp)|Fixed-contrast error (pp)|Ensemble-IF error (pp)|CB error (pp)| |---|---|---:|---:|---:|---:| |1divA02|31.89–37.89|60.11|45.78|0.00|26.94| |1divA02|91.89–97.89|1.94|0.11|0.61|0.00| |1kwgA03|32.56–38.56|52.28|5.89|2.89|20.94| |1kwgA03|77.56–83.56|9.78|7.61|0.00|33.89| |2v0cA03|96.00–100.00|0.83|0.00|0.00|93.17| |2v0cA03|14.40–20.40|0.00|26.93|11.73|24.10| Fixed contrast lowers MD target-band error relative to $\eta$=0 in four settings, reducing mean error from 24.60 to 17.24 pp. Because these two controls share the same BioEmu screening budget and unrestricted mutation allowance, this improvement supports the contribution of state-aware proposals beyond screening alone. The full Ensemble-IF pipeline achieves the strongest overall targeting in this comparison. Across those same five settings, its mean band error is 2.92 pp, compared with 17.24 pp for fixed contrast, 24.60 pp for $\eta$=0, and 39.81 pp for CB. Ensemble-IF improves upon fixed contrast in four settings and ties it on high-target 2v0cA03. Thus, fixed contrast provides a useful population-directed proposal mechanism, while the complete Ensemble-IF pipeline delivers substantially better overall targeting in the reported results.