- Rating
- 4
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
EnzyShell is a framework for generating enzyme backbones conditioned on catalytic motifs and substrates. The main idea is to explicitly model the local structure env around the catalytic motif and substract (functional shell), and to guide full-backbone generation. The framework consists of two conditional flow models. The motif-conditioned model generates backbone predictions from the catalytic motif and substrate, while the shell-conditioned model uses the functional shall and substrate as conditions. During inference, the functional shell is dynamically extracted from the motif-conditioned model's intermediate predictions. The vector fields from both models are then combined to update a shared sampling trajectory.
Critical strengths
- EnzyShell is well motivated because residues surrounding catalytic sites can influence substrate recognition, active-site geometry, and catalysis. Representing this local environment explicitly as a functional shell is a reasonable design choice. I also appreciate that the shell includes residues near both the substrate and the catalytic motif, rather than defining the entire environment using substrate proximity alone.
- The method provides a clear way to connect local structural prediction with global backbone generation. In particular, dynamically constructing the shell from intermediate backbone predictions avoids requiring a predefined pocket structure at inference time. The combination of two conditional vector fields along a shared trajectory is also straightforward to implement within flow-matching models.
Critical weaknesses
-
My main concern is whether the improvements can be attributed specifically to the proposed dynamic shell mechanism, rather than to the stronger underlying models, additional training objectives, or the combination of two networks. In Table 2, the motif-conditioned model alone already achieves a designability score of 0.689, which is substantially higher than the strongest external baseline (0.517). Dynamic shell guidance improves this score to 0.752, but the improvement over sequential two-model sampling is relatively small, from 0.726 to 0.752. Furthermore, Table 3 shows that using only the shell-conditioned vector field (), while still dynamically constructing the shell using the motif-conditioned model, already achieves 0.736. Combining the two vector fields increases this to 0.752. These results suggest that the different components contribute to performance, but their individual effects are not clearly separated. In particular, both models are trained with shell-weighted flow-matching losses and additional geometric supervision (Eqs. 9–13). Therefore, even the motif-conditioned model benefits from shell-specific training objectives.
-
During training, the shell-conditioned model receives shells extracted from native structures. During inference, however, the shell is extracted from predictions of the motif-conditioned model. The authors address this mismatch by adding Gaussian noise to the shell coordinates during training. However, coordinate perturbation does not necessarily capture all the errors in predicted shells. In particular, the predicted shell may include incorrect residues or miss residues that belong to the native functional environment. The hard distance thresholds can also cause shell membership to change abruptly as the predicted backbone evolves. Additionally, at later sampling steps, the motif coordinates in the shell are taken from the motif-conditioned model's predictions instead of the prescribed motif coordinates. So I wonder how reliably the method preserves the original catalytic constraints during sampling.
Questions for authors
- How much of the improvement comes specifically from dynamic shell construction?
- How accurate and stable are the dynamically predicted functional shells?
- How reliably the method preserves the original catalytic constraints during sampling?
- How reliable are the functional improvements across targets?
4 comments
Official Comment by Authors
Weakness 2 & Questions 2–3: Shell Prediction Reliability and Catalytic Constraint Preservation
We agree with the reviewer's observation that Gaussian coordinate perturbation does not explicitly simulate shell membership errors. To address these concerns, we have conducted additional analyses of coordinate augmentation, shell membership accuracy and stability, and catalytic motif preservation.
1. Effect of Gaussian coordinate perturbation (W2)
We trained shell-conditioned models with different levels of Gaussian coordinate perturbation during training, while keeping the motif-conditioned model and all other experimental settings fixed.
As shown in the table below, moderate coordinate perturbation improves generation performance under dynamic shell-guided sampling. We have included this ablation in Appendix C.1(new Table 5) of the revised manuscript.
| (Å) | Designability ↑ | Motif RMSD (Å) ↓ | # Succ. Clusters ↑ |
|---|---|---|---|
| 0.0 | 0.728 | 1.94 | 167 |
| 0.1 | 0.737 | 1.90 | 169 |
| 0.5 (default) | 0.752 | 1.82 | 171 |
| 1.0 | 0.744 | 1.87 | 163 |
2. Shell membership accuracy and stability (Q2)
We evaluated predicted shell membership against reference shells constructed from native enzyme structures using residue-index-based precision, recall, and intersection-over-union (IoU), excluding prescribed motif residues. Stability was measured using adjacent-step Jaccard similarity. We further evaluated geometric evolution by computing the RMSD between the motif model's clean predictions and the final generated backbone on fixed final-shell residue indices after motif-only alignment.
As shown in the table below, the predicted shells achieve high reference-shell agreement and rapidly stabilize across adjacent sampling steps, while dynamic shell construction continues to update geometric conditioning throughout sampling. We have included this analysis and the corresponding metric curves across sampling steps in Appendix C.3 (new Figure 3) of the revised manuscript.
| Step | Reference-shell IoU ↑ | Adjacent-step Jaccard ↑ | Shell RMSD to final backbone (Å) ↓ |
|---|---|---|---|
| 2 | 0.705 | - | 2.712 |
| 3 | 0.760 | 0.805 | 2.152 |
| 5 | 0.794 | 0.923 | 1.818 |
| 10 | 0.802 | 0.965 | 1.590 |
| 50 | 0.812 | 0.972 | 1.091 |
| 200 | 0.810 | 0.987 | 0.575 |
| 300 | 0.808 | 0.981 | 0.368 |
(The adjacent-step Jaccard at step 2 is omitted because the preceding shell contains only the prescribed motif, corresponding to an empty non-motif shell.)
3. Catalytic constraint preservation (W2, Q3)
We evaluated motif RMSD relative to the prescribed motif after motif-only Kabsch alignment, using both the sampling state and the motif model's predicted clean coordinates , which are used for dynamic shell construction.
As shown in the table below, the motif model's clean predictions preserve the prescribed catalytic motif geometry throughout sampling, while the fused sampling state progressively recovers this geometry. We have included this analysis and the corresponding motif RMSD curves in Appendix C.4 (new Figure 4) of the revised manuscript.
| Step | Motif RMSD (Å) | Motif RMSD (Å) |
|---|---|---|
| 10 | 17.32 | 0.14 |
| 50 | 11.01 | 0.12 |
| 100 | 6.07 | 0.08 |
| 200 | 1.80 | 0.05 |
| 250 | 0.93 | 0.08 |
| 300 | 0.48 | 0.09 |
| 400 | 0.10 | 0.10 |
Question 4: Reliability of Functional Improvements Across Targets
To address this question, we have conducted a paired target-level comparison between EnzyShell and RFdiffusion3 across all test targets.
As shown in the table below, computational functional performance varies across targets and metrics. We have included this analysis, the paired comparison table, and complete per-target comparisons across all five methods in Appendix C.5 (new Table 7, new Figures 5–7) of the revised manuscript.
| Metric | Win | Tie | Loss |
|---|---|---|---|
| CLEAN-predicted EC match rate | 66 (34.7%) | 93 (48.9%) | 31 (16.3%) |
| UniKP-predicted | 97 (51.1%) | – | 93 (48.9%) |
| Gnina docking score | 73 (38.4%) | – | 117 (61.6%) |
(Wins and losses indicate better and worse performance relative to RFdiffusion3, respectively.)
Thanks the authors for the rebuttal and additional experiments. I have no other issues and I'll maintain my positive scores.
Official Comment by Authors
Once again, we appreciate the reviewer's insightful and constructive comments, which have significantly enhanced the quality of our manuscript.
Official Comment by Authors
We thank the reviewer for the constructive feedback and suggestions. We have conducted additional experiments and analyses to address the reviewer’s concerns regarding component contributions, shell reliability, and functional improvements.
Weakness 1 & Question 1: Contribution of Dynamic Shell Construction and Shell-Specific Training Objectives
To address the reviewer's concern, we have conducted additional experiments to assess the respective contributions of dynamic shell construction and shell-specific training objectives, with newly added experiments marked as [New] below.
1. Dynamic shell construction
First, following the reviewer's suggestion, we added a fixed-shell shared-trajectory baseline using the same trained models and fusion settings as EnzyShell, except that dynamic shell updates were replaced with a fixed shell extracted from a backbone independently generated by the motif-conditioned model (as in fixed-shell sequential sampling).
As shown in the table below, dynamic shell updates improve designability (0.752 vs. 0.722), while also improving motif preservation and the number of successful structural clusters. Without vector-field fusion, dynamic shell-guided sampling also achieves slightly higher designability than fixed-shell sequential sampling.
2. Shell-specific training objectives
Second, we trained an ablated motif-conditioned model without the shell-specific training objectives, including the shell-weighted flow-matching term (Equation 9, Line 247), substrate loss (Equation 11, Line 260), and contact loss (Equation 11, Line 260).
As shown in the table below, removing these losses slightly improves standalone motif-model designability but reduces motif preservation, while leading to lower generation performance under dynamic shell-guided sampling.
We have incorporated the additional experiments into Section 4.3 (Table2, Lines 425–430, 444–445 and 457-463) and Appendix C.2 of the revised manuscript.