- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
EnzyFuse predicts catalytic residues from three views: frozen ESM-2 and MSA Transformer embeddings and an -equivariant structure encoder. An interaction branch combines the three representations on the structure graph. Each branch is directly supervised, and a training-only auxiliary task (catalytic partner retrieval) scores other catalytic residues within 15 Å of an annotated one. On a split controlling both sequence and structural similarity, EnzyFuse reaches an AUPRC of 0.757, compared with 0.701 for the five-model Squidly ensemble and 0.672 for retrained SCREEN; it also outperforms both on the subset with no detected neighbor among catalytic-labeled training proteins. Squidly retains higher F1 and MCC.
Critical strengths
- Careful evaluation: a joint sequence–structure split, a nearest-neighbour copy control showing that sequence-only splits reward annotation transfer (AUPRC 0.845 vs 0.299, App. A), and baselines retrained on the same data with paired statistics.
- Consistent gains, including over SCREEN, which uses comparable inputs (+0.085, Table 3).
Critical weaknesses
- Weak evidence in the low-homology setting. The paper is motivated by prediction when annotated homologs are scarce (L044–046). On the 3,322 enzymes with no detected neighbour, however, removing partner retrieval or the interaction branch lowers AUPRC by only 0.004 and 0.009, without confidence intervals, and the authors note that these comparisons do not establish significance (Table 7, L957–962). The "w/o structure" ablation also removes both components (L418–419), so it does not isolate them.
- The Squidly baseline configuration is underspecified. Appendix C states that Squidly was retrained using its released code but does not report which ESM-2 variant was used. Since the Squidly implementation supports 3B and 15B variants while EnzyFuse uses ESM-2 650M, reporting the variant would clarify the comparison and aid reproducibility.
Questions for authors
- Which ESM-2 size was used when retraining Squidly? How do Squidly and EnzyFuse compare when both are given the same BLAST fallback?
- Table 2 gives paired confidence intervals for these ablations on the full test set. Since the proteins are a subset of it, why are paired intervals unavailable in Table 7, and do the 0.004 and 0.009 differences exclude zero?
2 comments
Thank you for the detailed rebuttal and the additional statistical analyses. These resolve my concerns; I will retain my rating.
Response to Reviewer Yk2p
We thank the reviewer for the specific suggestions on the low-homology analysis and the Squidly configuration. Changes in the revised PDF are marked in blue.
W1 / Q2. Component contributions on the low-homology subset
The h=0 comparisons in the submission were computed from aggregate AUPRC only. We have now computed paired protein-level statistics on the same 3,322 enzymes, as for Table 2, and added the parameter-matched non-spatial control, which isolates spatial message passing while keeping the structure input and partner retrieval:
Removing the interaction branch or its spatial message passing lowers AUPRC significantly on this subset, whereas the effect of removing partner retrieval does not exclude zero. For each variant, however, at least one of the three training runs favors the ablated model, so we describe component contributions on this subset as less certain than on the full test set. Unlike "w/o structure", the first two variants keep the structure input and isolate partner retrieval and spatial message passing, respectively.
The smaller effects are consistent with the smaller contribution of structural input on low-homology enzymes: on the 2,909 h=0 enzymes with all three views, masking the structure at inference lowers AUPRC from 0.680 to 0.669, whereas masking the MSA lowers it to 0.551 (Figure 7). The low-homology claim of the paper rests on the full model, which exceeds the Squidly ensemble by +0.064 ([0.053,0.075]) and SCREEN by +0.116 ([0.106,0.127]) on these enzymes (Table 6). (Table 7 and Appendix E revised.)
W2 / Q1. Squidly configuration and the same BLAST fallback
Squidly was retrained with its default encoder, layer 36 of ESM-2 3B, whereas EnzyFuse uses the frozen 650M model; the advantage is therefore not due to a larger sequence encoder. Table 1 reports Squidly's model predictions without its BLAST-based ensemble.
We applied Squidly's own fallback to both models, with the same search results against the 75,847 catalytic training enzymes. In the released code, the fallback uses DIAMOND blastp (
--ultra-sensitive) and transfers sites from the top hit with Clustal Omega; any hit triggers the transfer. We also tested a 30% identity cutoff and MMseqs2 retrieval:The fallback lowers both models: on the 2,414 enzymes where it applies, the transferred sites reach 0.797 AUPRC, compared with 0.924 for EnzyFuse and 0.893 for the Squidly ensemble. On these enzymes both models receive the same transferred sites, so the remaining difference comes from the 4,390 enzymes without a hit, where each model keeps its own predictions (0.665 vs. 0.596). Against SCREEN, the difference stays between +0.073 and +0.085 under all settings. (Appendix C revised.)