- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
KiMChEE predicts enzyme kinetic parameters using enzyme sequences, main substrates, co-substrates, and assay conditions. It combines adapted pretrained encoders, mutation-aware pooling, and ExtraTrees regression, and evaluates performance on literature-curated external measurements.
Critical strengths
- Separating the main substrate from co-substrates addresses a clear limitation of conventional inputs.
- The collision-focused analysis helps explain where additional reaction context contributes.
- The manually curated external benchmark is valuable, and the paper openly reports remaining prediction failures.
Critical weaknesses
- Sequence overlap and random-split ablations weaken the evidence for novel-enzyme generalization.
- Mutation-aware pooling lacks direct validation, and mutation-direction prediction remains weak.
- Uncertainty estimation and baseline calibration need further checks.
Questions for authors
- The core co-substrate ablation uses a random record-level split, whereas the main claim concerns generalization to new enzymes. Please repeat this ablation with homology-disjoint folds and on the external benchmark, keeping encoder adaptation and ensemble settings matched.
- Mutation-aware pooling lacks a direct ablation, and Table 5 shows no above-chance mutation-direction prediction for or . Please compare Eq. (5) with uniform pooling and examine sensitivity to the mutation weight .
- Record-level bootstrapping may underestimate uncertainty when measurements share an enzyme or source article. Please add enzyme- or article-clustered confidence intervals, particularly for the smaller improvements on and .
- DLTKcat’s PCC of 0.480 alongside an of −2.234 raises a calibration question. Please verify checkpoint-specific units and input conventions, and provide the baseline inference code so this discrepancy can be checked.
- Appendix D shows that 3.8–8.0% of external records contain sequences already present in training. Please report performance by sequence-identity range and on a strictly sequence-disjoint subset to support the claims about uncharacterized enzymes.
Response to Reviewer 26g7
We thank the reviewer for the helpful suggestions on controlled ablations, uncertainty estimation, and baseline evaluation.
W1 & Q1 & Q5. Co-substrate ablation and sequence overlap
Item 2 of our common official comment repeats the co-substrate ablation under identity-clustered folds with matched encoder adaptation and ensemble settings. The channel contributes significantly, most on collided records, and the external benchmark does not distinguish this effect from zero (Table 3, Appendix D). Table F1 reports performance by maximum sequence identity for all three parameters; below 30% identity, KiMChEE ranks first for Km and kcat/Km and ties UniKP for kcat. Excluding the ≥99% identity bin, which removes every record with an identical or near-identical training sequence, the kcat margin over UniKP remains significant (ΔR2=0.138 [0.083, 0.202]), while the Km and kcat/Km margins remain non-significant, as on the full set (Table F2).
W2 & Q2. Uniform-pooling control and sensitivity to α
For the uniform-pooling control described in Item 1 of our common official comment, the table below gives the changes at α=0 relative to α=10 (Table 5).
No interval in the table excludes zero for any of the three parameters, so we do not claim a contribution from up-weighting substituted positions. Item 1 of our common official comment explains how this comparison addresses sensitivity to α and compares sign agreement on matched wild-type and mutant pairs between the two settings.
W3 (uncertainty) & Q3. Enzyme-clustered uncertainty
The co-substrate effect on collided records described in Item 2 of our common official comment remains supported after accounting for shared enzymes (Table 3). For the comparison with baselines, the Km and kcat/Km margins over the second-best model are not significant even with records resampled (Table F2), so we do not claim them under either resampling unit; with enzymes resampled, the kcat margin over UniKP is 0.128 [0.007, 0.247], which still excludes zero.
W3 (baseline calibration) & Q4. Corrected DLTKcat evaluation
DLTKcat's negative R2 came from a temperature-scaling mismatch in our evaluation, and correcting it raises its kcat R2 on the external benchmark from −2.234 to 0.025 (table below). The checkpoint expects temperature and inverse temperature to be min-max scaled with training-data statistics, whereas our original evaluation applied z-score normalization with fixed constants, so the same assay temperature reached the checkpoint on a different scale from its training inputs. We applied the training-data min-max transformation to both channels and reran inference on the full external benchmark. Output units matched the checkpoint, which predicts log10kcat.
The high PCC alongside a strongly negative R2 in the submitted evaluation is consistent with this mismatch, which distorted the scale of the predictions more than their ordering. DLTKcat moves from eighth to fifth in Table 4. The corrected wild-type and mutant results are reported in Table 6, and the Discussion now states that three of seven released predictors fall below zero R2, where the submitted version stated four of seven. The DLTKcat inference code is in the repository described in Item 4 of our common official comment.