- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a unified benchmark and pretrained model for enzymatic reaction prediction. Through a two-stage pretraining process, transferable knowledge regarding enzymatic transformations is acquired and subsequently adapted to real-world benchmark reactions. Experiments show state-of-the-art performance in both forward reaction and retrosynthesis prediction, validating the effectiveness of this method.
Critical strengths
None
Critical weaknesses
Some of the details and experimental analysis should be clarified, which is described in "Questions For Authors".
Questions for authors
-
Why does VenusRX use a T5-style encoder-decoder architecture? What is the necessity for this?
-
The authors claimed "For each reaction, we additionally use R-SMILES augmentation (Zhong et al., 2022)". Did the other baseline methods also use this type of augmentation?
-
I think more details about the construction of Stage 1 corpus are needed. In addition, the differences from existing corpora should be outlined.
-
It's imporant to explain how data leakage during the testing phase will be prevented.
-
In Table 5, for the first two tasks, applying only Stage-1 shows poorer results than only Stage-2. However, the situation becomes opposite for EC prediction task. What is the reason for this? In addition, given the core argument that "Stage-1 provides transferable enzymatic transformation knowledge, while Stage-2 adapts this knowledge to real benchmark reactions", one would expect EC prediction results without Stage-2 to be pretty worse, but the performance gap compared to full model is pretty small.
2 comments
Response to Reviewer 1Lxf (Part 2/2)
Response to Q4:
Thank you for raising this important point. We will add a dedicated description in the paper to clearly summarize our test-set isolation procedure:
-
For data splitting, the three splits group samples using canonical reactant combinations, principal products, or complete level-4 EC numbers as keys. Samples sharing overlapping keys are grouped into connected components and assigned as a whole to the training, validation, or test set. This guarantees that there are no overlapping keys across the training, validation, and test partitions.
-
For Stage-1 pretraining, the corpus for each split is filtered independently: (a) synthetic reactions are generated using templates extracted from the corresponding training set, and (b) any generated reactions whose structures match validation or test reactions are removed from the Stage-1 corpus.
-
For Stage-2 training, each split only continues training on its own training partition. For EC nearest-neighbor retrieval, the reference database consists solely of training reactions, and the number of neighbors k is selected on the validation set.
We will also clearly state the information used in each evaluation setting alongside the result tables: MLCD is evaluated using a benchmark-wide molecule vocabulary that includes test molecules, and round-trip evaluation is an auxiliary diagnostic computed with a forward oracle trained on the complete benchmark.
Response to Q5:
We believe this pattern occurs because Stage-1 and Stage-2 pretraining emphasize different capabilities. Stage-1 uses a very large set of synthetic reactions; while the exact substrate-product structures and combinations may not always match real benchmark distributions, the underlying reaction rules are broadly accurate. This makes Stage-1 particularly effective for learning global representations of enzymatic reactions. In contrast, Stage-2 trains directly on real benchmark reactions, which are smaller in scale but have exact molecular structures and combinations, making Stage-2 much more important for improving token-level generation accuracy.
Therefore, for EC prediction, which relies heavily on global reaction representations, Stage-1 pretraining plays the primary role and the gap without Stage-2 is small. For forward prediction and retrosynthesis, which require accurate token-by-token generation, Stage-2 adaptation is more critical. We will include this explanation in the revised manuscript.
We thank the reviewer again for the constructive comments, which helped us improve the clarity of our paper.
Response to Reviewer 1Lxf (Part 1/2)
We thank Reviewer 1Lxf for the thoughtful review and helpful questions. Below, we address each of your points in detail.
Response to Q1:
A T5-style encoder-decoder architecture is well suited for unifying multiple input-to-output tasks such as forward prediction and retrosynthesis. At the same time, EC-number prediction requires a strong reaction representation model. An encoder-decoder architecture naturally supports both sequence-to-sequence generation and representation learning within a single model, which is difficult to achieve with encoder-only (e.g., BERT), decoder-only (e.g., GPT), or diffusion-based architectures. We have updated the main text to make this motivation clearer.
Response to Q2:
Whether a baseline uses R-SMILES augmentation depends on the design of the original method. Specifically, RSGPT and R-SMILES both use R-SMILES augmentation, following their official implementations.
Response to Q3:
Thank you for the suggestion. We have expanded Section 3.2 in the revised manuscript to provide more details on the data sources, filtering criteria, and reaction generation pipeline for the Stage-1 corpus. Specifically, for each split of VenusRX-Bench, we extract local reaction templates from the atom-mapped enzymatic reactions in the corresponding training set, and decompose molecules from AtlasX BioDB, KEGG, and COCONUT using BRICS to build a candidate substrate fragment pool. We then apply the templates to compatible fragment combinations to generate candidate reactions, followed by standardization, deduplication, structural validity filtering (via RDKit), and thermodynamic filtering (via eQuilibrator). This pipeline produces 4.04M, 4.05M, and 3.85M full training reactions for the reactant split, product split, and EC split, respectively.
Compared with existing corpora, our Stage-1 synthetic corpus differs in two main ways:
(a) Compared with USPTO-FULL, which is widely used for chemical reaction pretraining:
(b) Compared with the existing enzymatic reaction datasets listed in Table 1, our synthetic corpus is substantially larger in scale than all of them.