- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes to combine cross-domain enzyme-reaction contrastive learning, EC-based intra-domain objectives, a GW-inspired regularizer, and an auxiliary EC prediction loss for the task of effective enzyme-reaction screening. The reported gains on ReactZyme can outperform existing methods to some extent.
Critical strengths
The paper proposes to combine cross-domain enzyme-reaction contrastive learning, EC-based intra-domain objectives, a GW-inspired regularizer, and an auxiliary EC prediction loss for the task of effective enzyme-reaction screening. The reported gains on ReactZyme can outperform existing methods to some extent.
Critical weaknesses
The methodological distinction from combining established objectives is insufficiently established, and the EnzymeMap screening evidence is too narrow to support the broad SOTA claim. The detailed comments are as follows:
- The novelty of the proposed method seems limited. The method mainly combines cross-domain contrastive learning, EC-based intra-domain losses, and a GW-inspired regularizer, which are existing techniques more of less and makes the novelty of this paper limited. The authors need to clarify what is new beyond this combination and how the actual objective relates to standard FGW.
- Table 4 (page 9) does not separately isolate the effects of the two intra-domain losses and EC prediction. More detailed ablation studies are suggested.
- The proposed method needs to compare with more methods. Table 1 compares it against CLIPZyme and two variants of that same method. Table 2 includes only CLIPZyme. This is a narrow basis for a general SOTA claim on enzyme virtual screening. Table 2 also shows a lower EF₀.₁ for FGW-CLIP than CLIPZyme (7.61 versus 7.81), which should be discussed rather than described only as comparable performance.
- Preliminaries appropriately introduces OT/GW/FGW, but the link to the implemented objective needs to be clearer. Figure 1 should better explain the GW regularizer, rather than merely display loss names.
- At Table 6(a) (page 19), in terms of Top5, the score of the proposed FGW-CLIP is 0.9746, which is smaller than the score of the comparison method CLIPZyme (UniMol-3D + ESM), namely 0.9478. However, the result of FGW-CLIP (0.9746) is bolded, which is not consistent with the claim that the best results are bolded.
Questions for authors
- The novelty of the proposed method seems limited. The method mainly combines cross-domain contrastive learning, EC-based intra-domain losses, and a GW-inspired regularizer, which are existing techniques more of less and makes the novelty of this paper limited. The authors need to clarify what is new beyond this combination and how the actual objective relates to standard FGW.
- Table 4 (page 9) does not separately isolate the effects of the two intra-domain losses and EC prediction. More detailed ablation studies are suggested.
- The proposed method needs to compare with more methods. Table 1 compares it against CLIPZyme and two variants of that same method. Table 2 includes only CLIPZyme. This is a narrow basis for a general SOTA claim on enzyme virtual screening. Table 2 also shows a lower EF₀.₁ for FGW-CLIP than CLIPZyme (7.61 versus 7.81), which should be discussed rather than described only as comparable performance.
- Preliminaries appropriately introduces OT/GW/FGW, but the link to the implemented objective needs to be clearer. Figure 1 should better explain the GW regularizer, rather than merely display loss names.
- At Table 6(a) (page 19), in terms of Top5, the score of the proposed FGW-CLIP is 0.9746, which is smaller than the score of the comparison method CLIPZyme (UniMol-3D + ESM), namely 0.9478. However, the result of FGW-CLIP (0.9746) is bolded, which is not consistent with the claim that the best results are bolded.