- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes GenFish, a framework for reverse target fishing: given a small molecule, identify the protein targets that could potentially bind it. This work avoids using false-negative pairs, which may affect retrieval learning in common contrastive learning. Additionally, this paper introduces a dataset, ProTargetBench, to support this task. This paper conducts comprehensive experiments to prove the effectiveness of GenFish.
Critical strengths
-
This paper focuses on a meaningful research topic. Reverse target fishing is relevant to drug discovery, and the issue of incomplete bioactivity labels and false-negative pairs is worth investigating.
-
This paper introduces a dataset related to this task. ProTargetBench integrates multiple bioactivity databases and distinguishes measured negatives from unmeasured pairs, providing a useful setting for evaluating proteome-scale retrieval.
-
GenFish achieves the best average performance across the retrieval metrics, particularly R@50. The authors also investigate false-negative competition, molecular similarity, and the biological relevance of semantic IDs.
Critical weaknesses
-
The overall novelty contribution is limited. The core framework of GenFish is quite similar to TIGER (Recommender Systems with Generative Retrieval, NeurIPS 2023). Both use pretrained representations, residual quantization to construct semantic IDs, an additional token to resolve ID collisions, and ID prediction for retrieval. GenFish mainly adapts this framework to molecule-to-protein retrieval. Although it introduces a molecule-conditioned interaction module, the methodological novelty is still limited, and the contribution is not clearly validated through ablation studies.
-
In Table 1, even the simple weighted k-NN almost outperforms all deep learning baselines, and some of these DL methods such as DrugCLIP are well-known. It is noted that these baselines have been substantially modified from their original implementations, this raises concerns about whether they are properly adapted and optimized, and whether the comparisons are convincing.
-
Some improvements are marginal. In Table 1, GenFish only slightly improves R@10 over k-NN (35.27% vs. 34.83%). In Table 2, its Overall AP is only marginally better than LigUnity (58.58% vs. 57.75%), while its Enzyme AP is slightly worse (81.22% vs. 81.97%). Overall, the gains appear limited in many cases.
-
In Figure 4, Oracle Masking only improves the standard contrastive R@50 from 31.30% to 33.40%, while GenFish achieves 50.59%. Although this confirms that false-negative competition affects contrastive learning, it does not adequately explain the much larger improvement from GenFish. The connection between the proposed motivation and the performance gains remains unclear.
-
The writing and presentation need substantial improvement. Some figures are too small to read. There are also noticeable typos and formatting inconsistencies in many figures and the main text. The related work discussion is also quite limited, with relatively few references.
Questions for authors
See weaknesses 2, 3, 4, more experiments or stronger justification are needed.