- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper deals with the task of predicting odorant–receptor responses (binary receptor activation or continuous firing rate change). The baselines use frozen molecular (like ChemBERTa) and protein language model embeddings (like ESM3), optionally with cross-attention to produce an interaction vector, followed by a XGBoost predictor. The authors propose using a two-layer GNN (GraphSAGE) that feeds into the XGBoost predictor.
Critical strengths
- Outperforms comparatively expensive models based on atom-to-residue attention, like LORAX (LoRA fine-tuned ChemBERTa + cross-attention), ProSmith (multimodal transformer, 43.8M parameters), and MolOR
Critical weaknesses
- The novelty is incremental at best
- The gains over a simple, off-the-shelf gradient-boosted tree (XGBoost) using pooled embeddings are neglectable
Questions for authors
- You compared two and one message passing layers, but why not more?
We thank the reviewer for the recognition of OlfaGraph’s competitiveness against more expensive models. We address the concerns below.
W1. The novelty of our work is twofold. First, we show that simple receptor descriptors and even receptor identities can compete with pretrained protein language model embeddings, motivating closer examination of representation choices in computational olfaction. Second, we demonstrate the value of learning receptor representations from their experimentally observed responses, beyond sequence alone. OlfaGraph achieves the best overall mean rank across datasets and evaluation settings, establishing response-informed representation learning as a promising direction for the field.
W2. OlfaGraph achieves the best overall mean rank in Table 1 (2.35 versus 2.96 for XGBoost-base), ranking first or second in five of six settings. Additional experiments demonstrate statistically significant gains under harder cold-molecule evaluation.
On M2OR, a Hladiš-style HDBSCAN cluster-based split reduces the median maximum train–test Tanimoto similarity from 0.59–0.65 to 0.47–0.60, increasing molecular dissimilarity between training and test sets:
Results are means across five partitions. * denotes a significant improvement over XGBoost-base in paired tests (p<0.05).
OlfaGraph improves all four mean metrics, with significant gains in AUROC (p=0.0018) and AUPRC (p=0.0419), demonstrating benefits over pooled embeddings even when test odorants are less similar to training molecules.
Q1. Two layers are the minimum depth needed for receptor–odorant–receptor information exchange; one layer aggregates only directly connected odorant features. To assess whether greater depth helps, we additionally tested three layers on M2OR in the cold-molecule setting:
Across five partitions, the third layer improves none of the four mean metrics, with no statistically significant differences (all paired-test p≥0.160). These results support two layers as a sufficient choice for the proposed information exchange.