- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
RELAY does not rely on an LLM. Instead, it performs kernel ridge regression over a knowledge-graph-derived kernel, transferring dense measured responses from related training perturbations to unseen ones to make DE and DIR predictions.
Critical strengths
-
This paper is easy to read and follow
-
The finding is compelling: a simple gene-majority-label prior outperforms all evaluated LLMs and expression-based models on DE prediction.
Critical weaknesses
1.The comparison with existing perturbation-prediction methods is not sufficiently comprehensive. Recent baselines such as CellFlow, PerturbDiff, and scDFM should be included.
2.No code is provided, which limits reproducibility.
3.The gain in global accuracy stems primarily from DIR, whereas on DE, RELAY only marginally outperforms the simple prior. In the compound setting—which is closer to real-world applications—its global metrics actually fall below the prior, with modest within-gene improvements of only ~4.6 points (DE) and ~5.7 points (DIR).
4.Information asymmetry in model inputs: Both the dense responses and effect statistics () used by RELAY are derived from the exact same screen as the DE tests used to generate the ground-truth labels. Specifically, the standardized effect serves as a continuous proxy for the discrete DE label. By contrast, the LLM baselines only have access to roughly 1% of the discrete labels. Consequently, the supervision signal available to RELAY and the baselines is not comparable, making the comparison unfair.
Questions for authors
see weakness