- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes K-PRS, a zero-training kernel-regression framework for cold-start drug-response prediction. The method combines frozen scGPT cell embeddings, frozen ChemBERTa-2/ECFP4 drug representations, a pathway-aware PSD kernel, and a masked residualized Nadaraya-Watson estimator. The authors argue that response-supervised predictors can memorize compound-specific response identities and fail under leave-one-drug-out evaluation, whereas a closed-form retrieval-based estimator avoids this shortcut.
Critical strengths
-
The paper highlights an important cold-start evaluation issue in drug-response prediction. Strict LODO is more realistic for unseen compounds, and K-PRS clearly outperforms the simple cell-mean baseline on GDSCv2.
-
The paper provides extensive diagnostic analysis. Ablations, stress tests, uncertainty analysis, evidence decomposition, and formal verification make the estimator relatively transparent.
Critical weaknesses
-
The methodological novelty is limited. K-PRS mainly combines frozen representations with classical kernel smoothing, pathway gating, residualization, and Nadaraya-Watson regression. The theoretical non-identifiability result is generic and applies equally to K-PRS and trained estimators.
-
The main gains rely heavily on curated pathway annotations. The pathway-only variant already achieves 0.6926 versus 0.7085 for the full model, and performance drops substantially when pathway labels are removed. It is unclear whether such annotations are realistically available for genuinely new compounds.
-
The evidence for the claimed "memorization trap" is not sufficiently comprehensive. The matched trained baselines are limited, and several recent published architectures are not rerun under the same protocol. Therefore, the extremely poor ridge-head result does not establish a general failure of learned drug-response models.
-
The external validation is limited. Experiments are restricted mainly to GDSCv2 and GDSC1, both historical cancer-screening datasets rather than prospective cold-start medicinal-chemistry settings. The authors also acknowledge that these datasets are not independent clinical cohorts.
-
The presentation quality is far from publication quality. Many figures are overly dense, with very small fonts, crowded annotations, and too many panels. In particular, the central pipeline and several key experimental figures are difficult to read at normal page scale, which substantially hurts clarity and accessibility.
Questions for authors
-
For a genuinely unseen compound, how is its pathway or mechanism-of-action label assumed to be known? Could the authors clearly define the deployment information budget and report the primary comparison under a setting in which pathway annotations for all query compounds are unavailable, noisy, or predicted rather than curated?
-
Can the authors evaluate stronger recent drug-response models under exactly the same LODO splits, frozen inputs, and tuning protocol? Without such comparisons, it is difficult to determine whether the observed "memorization trap" is a general problem of learned response models or primarily a failure of the particular trained baselines considered here.
-
What is the methodological gain over a much simpler pathway-restricted nearest-neighbor or Nadaraya-Watson baseline? Since the pathway prior supplies most of the improvement and the final gain from the dual frozen representations is relatively small, a simpler matched retrieval baseline would help isolate the actual contribution of K-PRS.
-
How does the method behave under a stronger notion of novelty, such as scaffold-held-out or mechanism/pathway-held-out compounds? Standard drug-level LODO can still leave chemically or mechanistically close drugs in the reference set, which is particularly favorable to a kernel retrieval method.
-
Could the authors redesign the main figures? In their current form, the small fonts, dense annotations, and large number of panels make the central method and empirical findings difficult to follow.