- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes scPathCF, a perturbation-aware framework for predicting protein abundance from RNA measurements and perturbation identities. The method decomposes protein predictions into a control baseline, an RNA-mediated component, and a perturbation-dependent residual component. Hard branch switches provide operational interventions for examining these contributions. Experiments on three CRISPR–CITE-seq datasets evaluate predictive performance and the biological consistency of the resulting decomposition.
Critical strengths
The paper addresses an important problem: distinguishing RNA-associated and potentially post-transcriptional contributions to protein responses. The explicit separation of prediction pathways offers a potentially useful approach to model interpretability. Evaluation across three datasets, together with component ablations and screening-prior provenance analyses, provides encouraging preliminary evidence. The authors also acknowledge several important limitations of their decomposition.
Critical weaknesses
Weakness 1: The proposed path decomposition lacks sufficient validation, making its central interpretability claim questionable.
a. The decomposition is architectural rather than biologically identifiable. The so-called RNA-mediated branch also receives perturbation-specific information through identity-indexed RNA prototypes, while the residual branch uses perturbation embeddings. Consequently, perturbation-specific effects can potentially be redistributed between the two branches without changing the final prediction. The hard branch interventions demonstrate how the architecture allocates predictions, but do not independently establish genuine RNA-mediated and RNA-independent effects.
b. The biological validation is insufficiently independent. The reported agreement between residual contributions and biological annotations is partly influenced by screening-derived labels and supervision. The paper does not demonstrate that the same path assignments remain stable without these priors or under alternative decompositions. The presented examples establish biological plausibility rather than validating the reliability of the inferred paths.
This is consequential because interpretable path decomposition is the paper's primary contribution. Without stronger evidence that these assignments are meaningful and stable, the method risks providing architecture-dependent explanations rather than reliable biological insights.
Weakness 2: The predictive advantages are not sufficiently convincing, particularly under controlled comparisons and stronger generalization settings.
a. Marginal improvements and unequal prior information. The performance differences against the closest baselines are not statistically significant across all three datasets. More importantly, the Frangieh comparison uses a target-derived full-data screening prior unavailable to the baselines. Removing this prior increases MSE by 0.0195, substantially exceeding the method's original 0.0045 advantage over cTP-net. This raises serious concerns about whether the reported improvement originates from the proposed architecture.
b. Limited evidence of generalization to unseen perturbations. Although the method performs competitively under unseen-guide splits, the more challenging held-out CaRPool three-gene combination reveals a substantial weakness: scPathCF achieves MSE 0.6904, compared with 0.4846 for GEARS. Furthermore, some reported aggregate metrics are influenced by baseline protein-abundance differences rather than perturbation-specific responses.
The results do not yet convincingly establish that the proposed decomposition improves either predictive robustness or perturbation-specific generalization over competitive alternatives.
Questions for authors
Q1. Since perturbation identity enters both the mediated and residual pathways, how can the authors establish that the learned decomposition reflects meaningful RNA-mediated versus residual effects rather than an arbitrary allocation between model branches? Can the authors demonstrate the stability of these assignments under strict-zero priors, prototype ablations, and alternative training configurations?
Q2. Can the authors provide strictly comparable experiments without target-derived screening priors, particularly on Frangieh, and demonstrate that scPathCF retains a meaningful advantage over strong RNA-to-protein baselines? How much of the improvement remains after controlling for differences in prior information?
Q3. How does the method perform under genuinely unseen perturbation identities and combinations, using evaluation metrics focused on perturbation-induced protein changes rather than overall abundance? Can the authors explain the substantial performance gap against GEARS on the held-out CaRPool combination?