- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper asks whether prediction errors in single-cell perturbation models contain stable structure that transfers across settings. The authors find that different virtual cell models consistently over- or underpredict specific genes. These “error fingerprints” persist across unseen genes, combinatorial perturbations, and drug perturbations, and can help predict which genes and pathways are likely to be mispredicted.
The authors use this observation to develop Gap Transferability Correction (GTC), a simple post-hoc method that uses error patterns observed during training to adjust predictions for unseen perturbations without retraining the original model. The main contribution is to characterize prediction error as a learnable, transferable property of a model and show how it can be used for correction.
Critical strengths
- The paper offers a novel and practically relevant perspective on model evaluation by asking whether systematic, repeatable errors can predict future failure patterns. This question matters in single-cell perturbation studies, where experimental feedback accumulates over time. If errors have stable structure, earlier experimental results can support post-hoc correction without retraining the base model. The paper formalizes this idea through transferable error fingerprints, evaluates their transferability at the gene, pathway, and perturbation-setting levels, and uses them to build a practical correction framework.
Critical weaknesses
1. Related work does not sufficiently cover causal representation learning.
The related-work discussion focuses on single-cell perturbation prediction, reliability analysis, and model fingerprinting, with limited coverage of recent causal and intervention-aware representation learning methods. Approaches such as Discrepancy-VAE [1], sVAE+[2], and PerturbedVAE[3] address closely related questions: modeling perturbation mechanisms in latent space, separating background variation, and improving generalization to unseen or combinatorial perturbations. PerturbedVAE also examines why complex models do not consistently outperform simple linear baselines and how better representations can improve perturbation prediction. Without discussing these connections, the paper’s relationship to existing representation-based perturbation modeling approaches remains unclear.
2. The baseline coverage is somewhat outdated and lacks recent strong models.
Although the paper compares 10 perturbation predictors, most baselines date from 2024 or earlier. Given progress in virtual-cell and perturbation prediction over the past two years, this provides limited support for the broader claim that transferable error fingerprints are a general property of virtual-cell models. The evaluation should include at least one recent strong baseline, such as STATE [4]. The current evidence mainly concerns earlier models, leaving it unclear whether the finding extends to the latest generation of perturbation predictors.
[1] Zhang J, Greenewald K, Squires C, et al. Identifiability guarantees for causal disentanglement from soft interventions[J]. Advances in Neural Information Processing Systems, 2023, 36: 50254-50292.
[2] Lopez R, Tagasovska N, Ra S, et al. Learning causal representations of single cells via sparse mechanism shift modeling[C]//Conference on Causal Learning and Reasoning. PMLR, 2023: 662-691.
[3] Jiang W, Liu Y, Cai Y, et al. What Makes a Representation Good for Single-Cell Perturbation Prediction?[J]. arXiv preprint arXiv:2605.19343, 2026.
[4] Adduri A K, Gautam D, Bevilacqua B, et al. Predicting cellular responses to perturbation across diverse contexts with State[J]. Cell, 2026, 189(19): 5914-5931. e20.
Questions for authors
Q1: Could the authors expand the discussion of causal representation learning methods, including Discrepancy-VAE, sVAE+, and PerturbedVAE? How does GTC differ from methods that explicitly learn perturbation-relevant or mechanism-aware representations in terms of problem setting, objective, and OOD perturbation prediction?
Q2: Could the authors include strong baselines from 2025 and 2026, including at least STATE (Adduri et al., 2026), and test whether error fingerprints persist and GTC remains effective on these newer models?
5 comments
Official Comment by Authors (2/n)
W2 / Q2. Recent baselines and the generality of error fingerprints.
AW2 / AQ2. We appreciate the reviewer's suggestion to include more recent perturbation predictors. We have incorporated STATE [4], PerturbedVAE [3], and Rhaister [5] into our fingerprint and correction evaluations.
Systematic prediction differences persist across these models. Across the eight settings in Figure 2(a), STATE and PerturbedVAE achieve mean real-vs-predicted AUROCs of 0.906 and 0.994, respectively. With all thirteen predictors included, model-attribution balanced accuracy reaches 0.979, substantially exceeding the chance level of 0.077. These results demonstrate that identifiable prediction patterns extend beyond the original model collection.
Historical-error correction also remains effective. Using Global+Local GTC with predicted-response neighborhoods, STATE and PerturbedVAE improve in 9 of 10 evaluation scenarios each, covering genetic, combinatorial, and chemical perturbations. Their improvements are particularly pronounced on unseen perturbations. Rhaister shows smaller correction gains, improving in 4 of 10 scenarios.
The complete results are summarized below. Values denote mean DEG@50 changes in percentage points relative to each base predictor.
| Dataset and evaluation scenario | STATE | PerturbedVAE | Rhaister |
|---|---|---|---|
| Norman2019: held-out cells | +24.09 | +6.03 | −0.03 |
| Norman2019: unseen combinations | +10.47 | +5.81 | −0.05 |
| Replogle K562: unseen gene perturbations | +12.44 | −0.82 | 0.00 |
| SciPlex3: unseen drugs, shared models | +8.37 | +1.37 | +0.14 |
| SciPlex3: unseen drugs, per-cell-line models | +9.61 | +1.26 | −0.05 |
| McFarland2020: unseen cell lines | +2.20 | +1.70 | +0.70 |
| Replogle–Nadig: unseen cell lines | +1.48 | +0.72 | 0.00 |
| Replogle–Nadig: unseen gene perturbations | +19.93 | +15.62 | +0.60 |
| Tahoe-100M: unseen cell lines | −0.43 | +0.24 | −0.18 |
| Tahoe-100M: unseen drugs | +18.86 | +12.42 | +0.10 |
| Scenarios improved / evaluated | 9/10 | 9/10 | 4/10 |
Scores are averaged across cellular contexts within each scenario. Improvements are determined using unrounded values.
Rhaister provides a complementary perspective. Its predictions are constructed from observed experimental summary statistics [5], potentially explaining their lower real-vs-predicted separability and the limited additional gains from GTC.
We also extended the effect-space real-vs-predicted and model-attribution analyses to all six datasets (Figure S2). Together, these results provide broader evidence that systematic prediction differences persist across diverse model architectures and that historical errors can improve predictions from models with different learning objectives.
Revision: We expanded the model descriptions in Section 3.2, incorporated the additional predictors into Figure 2(a) and Tables 1–3, and provided model configurations and detailed performance results in Appendices C and D, together with expanded fingerprint analyses in Appendix G (Figure S2).
References:
[3] Jiang et al. What Makes a Representation Good for Single-Cell Perturbation Prediction? ICML, 2026. https://proceedings.mlr.press/v306/jiang26ad.html
[4] Adduri et al. Predicting Cellular Responses to Perturbation across Diverse Contexts with State. Cell, 2026.
[5] Svensson et al. Back to Basics: Observed Statistics Are Sufficient to Predict Drug Responses. bioRxiv, 2026. https://doi.org/10.64898/2026.06.09.731197
Dear Reviewer 9gaM,
We appreciate your suggestions on causal representation learning and baseline coverage. We expanded Section 2.1 to discuss Discrepancy-VAE, sVAE+, and PerturbedVAE, and incorporated STATE, PerturbedVAE, and Rhaister into our benchmark (Figure 2(a), Tables 1–3). The additional results confirm that distinctive prediction patterns persist, while GTC improves STATE and PerturbedVAE in 9/10 evaluated scenarios each (Appendix D).
We hope these additions address your concerns and would appreciate your consideration of the new evidence in your final assessment. We remain happy to clarify any outstanding questions.
Official Comment by Authors (1/n)
We sincerely thank the reviewer for recognizing the novelty and practical relevance of our work. We particularly appreciate the insightful suggestions on causal representation learning and baseline coverage, which have helped us strengthen the manuscript.
Summary. We expanded the discussion of causal representation learning and incorporated STATE, PerturbedVAE, and Rhaister, increasing the benchmark from ten to thirteen models. The additional experiments demonstrate that systematic prediction differences persist across diverse predictors, while historical-error correction remains effective for STATE and PerturbedVAE across multiple perturbation settings.
W1 / Q1. Relationship to causal representation learning.
AW1 / AQ1. We appreciate the reviewer highlighting these closely related studies. We have expanded Section 2 to discuss Discrepancy-VAE [1], sVAE+ [2], and PerturbedVAE [3], clarifying their relationship to our work.
These approaches investigate perturbation-relevant representations: Discrepancy-VAE studies causal identifiability under interventions, while sVAE+ and PerturbedVAE model perturbation-related changes in latent representations. Their objectives concern learning representations that improve the prediction and generalization of intervention effects.
Our work addresses a complementary question: whether systematic errors remaining in a trained predictor can anticipate future failures and be reused for correction. Rather than modifying the predictor's representations or training objectives, GTC estimates recurring errors from historical predictions and experimental observations, then transfers them to unseen perturbations without retraining the original model.
Thus, representation-learning methods seek to improve OOD prediction through learned perturbation representations, whereas GTC exploits predictable structure in the remaining errors. We further demonstrate their compatibility by applying GTC to PerturbedVAE.
Revision: We expanded Section 2.1 to discuss intervention-aware representation learning and clarify its relationship to our post-hoc error analysis, with the GTC formulation presented in Section 4.1.
References:
[1] Zhang et al. Identifiability Guarantees for Causal Disentanglement from Soft Interventions. NeurIPS, 2023. https://proceedings.neurips.cc/paper_files/paper/2023/hash/9d3a4cdf6f70559e8c6fe02170fba568-Abstract-Conference.html
[2] Lopez et al. Learning Causal Representations of Single Cells via Sparse Mechanism Shift Modeling. CLeaR, 2023. https://proceedings.mlr.press/v213/lopez23a.html
[3] Jiang et al. What Makes a Representation Good for Single-Cell Perturbation Prediction? ICML, 2026. https://proceedings.mlr.press/v306/jiang26ad.html