- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This study introduces CellKAFC, a framework for predicting single-cell gene-expression responses to unseen genetic and drug perturbations. It combines biological prior information with conditional flow matching in a low-dimensional effect space, then applies kernel-based residual correction to adjust the predicted population mean. Its main contribution is to separate cell-dependent response modeling from condition-level mean correction, supported by an analysis of prediction errors within and outside the flow model’s update space. The authors evaluate the framework on Norman, RPE1, and ComboSciPlex, covering single and combinatorial perturbations. They report improved mean-expression prediction accuracy over established baselines and provide component ablations, error-decomposition analyses, and selected biological case studies to examine the sources of these improvements.
Critical strengths
The method addresses a concrete limitation of low-dimensional prediction. A fixed decoder prevents the flow model from recovering expression changes outside its update space. CellKAFC introduces a separate correction in gene-expression space to address this limitation, providing a clear rationale for the design.
The correction mechanism is supported by an interpretable quantitative analysis. The orthogonal error decomposition and projected-correction comparison distinguish improvements within and outside the decoder space. This analysis helps explain where the gains come from and shows that the additional correction directions contribute to prediction accuracy.
The reported performance is competitive across multiple perturbation settings. The evaluation covers three public datasets, genetic and chemical interventions, and single and combinatorial perturbations. CellKAFC achieves the best results on all six reported metrics for Norman Additive and five of six for RPE1, supporting its practical value for mean-expression prediction.
The matched ablations provide evidence for the contributions of individual components. On RPE1, the authors compare variants under the same split, training budget, and three training seeds, refitting the residual correction for each applicable variant. These comparisons support incremental benefits from the biological priors and flow model while identifying residual correction as the largest source of improvement.
Critical weaknesses
-
The reported benchmarks were used to select model configurations, limiting the evidence for generalization. The authors explicitly acknowledge selecting model configurations using the reported benchmarks (p. 9, lines 476–479). They also chose RPE1 for the main ablation study after inspecting the benchmark results, where the adopted configuration ranked best on five of six metrics (p. 18, lines 958–965). Because these results informed the selection of the reported configurations, they do not provide an independent assessment of generalization. The disclosure is welcome, but the claimed advantage needs to be evaluated on untouched data after the configurations and selection rules have been fixed.
-
The main evaluation does not adequately assess differences between individual cells. All six main metrics use condition-level mean expression (p. 6, lines 284–291). These metrics only assess the average response. They cannot tell whether the model captures how responses differ from cell to cell. This matters because residual correction, which produces the largest reported gains, shifts every predicted cell by the same amount and leaves the differences between cells unchanged (p. 5, lines 243–248). Appendix E provides some additional distributional tests, but these do not cover all final model configurations and mainly compare the authors’ own Flow and Direct variants (p. 20, lines 1030–1040). The reported results therefore support more accurate average responses, while evidence that the final models capture cellular variation better than strong external baselines remains limited.
Questions for authors
Clarification on model selection: Which model choices were made after inspecting the reported benchmark results? Were any test results kept separate from all configuration-selection decisions? If so, please identify them, as they would provide independent evidence for the claimed generalization advantage.
Evidence for capturing cellular variation: Do the final model configurations capture differences between cells better than the strongest external baselines? Please provide any available comparisons that assess cellular variation separately from average expression. Appendix E mainly compares Flow and Direct and does not cover all final configurations, so it does not fully answer this question.