- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
CoShare predicts single-cell responses to unseen genetic perturbations by splitting the response (relative to the control mean) into: (i) a mean shift, modeled as a weighted sum of M shared basis vectors (initialized by PCA), and (ii) a residual distribution generated by x-prediction flow matching. A router driven by a five-view gene graph encoder (STRING, GO-BP/MF/CC, LLM embeddings) sets both the basis weights and the mixing of low-rank adapters in the generator. CoShare beats nine baselines on Adamson, Norman and Replogle across RMSE, energy distance and Cell-Eval metrics, with ablations on Norman and a coefficient-swap analysis on Adamson.
Critical strengths
-
Consistent gains across datasets and metric types... The Replogle PDS_cos result (0.77 vs 0.59) is the most convincing; however, PDS is also the least biologically grounded metric, and can be often gamed and hill climbed on.
-
Regressing the pseudobulk mean directly and generating only residuals is a sensible design; however, prior publications like Rahister from Tahoe and PIE from Arc Institute implement this as well.
Critical weaknesses
- Gains are not attributable to component reuse: simple baselines are missing and baselines get less prior information.
The mean branch (b0 = average training response, B = top PCs of training responses) is essentially the linear baseline of Ahlmann-Eltze et al. (Nat. Methods 2025), which matched or beat deep models on these datasets. Other baselines like mean, linear, graph-neighbor, additive (Norman 0/2) and, for Replogle, copy-same-perturbation-in-other-cell-lines baselines are all absent.
The consequence: on Adamson, every method has PDS_cos of 0.52 to 0.65 (chance about 0.5) while CoShare's PDCorr is 0.87... this is a pattern that Systema attributes to predicting systematic variation. Also concerning is that PerturbDiff represents targets by averaging learned embeddings, which carry no information for genes never perturbed in training; PerturbDiff is nonetheless the best baseline on Norman 2/2, suggesting a largely perturbation-agnostic predictor is competitive there, while CoShare alone gets graph and LLM priors for unseen genes. The plain "Base FM" (E-dist 0.68) already matches the best baseline... also some baselines look mis-adapted (GraphVCI RMSE 0.512 on Replogle).
- Rigor and mechanism claims are under-supported... single split, single run, no uncertainty; several margins are small. No validation set or selection procedure is described for CoShare. The ablations do not say what replaces each removed component or whether capacity is matched, and there is no shared- vs independent-router comparison.
Questions for authors
-
Please add more baselines: mean, linear (same prior features), graph-neighbor averaging, additive (Norman 0/2) and, for Replogle, same-perturbation-from-other-lines baselines, and report metrics on perturbation-specific deltas. For distributional metrics, how does CoShare's predicted mean plus centered control cells (or pooled centered training residuals) compare with the generated residuals?
-
Please report mean + sd over multiple splits/seeds, the size of each Norman group, and held-out singles separately.
-
How were hyperparameters and checkpoints selected, and how were baselines tuned? What represents a never-seen target in each baseline?
-
What replaces the graph in "w/o Graph" and the factorization in "w/o Factorization"? Does a capacity-matched model with independent mean/residual routers do worse, and does swapping only the residual adapters degrade distributional metrics?
-
What fraction of held-out HepG2 targets are perturbed in K562/RPE1/Jurkat, and how do results differ for those vs. globally unseen targets?
-
How was the LLM graph built (prompt, inputs)? What happens with it removed, with each view alone, and with a degree-preserving shuffled graph?
-
How many cells were generated and observed per perturbation? The V-statistic in Eq. 17 is biased by sample size, so a real-vs-real floor would help. Do generated residuals have approximately zero mean?