- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
DeMixPert predicts single-cell perturbation responses by separating basal-state-dependent effects, perturbation-specific effects, and stochastic population variation. Target-gene embeddings support prediction for held-out perturbations. A conditional Gaussian mixture and an invertible network model the residual variation before the components are combined to reconstruct expression. The evaluation covers four genetic perturbation datasets, five seeds, and differential-expression, distributional, and perturbation-discrimination metrics. Single-gene conditions are held out; combinatorial tests use new combinations of targets seen individually (0/2 unseen). Ablations and mean/additive baselines support the predictive gains, although the biological interpretation of the components is less clear.
Critical strengths
-
The prediction results are convincing on several metrics. Table 1 shows strong differential-expression performance and the lowest energy distance among the listed learned methods on all four datasets. Condition-disjoint splits, validation-based checkpoint selection, and repeated seeds strengthen these comparisons.
-
The evaluation goes beyond mean-expression error. Distributional metrics, perturbation discrimination, retrained ablations, and the Training-mean/Additive baselines in Appendix N give a useful view of both gains and limitations. This breadth matters for a model intended to capture cellular heterogeneity.
Critical weaknesses
-
My main concern is that the Gaussian-mixture contribution has not been isolated. The “w/o GM” ablation removes the mixture, invertible network, and stochastic residual together (PDF p. 18). It shows that the full branch helps, but not that mixtures are preferable to another expressive stochastic model. The K-sensitivity analysis starts at two components, leaving this comparison open.
-
The distributional results do not yet make a clear case for improved population heterogeneity. The energy-distance gains are useful evidence, and evaluating a held-out training metric is reasonable. However, Wasserstein distance in Table 1 does not favor DeMixPert over scGPT. On Norman, the simple Additive predictor also has better Wasserstein distance and PDS (PDF p. 25). Since PDS measures centroid ranking, it does not establish recovery of multimodality or subpopulation proportions. The predictive gains remain credible, but the heterogeneity claim needs more support.
-
The decomposition is easier to justify as a predictive model than as a biological explanation. Held-out representation separability in Appendix L.1 supports perturbation discrimination, but it does not uniquely identify the systematic and perturbation-specific terms. The prototype–residual analysis instead uses training conditions and model-derived residuals (Appendix L.2, PDF pp. 23–24). Independent annotations or constraints would be needed to interpret these components as distinct biological sources of variation.
Questions for authors
-
Is there a matched comparison with a unimodal conditional flow, retaining comparable capacity, losses, and training budget? Simply setting K = 1 would also restrict the prototype-based shift function, so it may not isolate the role of mixtures.
-
Do the existing held-out predictions show better recovery of covariance or independently defined subpopulation proportions? How do the Wasserstein and Additive results affect the intended claim about heterogeneity?
-
What constraints or independent annotations distinguish the learned components from other decompositions with similar prediction error? Do the prototype–residual associations in Appendix L.2 also hold on unseen perturbations?