- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
CHARM-Flow predicts post-perturbation gene expression distributions using a population–state–cell hierarchy. It combines mean response prediction, conditional flow matching, and persistent access to source-cell references to model perturbation responses and cell-to-cell variation. Experiments on Replogle, PBMC, and Tahoe cover genetic perturbations, cytokine stimulation, and drug treatments, with the clearest improvements over baselines observed on Replogle.
Critical strengths
-
The population–state–cell hierarchy provides a reasonable way to combine population-level response patterns with within-population cellular variation. Retaining source-cell references during generation is a useful design choice for modeling heterogeneous responses.
-
Experiments on Replogle show improvements over multiple baselines in mean-response and differential-expression prediction. Ablations also provide evidence that the state hierarchy and persistent source-cell access contribute to performance.
Critical weaknesses
-
The biological significance and robustness of the inferred states remain unclear. The state partition affects both state summaries and source-cell sampling, but the paper provides limited evidence that these states correspond to meaningful biological differences. The sensitivity of the results to the number of states or the clustering method is also unclear.
-
The evidence for improved modeling of cellular heterogeneity is limited. Much of the main evaluation focuses on mean-response metrics, while distributional and dispersion analyses are concentrated on Replogle and model ablations. Comparisons with existing generative baselines across PBMC and Tahoe are needed to establish whether CHARM-Flow consistently captures cell-to-cell variation more accurately.
Questions for authors
-
Could the authors characterize representative states using marker genes, pathway activity, or available cell-state annotations? How sensitive are the results to the number of states (K) and the choice of clustering method?
-
Could the authors extend distributional and dispersion evaluations to PBMC or Tahoe and compare against a representative generative baseline under the same protocol? This would help establish whether the model's advantage extends beyond mean-response prediction.
3 comments
I thank the authors for their work. The rebuttal adds helpful new results and addresses some of my concerns. Still, open questions persist. The biological validity and robustness of these inferred states are not fully settled, and the sensitivity analysis remains limited. Though the new experiments strengthen the empirical support, my core doubts about state construction and interpretation are unresolved.
Follow-up to Reviewer fbaM (Q1/W1): Biological Interpretation of Control States and Sensitivity to K and Clustering Method
Thank you for clarifying your concern. We examined two related questions: what each state represents biologically within a given partition, and how its interpretation changes with the resolution of the partition.
We interpret each state based on the expression features that distinguish it from other control cells in the same biological background. We identify candidate markers in one half of the control cells and retain those that also show significantly higher expression in the same state relative to the other controls in the validation half. We interpret these markers alongside established gene-program scores, as illustrated in Appendix E.7 and Figure 3.
Replogle. In HepG2, state 3 shows elevated expression of MCM10, CDC6, and GINS2, together with higher S-phase and E2F scores, consistent with DNA replication. State 0 shows elevated expression of CCNB1, CDC20, and PLK1, along with a higher G2/M score, consistent with mitosis. Both states show proliferation-associated expression, with state 3 emphasizing DNA replication and state 0 emphasizing mitosis.
PBMC. Among CD4 memory T cells from Donor 1, state 61 shows elevated expression of IFIT2, IFIT3, and GBP1, together with higher interferon-α and interferon-γ response scores. State 0 from the same donor and cell type exhibits prominent mTORC1- and IL-2/STAT5-associated expression. These states capture distinct basal immune expression programs within the same annotated cell type.
Tahoe. Among DMSO-treated NCI-H460 control cells, state 0 shows elevated expression of GADD45A, MDM2, and CXCL8, together with prominent p53 and TNF/NF-κB signatures, consistent with a stress-associated profile. State 2 shows elevated expression of EXO1 and NEIL3, along with prominent E2F, S-phase, and G2/M signatures, consistent with a replication-associated profile. Both patterns remain detectable when using only genes excluded from the clustering panel.
To quantify marker support beyond these examples, we counted testable states with at least one gene outside the clustering panel whose expression was higher than in the remaining controls from the same background (adjusted q < 0.05 in both the discovery and validation halves). This criterion was satisfied by 468 of 512 states in Replogle (91.4%), 1,946 of 2,585 states across the four PBMC evaluation donors (75.3%), and 5,947 of 6,204 states in Tahoe (95.9%).
Effect of K on biological interpretation. To examine how clustering resolution affects the interpretation of cell states, we tracked the same HepG2 cells across different resolutions. With a maximum of 64 states, state 20 contained 93 control cells. When the maximum was increased to 128 states, these same cells were divided into two groups of 67 and 26 cells. Both groups retained elevated TOP2A expression and prominent E2F and G2/M signatures, preserving the proliferation-associated interpretation of the original state. However, the finer partition revealed differences in the strength of these shared expression signatures: the two groups had mean G2/M scores of 0.547 and 0.650, and mean E2F scores of 0.471 and 0.567, respectively.
We further assessed whether the biological interpretations remained consistent across different partitions. Using only genes excluded from clustering, we estimated each state's mean gene-program score from one half of the HepG2 control cells and evaluated its agreement with the measured scores of the same 2,515 validation cells. Across state limits of 64, 128, and 192, Pearson correlations ranged from 0.810 to 0.816 for E2F and from 0.674 to 0.679 for G2/M. At K = 128, recursive and flat k-means produced substantially different cell assignments (adjusted Rand index = 0.211), yet both achieved a correlation of 0.816 with measured E2F scores, while their correlations for G2/M were 0.675 and 0.687, respectively.
Together, these results indicate that the proliferation-associated expression patterns in HepG2 remain detectable across the clustering resolutions and methods evaluated, even when the exact cell assignments differ. The 93-cell example shows what finer resolution adds: both subgroups retain the proliferation-associated profile of the parent state, while their measured E2F and G2/M expression scores reveal a difference in the strength of that shared signature.
Response to Reviewer fbaM (Q1–Q2; W1-W2): State Interpretation, Clustering Sensitivity, and Distributional Evaluation
Q1 and W1: Biological interpretation of states and sensitivity to K and clustering
Our design is motivated by making fuller use of the initial expression state of individual cells. When evaluation primarily relies on population means, heterogeneous perturbation outcomes are averaged together, and the diversity of initial cellular expression is difficult to assess. Through the population–state–cell hierarchy, we jointly use population context, initial transcriptional states, and individual-cell expression to preserve response differences associated with distinct initial cellular backgrounds during generation.
To characterize these initial states, we identified marker genes through state-versus-rest differential-expression analysis within each biological background. Candidate markers were discovered in one half of the control cells and validated in the other half, requiring a consistent direction of expression difference and an adjusted q<0.05. The methods and results are provided in Appendix E.7 and Figure 3. Representative states exhibit interpretable biological features: ASPM, CCNB1, CDC20, and PLK1 mark proliferation-associated programs in HepG2; IFIT2, IFIT3, GBP1, and HLA-B characterize interferon-associated programs in PBMC Donor1 CD4-memory cells; and distinct states in Tahoe NCI-H460 exhibit stress-associated and replication/proliferation-associated features.
On Replogle, under the minimum-support constraint of 20 control cells per state, we compared K=64, 128, and 192, together with flat k-means at K=128. Their PDCorr values are 0.478, 0.477, 0.477, and 0.478, respectively, and the ranges of all three centered distribution metrics differ by less than 1%. Actual control members and within-state variation remain available throughout the model. K therefore controls the granularity with which initial-state information is organized, and further subdivision has little effect on overall prediction once sufficient resolution is reached.
The value of covering multiple source states is also illustrated by an inference comparison using the same trained model. For PPP6C perturbation in HepG2, sampling from multiple states according to the learned weights reduces NCED, CMMD, and NCSW1 by 66.2%, 41.9%, and 40.7%, respectively, compared with restricting sampling to a single state, while keeping mean prediction unchanged. Further subdivision provides finer biological interpretation. For example, under ZDHHC7 perturbation, a state at K=64 splits into two subgroups at K=128, with predicted G2M-program means of 0.171 and 0.334. We use 128 as a balance between state resolution and sample support per state.
The current data do not provide paired observations of the same cell before and after perturbation. Our evidence therefore supports improved prediction at the population-distribution level; it does not establish recovery of each individual cell's true perturbation outcome. An important next step is to combine the model with wet-lab measurements linking initial cellular states to post-perturbation outcomes, enabling more direct evaluation of cell-level response prediction.
Q2 and W2: Distributional and dispersion comparisons on PBMC and Tahoe
We have extended the distributional evaluation to PBMC and Tahoe and added comparisons with PerturbDiff across all three datasets using the same evaluation protocol within each dataset (Appendix E.8, Table 22). CHARM-Flow achieves lower centered distribution errors in NCED, CMMD, and NCSW1 on all three datasets, with NCED reduced by 45.5%, 90.9%, and 83.0% on Replogle, PBMC, and Tahoe, respectively. These comparisons support more accurate recovery of within-population cellular variation beyond the population mean response across the three datasets.