- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper presents scCANDI, a hybrid discrete–continuous diffusion framework for generating single-cell gene expression profiles. The method combines discrete diffusion, which better matches the sparse and discrete nature of count data, with continuous updates that jointly refine multiple gene positions and aim to improve sampling efficiency. The framework is evaluated on three single-cell datasets under unconditional and conditional generation settings. Results show that scCANDI provides a trade-off between the MMD performance of discrete diffusion and the Wasserstein-distance performance of continuous diffusion, while requiring substantially fewer function evaluations than the discrete baseline.
Critical strengths
A main strength is the paper’s clear motivation for combining discrete and continuous diffusion. The authors identify complementary properties of the two approaches and provide an empirical analysis showing that they behave differently under MMD and Wasserstein distance. This makes the hybrid design intuitive and provides some insight into why the two diffusion paradigms may be useful in different regimes.
Critical weaknesses
-
The methodological novelty appears limited. scCANDI largely adapts the existing CANDI hybrid discrete–continuous diffusion framework to single-cell gene expression using the representation and setup of DCM. The paper therefore needs to more clearly establish what methodological insight is introduced beyond combining these existing components.
-
The evaluation is insufficient to support the claim of improved single-cell generation. The experiments rely mainly on MMD, Wasserstein distance, and cell-wise mean expression distributions. These results establish a trade-off between discrete and continuous diffusion, but do not demonstrate that the generated cells are biologically more faithful. Important properties such as marker expression, gene–gene relationships, biological programs, cell identity, differential expression, or downstream utility are not evaluated. This is particularly important because one of the main motivations for the continuous component is its ability to jointly model gene relationships, yet this property is not directly tested. The claimed efficiency improvement is also based on the number of function evaluations rather than actual runtime or computational cost.
-
There is a noticeable mismatch between the scope suggested by the figures and the experiments actually presented. Figure 1 explicitly presents trajectory inference, gene regulatory network inference, and perturbation-effect analysis as downstream applications of the generated cells, yet none of these tasks is evaluated in the paper. The empirical study instead remains almost entirely at the level of generic distributional metrics. This makes the presentation suggest broader biological utility than is actually demonstrated.
Questions for authors
-
What is the main methodological contribution of scCANDI beyond adapting the existing CANDI hybrid diffusion framework to the single-cell representation and pipeline used by DCM?
-
Can the authors provide biological-fidelity evaluations showing whether scCANDI better preserves properties such as marker expression, gene–gene correlations, biological programs, cell identity, or conditional perturbation effects? Such results would materially affect whether the current improvements in MMD and Wasserstein distance translate into better synthetic cells.
-
The paper reports a 5–10× reduction in function evaluations. Does this correspond to a comparable improvement in wall-clock generation time or total computational cost, especially considering the additional continuous updates and the need to tune temperature and NFE settings?
2 comments
Thank you for the detailed response and additional experiments. I appreciate the new gene–gene correlation analysis, which provides more biologically meaningful evidence, as well as the clarification of the computational efficiency.
However, my main concern regarding novelty remains. The authors acknowledge that the contribution is not methodological, while the additional biological analyses, although useful, do not yet establish a sufficiently strong scientific contribution beyond applying an existing framework to single-cell data. In particular, it remains unclear what new capabilities or insights scCANDI provides compared with existing generative approaches more broadly.
Overall, while the rebuttal has partially addressed my concerns, I am not sufficiently convinced to change my original assessment. I will maintain my score.
Thank you for your comments, we have addressed your concerns in order.
Our contribution is not the methodology, but utilizing scCANDI to better understand what the continuous and discrete updates mean in the context of single-cell generation. CANDI was introduced in a language modeling context, which is quite different from single cell generation. We believe that it is valuable to discuss how we adapted the model for the application and what are some important features, like inspecting the distribution fidelity and temperature tuning.
We will add gene-gene correlations. We have included our current results below with some analysis on what we are observing.
The wall-clock generation is slower for scCANDI compared to DCM. With the same hardware and batch size the ms/NFE is around 163 for scCANDI and 119 for DCM. This is around a 1.4x cost increase. However, since scCANDI requires less NFEs to reach their comparable results, the actual cost of wall-clock generation time is slightly faster. We also wanted to add that the temperature tuning is often straightforward to adapt with slight decreases of 0.1 in either direction will result in a low NFE requirement for good results.
Summary of new results:
Runtime measurements at equal resources: scCANDI 163 ms/nfe, DCM 119 ms/nfe
Gene-gene correlation: For each dataset we compute the gene-gene Pearson correlation matrix (top-200 most variable genes) in real and in generated cells, then report the Pearson correlation between the two matrices across all gene pairs. General correlation pools all cells while cell-type correlation computes the same within each of the largest cell types and averages (3 largest cell types for Dentate Gyrus and pbmc3k, 4 cell types for pbmc_covid). We present the result in order of scCANDI, DCM, real-data.
Dentate Gyrus (conditional 1465 cells)
General: 0.915 ± 0.001, 0.844 ± 0.002, 0.988
Cell-type: 0.242 ± 0.010, 0.002 ± 0.001, 0.778
pbmc3k (conditional 1319 cells)
General: 0.790 ± 0.003, 0.908 ± 0.000, 0.939
Cell-type: 0.073 ± 0.003, 0.001 ± 0.003, 0.272
pbmc_covid (unconditional 5000 cells)
General: 0.902 ± 0.001, 0.011 ± 0.001, 0.962
Cell-type: 0.320 ± 0.024, −0.002 ± 0.003, 0.488
scCANDI preserves cell-type co-expression better than DCM on all three datasets. On the conditional datasets, DCM achieves a higher general correlation, which reflects reproducing each cell type's average expression profile rather than co-expression (it does not exceed a random average of real cells). On the unconditional dataset, scCANDI is higher on both. Cell-type co-expression measures how genes vary together across individual cells of the same type. For example, monocyte cells with a higher S100A8 also express a higher S100A9. scCANDI captures part of this structure because genes are revealed gradually and its continuous updates use the genes already revealed, so later genes are generated consistently with them. DCM reveals nearly all genes at once, so its genes are effectively sampled independently within a cell type. These results are consistent with our motivation of using continuous updates to guide generation based on revealed genes (the discrete anchors).