- Rating
- 2(+1)
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes a spatial transcriptomics foundation model using discrete diffusion to learn cellular representations and inpaint spatial cellular configurations.
Critical strengths
The paper addresses biologically relevant tasks, including niche retrieval, spatial clustering, and immune recruitment prediction.
Critical weaknesses
- Insufficient motivation for discrete diffusion. The authors do not convincingly explain why discrete diffusion is necessary for these tasks, particularly niche retrieval and clustering, which are fundamentally representation-learning problems. The advantages over conventional masked modeling with variable masking rates remain unclear.
- Unclear practical advantages of generation. Although the downstream tasks are biologically meaningful, the paper does not demonstrate why generative modeling is preferable to simpler discriminative approaches. For example, immune recruitment could be predicted directly without generating surrounding cells. Furthermore, differences in baseline adaptation protocols complicate fair comparisons.
- SUDOKU can be considered as a pre-trained spatial transcriptomics model, but claiming it as a general-purpose tissue foundation model is not convincing.
Questions for authors
Key question on the motivation for discrete diffusion: What specific advantages does discrete diffusion offer for spatial transcriptomics compared with conventional masked modeling? In particular, why is a generative formulation necessary for downstream tasks such as niche retrieval and clustering?
10 comments
Response to Reviewer 8X6E (2/3)
Weakness 2(a): practical value of generation
The purpose of generation is not limited to predicting immune recruitment. It is to recover the cell states of a missing region and their spatial arrangement, which SUDOKU does more accurately than every baseline across organs, species and missing geometries (Section 4.2, Table 4); immune recruitment (Section 4.3) is one way to validate the generated tissue against measurement. A simple discriminative model outputs one quantity chosen before training and must be retrained for each new quantity, whereas any quantity of the region can be read from the generated cells afterwards. Even on immune recruitment, the one quantity it is trained for, the direct discriminative approach is clearly worse than SUDOKU. To show this, we add a direct prediction baseline: a ridge regression model from the mean expression of a clone to its immune recruitment, fitted on the clones of the training sections.
| Method | Spearman, mean of three sections | Median rank error |
|---|---|---|
| SUDOKU | 0.77 | 0.12 |
| Direct prediction | 0.62 | 0.24 |
Beyond recruitment, the same generated band shows where the immune cells are and which cells sit next to the clone, as Figure 2c illustrates for one clone. In the revision we score three such quantities on all 125 clones, from the same generated cells as Figure 2 and with no retraining.
| Question about the band around a clone | Agreement with measurement | SUDOKU | GeST | Interpolation |
|---|---|---|---|---|
| Which side holds more immune cells | Pearson over four sectors | 0.61 | 0.52 | 0.22 |
| Which cell types lie within 25 µm of the clone | Spearman over 12 cell types | 0.81 | 0.46 | 0.32 |
| Which cell types sit next to each other | Pearson over 67 type pairs, against shuffling | 0.74 | 0.39 | 0.29 |
SUDOKU agrees best with the measurement on all three questions. A simple discriminative approach cannot answer these questions: the model built for recruitment returns only recruitment, and each row would need its own target and its own model, whereas SUDOKU answers all three from the generation it has already made.
Generation also enables uses that a predictor cannot serve. In future work, we will alter the cells of one region by hand and generate the tissue around them, which gives an in silico spatial perturbation. We see this as a step toward the virtual tissue model.
Weakness 2(b): baseline adaptation protocols
Every method is adapted in the same way wherever its released code allows. SUDOKU is fine-tuned on the benchmark sections with its own self-supervised objective and no labels, and no benchmark section is in its pre-training corpus (Appendix E). GeST, CellPLM, Nicheformer and Novae, the baselines whose training code is released, are fine-tuned on the same sections in the same way (Appendix F); GeST is also pre-trained on our corpus, so that comparison differs only in the model. Four baselines are used as released: scGPT-spatial, SToFM and CellWorld release inference code only, and the self-supervised adaptation of TERRA exceeds our compute budget. For a fair comparison with these four, we added zero-shot evaluation with SUDOKU. It is far above the best of the four on every representation benchmark, and on HESTA and multi-scale clustering it already outperforms every baseline, including the fine-tuned ones (0.486 vs 0.447 for GeST on HESTA, 0.408 vs 0.295 for STAGATE on clustering).
| Task | Metric | SUDOKU, zero-shot | Best of the four, as released |
|---|---|---|---|
| Niche retrieval, HESTA | AUPRC, mean of 8 organs | 0.486 | 0.303 (scGPT-spatial) |
| Niche retrieval, DLPFC | PCC, mean of 7 classes | 0.490 | 0.223 (TERRA) |
| Multi-scale clustering | ARI, mean of 3 levels | 0.408 | 0.255 (scGPT-spatial) |
We add this table to Appendix J. The revision also adds a table to Appendix F (Table A.8) that lists, for every method, its starting weights and its adaptation; all models are read out at the same neighborhood radius as SUDOKU.
Response to Reviewer 8X6E (3/3)
Weakness 3: foundation model
We present SUDOKU as a spatial foundation model, that is, a foundation model for spatial transcriptomics. It is not meant to cover every aspect of tissue, for example other modalities such as histology images. Within this scope, SUDOKU has the two properties that define a foundation model (Bommasani et al., 2021): pre-training on broad data, and adaptation to a wide range of downstream tasks.
- Broad data. SUDOKU is pre-trained on 396 whole-transcriptome sections at single-cell resolution, from 12 organs, two species, and normal and tumor tissue. We favored quality over quantity: the 49.1 million cells are what remains of about 80 million after strict quality control (Appendix A). This corpus is already larger than those of Novae (Nature Methods, 2025) and scGPT-spatial, two spatial foundation models pre-trained on about 30 million cells or spots.
- A wide range of downstream tasks. SUDOKU serves both paradigms of downstream use including representation and generation. It is the only model that both generates cells and gives representations at multiple spatial scales (Table 1). The experiments span four spatial transcriptomics technologies, two species and ten organs, from embryonic heart and liver to cortex, kidney and lung tumor tissue (Appendix E), and SUDOKU outperforms existing methods in all of these evaluation scenarios.
We hope these clarifications and results answer your concerns. If any concern remains, please let us know, and we will do our best to address it within the discussion period.
Response to Reviewer 8X6E (1/3)
Thank you for your review. We believe there are some misunderstandings about our motivation, the practical value of generation and the scope of our foundation model term. We apologize for not stating these points more clearly and clarify them below. We sincerely look forward to further discussion.
Weakness 1: motivation for discrete diffusion
We first clarify the motivation for discrete diffusion. Since no specific method is named in the review, and the masked modeling baselines (CellPLM, Nicheformer, scGPT-spatial, SToFM, CellWorld and TERRA) all use one or a few fixed masking rates (Table 1), we answer for both forms that masked modeling with variable masking rates can take:
Our motivation for the generative formulation over the second form is to unify generation and representation in one model, which gives the following advantages:
We would like to note that we did not claim the generative training objective to be a must for representation learning. We do not deny that conventional masked modeling is useful for representation learning, but our experiments have shown that generative pretraining yields better representations.