- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3(+1)
- Soundness
- 2
Read review
Paper summary
The paper proposes SPARSE, a comparably lightweight spatial adapter on frozen transcriptomic foundation-model embeddings that combines TCFormer-style token merging, 2D spatial RoPE, cross-resolution attention, and FPN-style fusion, trained with masked expression reconstruction. SPARSE applied to spatial domain identification tasks.
Critical strengths
- The paper address timely and important research question, cell representation learning from spatial transcriptome.
Critical weaknesses
- Novelty: The contribution is largely combinatorial (TCFormer-style token merging + 2D RoPE + FPN-style fusion + masked reconstruction) rather than an original solution to a known challenge or a new framing of the problem, and it is unclear which component addresses anything specific to spatial transcriptomics.
- Clarity: The term “hierarchical” is overstated. A hierarchy requires that coarser levels structurally constrain finer ones, but neither SPBlock nor HSF enforces this: cross-scale attention is dense across all fine tokens regardless of cluster membership, and HSF explicitly avoids assignment-based upsampling. The method should be toned down to “multi-scale.”
- Significance
- Baselines. Standard spatial-domain methods mentioned in related work (STAGATE, GraphST, BayesSpace) are not compared.
- Comparing methods by NMI/ARI measures how well each embedding’s clusters overlap with ground-truth labels, so how the ground truth was defined is critical. Yet the labels driving the main results are vague: the human-brain “17 domain types” (Table B3) are never described (cortical layers? anatomical regions?). The human-lung analysis (Fig. E1) uses only section-level healthy-vs-cancer labels, not cell-level ground truth. It’s unclear whether ground truth labels are reliable or appropriate for this task.
- It is unclear whether the gains come from better embeddings or from Leiden behaving differently on a 64-dim embedding than on the higher-dimensional competitors.
Questions for authors
- Line 1430, authors stated that “The ablation study is the stated exception: it uses seed 42 and averages the two held-out human-brain regions.” Why is it an exception? Every other table follows the three-seed mean ± std rule, but the ablation (Table 2 / E1) was run once with seed 42 and averaged over the two held-out brain regions.
6 comments
Initial Response to Reviewer hjXw(Part 2/2)
W3(c): Sensitivity to output dimensionality
We tested SPARSE output dimensions of 128, 256, and 512 on both human brain and mouse embryo. The encoder and the 64-dimensional HSF fusion layers were kept fixed in width; only the terminal projection, its output normalization, and the corresponding reconstruction-head input changed. We trained each higher-dimensional variant with three seeds and used the same downstream clustering procedure. The 64-dimensional results are the original manuscript references and were not rerun.
The table below shows spatial-domain identification results for SPARSE at output dimensions of 64, 128, 256, and 512. We have added these results to Table E14 (Appendix E.8).
| Output dimension | Human brain Region 1 NMI % ↑ | Human brain Region 1 ARI % ↑ | Human brain Region 2 NMI % ↑ | Human brain Region 2 ARI % ↑ | Mouse embryo E16.5 NMI % ↑ | Mouse embryo E16.5 ARI % ↑ |
|---|---|---|---|---|---|---|
| 64 | 57.53 ± 0.58 | 47.03 ± 0.66 | 38.92 ± 3.08 | 24.50 ± 4.62 | 65.77 ± 0.97 | 49.81 ± 1.19 |
| 128 | 55.17 ± 1.91 | 42.98 ± 5.17 | 39.92 ± 2.98 | 25.90 ± 5.01 | 64.92 ± 1.15 | 51.04 ± 2.45 |
| 256 | 52.75 ± 1.17 | 42.76 ± 1.30 | 36.26 ± 1.83 | 22.87 ± 4.01 | 65.35 ± 0.58 | 51.46 ± 1.30 |
| 512 | 51.27 ± 3.43 | 36.91 ± 3.83 | 37.14 ± 2.40 | 24.89 ± 3.50 | 66.04 ± 0.70 | 50.58 ± 1.76 |
When averaged across the two human-brain regions, the 128-dimensional results are close to the 64-dimensional reference, while the 256- and 512-dimensional variants have lower means. On mouse embryo, NMI remains similar across dimensions, and mean ARI does not decrease at the higher dimensions. These results show that SPARSE can perform well beyond 64 dimensions, but its sensitivity to output dimensionality varies by dataset. Lower-dimensional embeddings do not necessarily yield better clustering results. Because the higher-dimensional variants were retrained, this experiment does not isolate the effect of dimensionality on the 15-NN graph or Leiden, nor does it replace a dimension-matched comparison across methods.
Q1: Three-seed ablation results
Tables 2 and E1 originally reported two-region averages for seed 42 only. We have now added seeds 0 and 123 for all five ablations.
The table below summarizes the human-brain component ablation results across three seeds. We averaged the two regions within each seed before computing the mean and sample standard deviation. We have updated Table 2 (Section 4.4) with these results.
| Model variant | Two-region mean NMI % ↑ | Two-region mean ARI % ↑ |
|---|---|---|
| w/o spatial neighborhood | 38.34 ± 1.51 | 28.43 ± 4.12 |
| w/o HSF | 43.29 ± 0.29 | 34.43 ± 0.75 |
| w/o rCTM | 45.43 ± 1.27 | 33.57 ± 1.22 |
| w/o cross-scale attention | 45.31 ± 1.16 | 33.93 ± 1.34 |
| w/o token score | 45.73 ± 2.20 | 32.79 ± 1.00 |
| Full scGPT+SPARSE | 48.23 ± 1.78 | 35.76 ± 2.62 |
Table E1 (Appendix E.3) also reports the results for each region separately. The full configuration has the highest mean NMI and ARI when averaged over the two regions.
Thank you for the detailed response and additional experiments. The inclusion of STAGATE and GraphST, the three-seed ablations, and the clarification of “multiresolution” terminology address several of my concerns. I also appreciate the more careful interpretation of the lung visualization. However, my main concerns about novelty and the strength of the empirical evidence remain.
- Novelty. The response clarifies the architecture and its differences from TCFormer, particularly the aggregation of physical coordinates and the assignment-free fusion. However, it does not sufficiently establish why these adaptations constitute a substantive methodological contribution specific to spatial transcriptomics. The ablations support the utility of individual components within SPARSE, but do not establish the advantage of the proposed design over simpler ways of incorporating spatial context into existing cell embeddings.
- Dimensionality and the clustering comparison. The new experiments demonstrate that SPARSE can perform reasonably across several output dimensions, but they do not resolve the original concern about comparisons across methods. As the authors acknowledge, retraining variants with different terminal projections does not isolate the effect of embedding dimensionality on graph construction and Leiden clustering. Moreover, the fusion representation remains 64-dimensional. A comparison using a common dimensionality across methods would more directly address this concern.
Overall, the rebuttal improves the clarity and completeness of the evaluation. I therefore increase my Presentation score from 2 to 3. However, my central concerns about methodological novelty and the interpretation of the reported gains remain, so I maintain my overall score of 2 (Weak rejection).
Initial Response to Reviewer hjXw(Part 1/2)
Thank you for the constructive feedback. We agree that the manuscript should state more clearly what SPARSE contributes, what its multiresolution structure does and does not enforce, and what conclusions the evaluations support. We address each point below:
W1: Novelty
Just as FPN and ViTDet build multiresolution representations to contextualise local image features, spatial transcriptomics benefits from interpreting a cell’s expression profile in the context of the surrounding tissue. The core novelty of SPARSE is to apply this principle to spatial transcriptomics by decoupling gene-expression encoding from multiresolution spatial modelling: rather than retraining the transcriptomic backbone, SPARSE builds local tissue context at multiple resolutions from existing cell embeddings and integrates that context back into the target cell’s representation. To realise this idea, SPARSE draws on TCFormer’s feature-guided token merging. Physical coordinates determine which neighbours are included, while token features determine how those neighbours are grouped. The representation thus becomes coarser across stages without expanding the spatial neighbourhood. Unlike TCFormer, SPARSE uses the same weights to aggregate token features and physical coordinates during merging, then uses the resulting coordinates in the encoder’s cross-resolution attention via 2D RoPE. During fusion, TCFormer’s original MTA upsamples coarse features according to cluster assignments before further fusion. SPARSE’s Hierarchical Stage Fusion (HSF) instead lets finer tokens directly attend to the fused tokens from the next coarser stage, without restricting attention to their original merge groups. The final fused representation of the centre cell is the adapter’s output.
W2: Use of “hierarchical”
We agree that “multiresolution” is more precise than “hierarchical” when describing the overall adapter. Token merging creates fine-to-coarse assignments, but SPBlock does not restrict attention to tokens assigned to the same cluster, and HSF does not use assignment-based upsampling. In the camera-ready version, we will use “multiresolution” to describe different token granularities within the same neighborhood. For ease of reference, we retain HSF in this response.
W3(a): Additional spatial-domain baselines
The table below reports the three-seed mean NMI and ARI for STAGATE and GraphST on the two held-out human-brain regions and the held-out mouse-embryo stage. In the camera-ready version, we will add these results to the main comparison table and include visualizations of the corresponding spatial-domain assignments.
We did not include BayesSpace in this embedding-based comparison. Its native spatial clustering returns labels rather than a learned spatial embedding that can be passed to the same 15-NN graph construction and Leiden pipeline. Its native spatial adjacency also assumes a regular lattice, whereas our evaluation data contain irregularly positioned cells. BayesSpace labels could be scored directly with NMI and ARI, but that would be a comparison of different clustering pipelines rather than of embeddings under a shared readout.
W3(b): Human-brain annotations and the purpose of the lung analysis
The human-brain reference labels are not exclusively cortical layers or exclusively anatomical regions. They include cortical developmental zones such as the cortical plate, subplate, and ventricular zone, as well as anatomical structures such as the striatum and thalamus. Region 1 and Region 2 contain 17 and 16 distinct values in the reference annotation field, respectively, including the retained NA category (Table B3, Appendix B.3). We will replace “domain types” with “reference annotation categories” and clarify that NMI and ARI measure agreement with these annotations. The two holdouts are defined by coordinates; we do not claim that they are independent physical sections.
The lung analysis asks whether SPARSE embeddings reflect disease-associated differences in cellular states, as shown in Figure E1 (Appendix E.1). It is exploratory: healthy and cancer labels are assigned at the section level, not to individual cells as verified malignant or non-malignant labels. The observed separation may also reflect differences in cell-type composition, section identity, or technical factors. We will clarify that this visualization is not evidence of cell-level malignancy classification or of disease-state discrimination within a matched cell type.