- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper studies self-supervised representation learning for imaging-based spatial transcriptomics and proposes a local-to-global encoder whose cost grows linearly with transcript count. It combines a local transcript graph, a quadtree spatial Transformer, and a cross-attention readout back to each transcript. It is trained with a multi-scale JEPA objective under spatial and gene masking. It is pretrained on 632 public iST sections and evaluated frozen against existing spatial and single-cell foundation models on eight transfer tasks spanning cell, niche, and tissue scales.
Critical strengths
- The studied problem is meaningful, and the transcript-level perspective is novel. Unlike existing single-cell or spot-based foundation models, which pool transcripts into predefined units before learning, this work represents tissue directly at the level of individual transcripts.
- The proposed approach is interesting and intuitive. The tissue embedding field allows representations to be read out at multiple spatial resolutions from a single encoding pass. Such a design choice can potentially inspire future studies.
Critical weaknesses
- My main concern is that the performance gains are not significant, and Laminar falls well behind other methods on several tasks. On cell type, Laminar scores 0.596, ranking 12th of 14 methods and below the raw-count baseline and scGPT-spatial. Even on region composition, where Laminar ranks first (0.869), simply predicting the training-fold mean already reaches 0.876.
- I am not sure that the evaluated tasks and comparators fit this modeling paradigm, since the settings are not fully aligned. It is unclear whether this benchmark effectively reflects the model’s capability.
- The comparators differ substantially in pretraining data, platforms, and gene vocabularies, which limits the comparability of the results. Performance differences may therefore reflect differences in training data rather than in modeling choices.
Questions for authors
See weaknesses.
Response to Reviewer uJNk
We thank the reviewer for the constructive review and are glad the reviewer found the problem meaningful, the transcript-level perspective novel, and the tissue embedding field interesting and intuitive. We ran new experiments for each of the three concerns. Changes in the paper are in blue.
Laminar is now in the top three on all seven tasks, with the best mean rank (1.86 against 5.43 for the next method) and the highest Elo (1674 against 1631) (Table 1, lines 379–397). Two changes brought this about. We added two pretraining losses that predict the relative abundance of each gene's transcripts in local regions and their surrounding tissue (lines 323–334). And for each task Laminar now sums the transcript embeddings of the region being scored, instead of averaging cell embeddings.
On significance: Elo is fitted to wins and losses on paired folds, and we added paired tests corrected for multiple testing (lines 466–467, Appendices J and P). Over the seven tasks, Laminar is significantly above 12 of the 13 comparators, and none is significantly above it (Table 18). At the multicellular scale it is significantly above scGPT-spatial (adjusted p < .01). On a given task its median is higher than another method's in 91 of 97 cases, and its Elo is the highest in 99.9% of 2,000 bootstrap refits (Fig. 11).
We read this concern as follows. The submission evaluated Laminar like a cell model, by embedding each cell and averaging cells over larger regions, although the field is meant to be read at the region itself. We now evaluate it that way. Laminar sums the transcript embeddings of the region being scored and normalizes once, with the same frozen encoder (Eq. 3, lines 341–344). On both tissue-core tasks this scores higher than averaging cells: WHO grade .454 against .421 and methylation subclass .541 against .501 (lines 2360–2362). Read this way, Laminar is second at the cell scale and first at the multicellular and tissue-core scales, while seven of the eight models pretrained on cells or cell neighborhoods do best at their own scale (Fig. 3b, lines 460–464). And when Laminar is read exactly like the comparators, by averaging cells, it still has the best mean rank of the 15 methods (2.86 against 5.43, Appendix I).
We agree. Models that were pretrained independently differ in data, platforms and gene vocabularies, so comparing them cannot isolate the model. We therefore ran two sets of experiments in which all three are the same.
Amount of pretraining. We trained four more runs of Laminar and ranked their checkpoints among the comparators (Appendix N, Table 16, lines 2572–2580). From 10k steps on, every checkpoint is first.
At 10k steps Laminar has seen about a ninth of its corpus. A run on a random quarter of the sections (31M cells, about the size of scGPT-spatial's corpus) is also first at 10k steps (mean rank 3.86, Elo 1652). The five published models with the largest corpora (88M to 112M cells) all rank below scGPT-spatial, which was pretrained on 30M profiles (Table 11, lines 2582–2586). The lead does not come from a larger pretraining corpus.
Model. Each of the ten ablations removes or replaces one part of the full 95.1M-parameter encoder and is compared with a control that has the same corpus, platforms, gene vocabulary, seed and number of steps. All ten score lower than their control over the seven tasks combined, and each is significantly lower on at least one task (Fig. 4). We also replaced Laminar's neighborhood attention with PTv3 (Wu et al., 2024), OctFormer (Wang, 2023) or Erwin (Zhdanov et al., 2025), again with everything else the same (30k steps). All three rank above every published method by Elo, and Laminar's own encoder has the highest Elo (Fig. 5, Table 15).
We thank the reviewer for raising these points and would appreciate a reassessment in light of the new experiments.