- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces CellHIST, a standardized dataset and benchmark for weakly supervised single-cell gene expression prediction from histopathology. It collects 169 samples across 14 organs and evaluates existing methods under different supervision settings, with additional analyses of data scaling, cell specificity, and downstream biological applications.
Critical strengths
The paper addresses an important gap by providing a large-scale, standardized dataset covering 169 samples across 14 organs. This could be a useful resource for future research on virtual single-cell spatial transcriptomics.
The paper compares several weakly supervised methods with fully supervised and super-resolution approaches.
Critical weaknesses
The number of evaluation samples varies considerably across organs. In particular, Ovary and Skin have only two and three single-cell samples, respectively. This makes it difficult to draw strong conclusions about model performance and generalization on these tissues.
Questions for authors
The cell-matching coverage is relatively low for some tissues, especially Lung. Could this affect the evaluation results or introduce bias toward certain cell populations?
Given the differences in gene panels and sequencing platforms across datasets, how much do these factors influence the benchmark results?
5 comments
Response to Reviewer Uaq1 (Part 2 / n)
W1: The number of evaluation samples varies considerably across organs. In particular, Ovary and Skin have only two and three single-cell samples, respectively. This makes it difficult to draw strong conclusions about model performance and generalization on these tissues.
AW1: Thanks for pointing this out and for your thoughtful assessment of its potential limitations. We really appreciate your feedback that helps strengthen this paper.
Response summary: More samples for some organs (e.g., Skin) would help strengthen the generalizability of the organ-specific findings. It is also our ultimate goal. However, the number of available single-cell-resolution Xenium samples is growing slowly because of the high cost (approximately $10k per sample). This work represents an initial step in this area by contributing the first standardized cell-centric dataset for virtual single-cell ST. We will continue collecting additional samples from public resources in our future work. We have discussed this issue in our revised paper.
Our detailed responses are as follows:
(1) Data size comparison between CellHIST and existing studies
We would like to note that single-cell ST datasets remain limited in scale because of the high cost and technical complexity of data generation. Related studies have also used limited numbers of samples for model development and evaluation, as summarized in Table R1.
Concretely, for Skin, GHIST used one melanoma sample and SPoTLIghT used two, whereas CellHIST incorporates these public sources and an additional Xenium Prime 5K sample, yielding three slides. For Ovary, UTOPIA analyzed one Xenium 5K sample, while MIST includes two FFPE ovarian cancer datasets and one fresh-frozen ovarian dataset; CellHIST incorporates the two FFPE datasets. For Bowel, MISO evaluated high-resolution expression prediction using one colorectal cancer Xenium sample, whereas our evaluation pool includes five slides.
Concretely, for skin, GHIST [A] used one melanoma sample and SPoTLIghT [B] used two, whereas CellHIST incorporates these public sources and an additional Xenium Prime 5K sample, yielding three slides. For bowel, MISO [C] evaluated high-resolution expression prediction using one colorectal cancer Xenium sample, whereas our evaluation pool includes five slides. For ovary, UTOPIA [D] analyzed one Xenium 5K sample, while MIST [E] includes two FFPE ovarian cancer datasets and one fresh-frozen ovarian dataset; CellHIST incorporates the two FFPE datasets.
Table R1. Data size comparison between CellHIST and existing studies.
| Method/resource | Publication venue | Organ | Number of samples | Slides in CellHIST evaluation pool |
|---|---|---|---|---|
| GHIST | Nature Methods, 2025 | Skin | 1 | 3 |
| SPoTLIghT | npj Precision Oncology, 2024 | Skin | 2 | 3 |
| MISO | Nature Communications, 2025 | Bowel | 1 | 5 |
| UTOPIA | bioRxiv preprint, 2026 | Ovary | 1 | 2 |
| MIST | ICML 2026 | Ovary | 3 | 2 |
These studies differ in their prediction tasks, evaluation settings, and sample inclusion criteria. The comparison therefore contextualizes organ-specific sample availability rather than predictive performance or the number of independent patients. It does not establish that the available samples are sufficient for broad generalization.
The high cost and technical complexity of spatial transcriptomic profiling remain barriers to assembling large patient cohorts. Suitable data for our evaluation additionally require paired high-resolution histology and reliable cell-level correspondence. CellHIST addresses this resource gap through systematic curation and standardized processing. Nevertheless, these efforts do not eliminate the limitations associated with small and uneven organ-specific cohorts. In particular, the Ovary and Skin results may be sensitive to the characteristics of individual slides, and differences in sample size and cohort composition warrant caution when comparing performance across organs. We therefore restrict our organ-specific conclusions to the evaluated cohorts and plan to incorporate additional independent patient samples, prioritizing underrepresented organs. We also plan to publicly release the expanded resources, subject to data-sharing permissions.
(2) Our revisions
We have added the following discussion of sample availability and generalizability in Section 6 (Discussion):
Limited single-cell ST samples, particularly for Ovary, Skin, and Bowel, may constrain the generalizability of our organ-specific results. Single-cell-resolution samples are expensive, and the data scale increases slowly in this field. This study has curated as many high-quality cancer samples as possible from public resources. We will gather more ST data in the future to improve CellHIST.
Please refer to page 10, where this discussion is colored in red.
Response to Reviewer Uaq1 (Part 3 / n)
Q1: The cell-matching coverage is relatively low for some tissues, especially Lung. Could this affect the evaluation results or introduce bias toward certain cell populations?
AQ1: We thank the reviewer for their careful reading. This prompts us to examine how matching coverage relates to prediction performance and whether the matching process preferentially retains certain cell populations, thus helping us better understand its potential influence on the evaluation results. Insightful comments.
Response summary: Our Lung analyses show that cell matching changes the evaluated cell population, with T and B cells enriched in the matched subset. Lower matching coverage also coincides with lower PCC across all seven methods. These findings indicate the differences in cell-type representation caused by cell matching and an association between matching coverage and prediction performance.
Next, we describe the experimental setup, results, and our revisions.
(1) Experimental setup
Cell-type representation. We compared cell-type proportions between the full Xenium cell population and the successfully matched subset, separately for the Xenium and post-Xenium groups.
Performance across alignment groups. We compared matching coverage and prediction performance across the two groups, comprising four Xenium slides and 16 post-Xenium slides. Performance was measured using gene-wise PCC on TargetH50 with assay-CPM log1p normalization. We calculated equal-weight slide averages and report the mean ± SD across three training seeds.
(2) Results
Cell matching changes cell-type representation. As shown in the table below, the matched subset had higher proportions of T and B cells in both alignment groups. In contrast, the proportions of epithelial, stromal, myeloid, and endothelial cells each differed by less than two percentage points.
Table R2: Cell-type proportions before and after matching in the Lung cohort.
| Cell type | Xenium all → matched | Post-Xenium: all → matched |
|---|---|---|
| Epithelial | 30.81 → 31.66 | 22.35 → 23.62 |
| Stromal | 15.97 → 16.22 | 32.98 → 31.10 |
| Myeloid | 8.31 → 8.18 | 13.26 → 14.05 |
| Endothelial | 7.15 → 7.34 | 2.27 → 2.01 |
| T cells | 6.63 → 8.05 | 2.65 → 3.82 |
| B cells | 3.32 → 3.99 | 4.02 → 4.87 |
| Unknown | 26.70 → 23.28 | 21.92 → 19.92 |
Lower matching coverage coincides with lower prediction performance. The post-Xenium group had lower matching coverage than the Xenium group (38.19% versus 75.33%) and lower PCC across all seven methods, as shown below.
Table R3: Matching coverage and prediction performance across Lung alignment groups.
| Measure | Xenium | Post-Xenium |
|---|---|---|
| Slides | 4 | 16 |
| Matching coverage | 75.33% | 38.19% |
| ABMIL | 0.237 ± 0.002 | 0.075 ± 0.003 |
| ABMIL-gated | 0.236 ± 0.007 | 0.076 ± 0.004 |
| GraphMIL | 0.217 ± 0.003 | 0.063 ± 0.016 |
| MS-GraphMIL | 0.103 ± 0.007 | 0.023 ± 0.002 |
| Transformer | 0.212 ± 0.002 | 0.085 ± 0.010 |
| DeepSpot2Cell | 0.227 ± 0.000 | 0.061 ± 0.004 |
| sCellST | 0.229 ± 0.003 | 0.058 ± 0.008 |
PCC: TargetH50, assay-CPM log1p normalization; equal-weight slide averages, reported as mean ± SD across three seeds.
Residual alignment errors can push nuclear centroid distances beyond our 5 μm threshold and affect retained image–expression correspondences. Consistent with the nuclear-geometry-based matching used by Xenium and GHIST, post-Xenium samples showed fewer distance-threshold exclusions for T/B cells (3.84%/4.57%) than for epithelial/stromal cells (17.98%/16.89%).
Together, these results show that matching changes cell-type representation and that the lower-coverage cohort also yields poorer prediction scores. The cohort comparison supports an association with alignment quality, rather than establishing causality.
(3) Our revisions
In response, we have made the following revisions on Pages 20 and 21:
-
Add the cell-type proportion comparison to show how matching changes the composition of the evaluated cell population.
-
Report matching coverage and prediction performance separately for the Xenium and post-Xenium groups.
-
Add the corresponding discussion of potential alignment-related effects and clarify that the reported performance is evaluated on the matched cell population.
Response to Reviewer Uaq1(Part 1 / n)
Thank you for your encouraging comments and constructive feedback. We appreciate your positive assessment of CellHIST’s value as a large-scale, standardized resource for virtual single-cell spatial transcriptomics and of our experimental design comparing weakly supervised, fully supervised, and super-resolution approaches.
Next, we provide a detailed point-to-point response to address your questions and concerns.