- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This work evaluates the calibration of deep learning frameworks for the task of virtual ST prediction: predicting ST expression from H&E histology. The study proposes an evaluation protocol where each slide is partitioned into a number of disjoint FOV and selected FOVs are used to learn the calibration needed in the target FOVs. The strategy is evaluated on the HEST1k dataset across 70 slides from 47 donors and tested using several calibration ladders: (1) no prompt, (2) a scalar offset, (3) gene-wise empirical-Bayes offsets, (4) low-rank empirical-Bayes offsets. Gene-wise calibration reduces normalized log-MSE by 16.7%, while a single scalar offset recovers 97.3% of this gain.
Critical strengths
- The study evaluates a well-known feature of ST that is that batch effects are present across slides.
- Inducing prompt-based calibration reduces NMSE while preserving Pearson and Spearman correlations, as explained in Proposition 1.
Critical weaknesses
- Unrealistic acquisition scenario. Prompting is simulated by masking FOVs within a fully profiled slide. Current sequencing- and imaging-based platforms (e.g., Visium) do not allow selected groups of ~50 spots to be profiled on demand, as the authors acknowledge in their Limitations. A more realistic setting would estimate the calibration on one fully profiled section and apply it to other H&E-only sections from the same donor, or use the profiled capture area to calibrate predictions on the rest of the whole slide image (e.g; Novae, Nat. Methods 2025; iSCALE, Nat. Methods 2025).
- Limited methodological contribution. The correction is a spot-invariant offset, and a single scalar captures 97.3% of the gain, so the method is effectively slide-level normalization.
- Missing baselines. The method is only evaluated on spot-based technologies on a single foundation model (UNI2-h) and a single prediction strategy (Ridge predictor). ST (both, sequencing-based and imaging-based technologies) has evolved towards single-cell resolution in the recent years, and virtual ST models have now transitioned to this higher spatial resolution (GHIST, Nat.Methods 2025; iSTAR, Nature Biotechnology, 2024; sCellST, Nat. Communications, 2025).
Questions for authors
-
Q1. Can the calibration mechanism be estimated for example on the leftmost portion of a whole-slide image and applied to the right-most section? Similarly, could the top portion of the FOV be masked and used for calibration of the bottom part? This would be a more realistic scenario than randomly selecting FOV of ~50 spots and masking them.
-
Q2. Can the calibration ladder be evaluated across other ST prediction mechanisms? Currently, it is only assessed on a single foundation model (UNI2-h) and a single prediction strategy (Ridge predictor). How the calibration strategy adapts to virtual ST prediction methods such as TRIPLEX (CVPR, 2024), STNet (Nat. BME, 2020) or BLEEP (NeurIPS, 2023)?
-
Q3. Can the proposed calibration strategy be extended to single-cell ST modalities where virtual ST is currently more common?