- Rating
- 4
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes a model for spatial multiomics data that uses Gaussian process priors on a Bayesian latent variable model. This is the first such formulation. Empirical benchmarking using simulated and real data against nine existing methods demonstrates convincingly that the proposed model works well.
Critical strengths
The paper does an excellent job of framing the problem, laying out the state-of-the-art methods, and describing its contribution to the field. The model is described in detail, as are the experimental methods.
The empirical results are very strong, with the proposed method outperforming every other method in nearly every setting.
Critical weaknesses
None
Questions for authors
Why does your method exhibit perfect performance according to all three performance measures on Simulation 1, scenarios 1-3? The text points out that SpaLVM ranks first, but doesn't explore why (or even mention that) its performance is perfect.
It seems strange that COSMOS gets a better LISI score even though its clusters are erroneous. Does this point to a problem with your evaluation setup?
2 comments
Response to Question 2
Response to Question 2: We thank the reviewer for these insightful comments. We agree that a better LISI score does not necessarily indicate more accurate clustering. The LISI (Local Inverse Simpson’s Index) metric was originally introduced by Korsunsky et al. in “Fast, sensitive and accurate integration of single-cell data with Harmony” (Nature Methods, 2019) and has since been adopted in various studies, including SpatialPCA and SMOPCA.
In our study, LISI is calculated based on cell locations and predicted cluster labels to quantify the diversity of predicted labels within local spatial neighborhoods. A lower LISI score indicates greater local spatial consistency (i.e., smoother spatial distributions) of the predicted labels. However, greater spatial smoothness does not necessarily translate into better clustering accuracy, as excessive spatial smoothness may obscure genuine spatial heterogeneity and lead to erroneous cluster assignments. Therefore, the LISI score alone is insufficient to assess clustering accuracy and should be interpreted alongside complementary biological and histological evidence, such as gene/protein marker expression patterns and H&E tissue morphology. Thus, the better LISI score obtained by COSMOS does not contradict its erroneous clustering results; rather, it highlights the distinction between spatial consistency and clustering accuracy. We have revised the manuscript to clarify the interpretation and limitations of the LISI metric in Appendix C.3, “Evaluation Metrics” (Lines: 1441-1445).
Response to Question 1
Response to Question 1: We thank the reviewer for these insightful comments. We agree that the perfect performance of SpaLVM across all three evaluation metrics in Simulation 1 (Scenarios 1–3) deserves further explanation. This performance can be partially attributed to the nonlinear mapping, which provides greater flexibility in capturing complex relationships between the latent representations and observed multi-omics data, compared with the linear mapping used in SMOPCA. This advantage is also consistently observed in our comparisons between SpaLVM and SMOPCA across different experiments.
In addition, the performance of SpaLVM benefits from its ability to jointly model spatial dependencies and multiple modalities, as demonstrated by the ablation experiments in Tables S3–S5 and Figures S29–S32. The additional comparisons of different spatial regularization strategies in Figures S33–S36 further demonstrate the benefits of our original formulation in Equation (15).
Together, these model components enable SpaLVM to effectively capture nonlinear multi-omics relationships while preserving spatial structure, thereby explaining its perfect performance in these simulation scenarios.