- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents BasilSup, which combines zero-shot multimodal-LLM predictions with supervised histology-based spatial gene-expression models. Morphological clusters are ranked by the LLM to form a spatial prior, which is fused with a UNI2-h Ridge-MLP ensemble through gene-specific weights. Experiments use HEST-Bench, STimage-1K4M, and KPMP.
Critical strengths
- External biological knowledge may help spatial prediction when paired data are limited.
- The evaluation spans several tissues, species, technologies, and a large gene panel.
- Multiple LLM backbones and gene-level analyses provide useful initial evidence.
Critical weaknesses
- Equation (3) is presented as empirical Bayes, but the implementation is a weighted average of two predictions derived from the same H&E images. The LLM scores are standardized within each slide, whereas the supervised branch predicts log-transformed expression, and no calibration between these scales is described. Squared training-set PCC is also treated as precision without showing that it estimates inverse variance. These gaps weaken the Bayesian interpretation.
- It is unclear whether the LLM ranking is driven by the images. The prompt already contains generated descriptions of each gene, allowing the model to rely on known marker-cell associations and match them to broad tissue patterns. Image-shuffling, blank-image, text-only, and mismatched-description controls are needed to establish that the spatial prior contains information from histology rather than the text prompt alone.
- The supervised branch includes two strong improvements that are separate from the main idea: UNI2-h features and an average of Ridge and MLP regressors. Most baselines do not receive the same encoder or ensemble treatment, while the supervised-only model already explains much of the final performance. Ridge, MLP, and their ensemble should be reported separately, both with and without the LLM prior.
- The cross-validation protocol for the zero-shot branch is underspecified. Section 3.2 samples within-slide and cross-slide pairs but does not state whether clustering and LLM comparisons are rebuilt within every fold. The paper should clarify whether a test slide can be compared with training slides or other test slides. If test images jointly construct the prior, the setting is transductive and not directly comparable with inductive baselines.
- The interpretability analysis is partly circular. A gene receives a high weight because its zero-shot prediction correlates with training labels, and the stronger accuracy of those same high-weight genes is then used as evidence of biological meaning. Much of this pattern follows from the weight definition. Validation on held-out genes, external data, or blinded expert assessment would provide independent evidence.
- Figure 1 is difficult to inspect. The text is small and rasterized, graphical elements are inconsistent, and the training and inference paths are not clearly separated. The figure should be redrawn as a clean vector diagram, and the AI-use statement should clarify whether generative tools were used to create it.
Questions for authors
- How are the two prediction branches calibrated, and why is squared PCC a valid precision estimate?
- Does the LLM remain useful when images or gene descriptions are shuffled, removed, or mismatched?
- Are all zero-shot operations rebuilt within each fold, and what remains when using one supervised regressor?
I hope the author can respond to our concerns before the deadline; otherwise, I will reconsider my score.