- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes a Visual Soft-Prompt framework for predicting ranked gene expression sequences from histology images. The approach connects a frozen pathology foundation model (GPFM) with a pretrained cell-sentence language model (C2S-Scale) through a trainable adapter, optionally incorporating attention LoRA for long-horizon generation. The paper investigates autoregressive degeneration in long gene-sequence generation and demonstrates that attention LoRA, combined with extended training, substantially improves generation stability and gene coverage. Experiments on the HEST dataset compare the proposed approach against conventional regression and retrieval methods, including ST-Net, BLEEP, and HisToGene. The results suggest that the method can generate longer gene lists beyond predefined gene panels, although several conventional baselines remain stronger on major shared-panel ranking metrics.
Critical strengths
- Meaningful formulation of gene expression prediction as sequence generation.
The paper explores an interesting alternative to fixed-panel gene expression regression by generating ranked gene lists over a substantially larger vocabulary.
This formulation provides greater flexibility in the output space and potentially enables the prediction of genes outside predefined panels.
- Thorough investigation of long-horizon generation failures.
The authors systematically investigate how sequence length, decoding constraints, attention LoRA, and training budgets affect generation quality.
In particular, the matched-length and matched-budget experiments provide convincing evidence that attention adaptation contributes to stable long-horizon generation beyond simply increasing the number of training steps. This analysis represents a valuable contribution of the paper.
Critical weaknesses
- Insufficient baseline coverage and inadequately controlled comparisons limit the evidence for the proposed architecture's independent contribution.
This is my primary concern regarding the paper.
First, the experimental comparisons mainly involve relatively established methods such as ST-Net, BLEEP, and HisToGene, while several more recent and potentially competitive approaches are not evaluated. Relevant examples include:
STFlow (Huang et al., ICML 2025): A whole-slide flow-matching approach for spatial gene expression generation, evaluated on datasets including HEST-1k.
OmiCLIP/Loki PredEx (Chen et al., Nature Methods 2025): A visual–omics foundation-model framework that supports cross-modal prediction of spatial gene expression from histology.
HECLIP (Bioinformatics 2025): A histology-enhanced contrastive learning approach for spatial transcriptomics imputation.
GenAR (Ouyang et al., Medical Image Analysis 2026): A multiscale autoregressive framework for predicting spatial gene expression from histology images, which is particularly relevant to the proposed generative formulation.
Notably, STFlow, OmiCLIP, and GenAR are already discussed in the Related Work section but are not included in the quantitative comparisons.
I acknowledge that these methods differ in their input requirements, prediction spaces, and output representations, so fully equivalent comparisons may not always be straightforward. Nevertheless, the authors should clarify why these recent approaches were excluded and, where feasible, provide comparisons using shared gene sets, consistent data splits, and common ranking metrics.
Second, the main long-horizon comparisons against ST-Net and BLEEP are affected by their fixed 1,000-gene prediction panels.
Once the evaluation depth exceeds the effective prediction range of these baselines, their performance degradation is partly an inherent consequence of their restricted output spaces. This does not necessarily demonstrate that the proposed generative model achieves superior gene-ranking accuracy.
Therefore, the reported long-horizon advantage may partly reflect differences in output coverage rather than improvements in predictive capability under equivalent conditions.
More importantly, the compared methods use different visual representations. The proposed approach benefits from a strong pretrained GPFM encoder and additional organ/technology metadata, whereas the conventional baselines primarily follow their original image-based configurations.
A direct comparison with a regression or gene-ranking model trained on the same GPFM features and metadata is missing. Without such a controlled baseline, it is difficult to determine whether the observed benefits arise from the visual foundation model, the pretrained cell-sentence language model, or the autoregressive generation architecture itself.
Furthermore, on the shared 1k-HVG panel, the proposed approach still trails ST-Net and BLEEP on major ranking metrics, including J@10, NDCG@50, and PCC(inv).
Overall, the experimental evaluation neither sufficiently covers recent competitive methods nor adequately isolates the contribution of the proposed architecture under matched input and output conditions. This substantially limits the strength of the paper's empirical claims and is a major factor in my recommendation.
- Long-horizon generation quality and statistical reliability require stronger validation.
Although the proposed model generates substantially longer gene sequences, the current evaluation does not sufficiently distinguish accurate gene ranking from expressed-gene set recovery.
As acknowledged by the authors, extensive expression-count ties in the long tail make windowed NDCG increasingly reflect gene-set membership rather than precise relative expression ordering.
Consequently, generating near-complete gene sequences does not necessarily establish faithful reconstruction of long-range gene expression rankings.
Additionally, the reported results are based on single training runs, without multi-seed evaluations of model stability.
The confidence intervals are computed over sampled spatial spots, while multiple spots originate from the same tissue slides and may exhibit substantial statistical dependence. Treating these spots as independent observations could underestimate the uncertainty associated with the reported results.
These limitations make it difficult to fully assess the robustness and statistical significance of the reported improvements.
Questions for authors
- Recent baselines and comparison fairness
The paper discusses recent methods such as STFlow, OmiCLIP, and GenAR but does not include them in the experimental comparisons. Could the authors clarify the specific reasons for their exclusion?
For methods with compatible prediction objectives, are comparisons available under consistent data splits, shared gene sets, and unified evaluation metrics? If direct comparisons are infeasible, please clarify the relevant methodological or protocol differences.
- Matched feature comparison
Could the authors clarify how much of the reported performance improvement can be attributed to the pretrained C2S language model rather than the GPFM visual representations?
Are results available for a regression model or gene-ranking head trained using the same GPFM features and organ/technology metadata?
- Long-horizon evaluation
Given that conventional baselines are restricted to fixed gene panels and that deep ranking metrics are affected by extensive expression ties, how should the reported long-horizon advantage be distinguished from increased gene coverage and expressed-gene set recovery?
What evidence supports improved ranking accuracy beyond the recovery of expressed genes?
- Statistical robustness
Were correlations between spots from the same slide or patient considered when computing confidence intervals?
Are results from additional training seeds available to assess the stability of the proposed approach?
We thank the reviewers for their careful and constructive reviews. We ran the requested experiments and report the outcome briefly, because they change the paper's central claims.
Matched regressor (QwLv, zYKC, GH4g). A ridge/MLP regressor on the same frozen GPFM features plus organ/technology labels, over all 27k genes, with an expression cutoff tuned on validation data, outperforms our model on the spot-wise ranking metrics (Table 1 J@10 0.40 vs. 0.31 for our long-horizon model) and on the Fig. 2 windowed NDCG and precision at every depth (paired slide-level bootstrap, intervals well away from zero). It also selects expressed genes better (F1 0.49 vs. 0.28).
Image-free prior (QwLv). The training-set mean ranking per organ and technology reaches our model's J@10 and exceeds it on the Fig. 2 metrics at every depth. The reviewers are therefore right: the long-horizon advantage over ST-Net and BLEEP reflects output coverage and the encoder, not better ranking accuracy.
Per-gene correlation (QwLv). On 24 human slides, the HEST-style per-gene correlation of our model (r = 0.16 on the top-50 variable genes) is below ST-Net (0.22) and the GPFM regressors (0.26 to 0.32).
Stopping (zYKC, GH4g). Training sentences contained no end-of-sequence token at their true end, so the model cannot learn spot-specific list length. It almost always stops at the training budget.
What holds. Tracking of which genes are spatially structured (correlation of per-gene Moran's I with ground truth, 24 slides, slide-level bootstrap) is significantly better than ST-Net, BLEEP and HisToGene, and on par with the matched regressor (0.22 vs. 0.20, interval includes zero); per-gene variance and gene-gene correlation structure, however, are closer to ground truth for the regressors. The blind controls show that the image adds signal beyond the metadata, and the analysis of long-horizon degeneration in a frozen cell-sentence decoder, which all three reviewers named as a strength, is unaffected.
Clarification (QwLv). The validation set is 20% of the training shards (spots from training slides). Design comparisons (sequence length, LoRA, decoding) were evaluated on test spots, which are separated from training at the patient/study level. Given these results, the abstract's claims about the generative formulation are not supported in their current form. We are therefore withdrawing the paper and will rework it around the failure analysis and the matched comparisons. We thank the reviewers again for feedback that made this clear.