- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Stack-JEPA, a self-supervised framework for learning molecular representations from serial histology sections. It combines masked-section latent prediction with graph reconstruction to preserve molecular and spatial relationships. The learned representations support gene expression imputation, spatial graph reconstruction, and 3D alignment.
Critical strengths
The paper presents a well-motivated framework for learning molecular representations from serial histology sections, achieving consistent improvements in gene expression imputation across three datasets.
The learned representations support multiple downstream tasks, including expression imputation and 3D alignment, without retraining the backbone for different gene panels.
Critical weaknesses
The ablation studies do not sufficiently isolate the contributions of JEPA training and graph reconstruction. Some reported improvements are relatively small, without statistical significance testing.
The 3D alignment evaluation relies on EMA-teacher embeddings when target expression is available, rather than the student-predicted representations. This makes it difficult to isolate the contribution of masked-section prediction to alignment performance, particularly given the substantial performance drop in the unobserved setting.
Questions for authors
Can the authors provide a coordinate-distance baseline and additional ablations isolating the JEPA objective and graph loss?
3 comments
W2 response:
We thank the reviewer for highlighting the need to clarify the contribution of masked-section prediction to alignment performance. We would like to clarify what we report in 3D alignment task (Table 3).
PASTE2 is a protocol for performing and evaluating 3D alignment when gene expression is available for serial sections. When target expression is unavailable, the PASTE2 protocol thus cannot directly perform 3D alignment, as it requires gene expression from serial sections as input (row 1). STACK-JEPA enables 3D-aware masked-section prediction even when only H&E is available for the target section. It can therefore impute target representation and enable alignment in a setting where PASTE2 would otherwise be inapplicable (row 2). The purpose of this row is to demonstrate that 3D alignment remains feasible under this challenging condition, rather than to establish a direct comparison with the observed setting.
When expression is available for the serial sections, alignment can be evaluated under the standard PASTE2 protocol (rows 3–4). In this setting, we use the STACK-JEPA encoder rather than masked-section prediction from H&E. The resulting spot embeddings implicitly capture H&E and gene expression context from adjacent sections, yielding better 3D alignment than using raw gene expression in PASTE2. Thus, the observed results assess the utility of the learned embeddings for alignment, whereas the unobserved results demonstrate how masked-section prediction extends alignment to sections without measured target expression. We will revise the text to make these distinct purposes clearer.
Q1 response:
We thank the reviewer for the constructive suggestions, for the ablations, please see our response to your first critical weakness. We agree that comparing with naive baseline, can strengthen the significance of STACK-JEPA. However, we would like to clarify that coordinate-distance baseline is defined by spatial proximity, which is the reference for graph reconstruction task (Task 2). This task evaluates whether neighbourhoods defined by embedding similarity agree with the tissue's spatial graph: candidate spot pairs within a fixed radius are ranked by embedding similarity and scored against the spatial kNN graph, which is a coordinate-distance based graph. Coordinates define this reference graph, so a coordinate-distance baseline recovers it almost exactly (AUPRC 0.97 on ST-data, 0.99 on DLPFC).
Dear Reviewer,
Thank you again for your thoughtful review of our submission. We have put considerable time and effort into addressing your comments, including additional analyses and clarifications, and have posted a detailed response.
As the discussion period ends soon, we would be grateful if you could look at our response when you have a moment and consider whether it addresses your concerns. If so, we would kindly ask you to consider updating your assessment.
We are happy to answer any further questions or provide additional clarification.
Best regards, The Authors
W1 response:
We gratefully thank the reviewer for their vital comment. We agree that the original manuscript did not sufficiently demonstrate the contributions of cross-section representation training and graph reconstruction loss, and that their effects should be significance tested. We have therefore added ablations and paired statistical comparisons, and will revise our claims to reflect the scope of this evidence.
(a) Cross-section representation learning and input ablations. On HER2, we compared the full model with four variants and tested each comparison using a two-sided paired Wilcoxon signed-rank test across the eight patients, with Holm correction over the four comparisons.
Stack-JEPA is significantly higher than the UNI2-h baseline and the input ablations. With UNI2-h as its only input, Stack-JEPA cross-section modelling raises PCC_gene from 0.343 to 0.364, so the student-teacher objective adds to the frozen H&E features. Without any H&E it reaches 0.369. Replacing TERRA with a PCA of the same counts lowers PCC_gene by only 0.004, against 0.037–0.063 for the other variants. Most of the gain therefore comes from Stack-JEPA cross-section modelling, and TERRA's pretraining does not improve performance significantly.
(b) Direct ablation of graph reconstruction loss. We have extended the alignment ablation in Table 4 to cover imputation and graph reconstruction on ST-data, evaluating STACK-JEPA with and without ℒ_graph. These additional experiments directly assess the contribution of graph loss across the remaining tasks. We agree that the comparison with TERRA cannot establish this contribution, since it also reflects differences in architecture and training objectives.
Task 1:
Task 2:
Task 3:
Graph loss improves alignment LTARI from 0.151 to 0.165 while the improvement from graph loss in graph reconstruction and imputation is sufficiently consistent to make any conclusions. Its contribution is therefore task-dependent, with the clearest benefit in alignment. We will revise Section 4 accordingly, remove the claim that the TERRA comparison isolates graph supervision, and will include the additional ablations in the appendix.
References
[3] Kornblith S, Norouzi M, Lee H, Hinton G. Similarity of neural network representations revisited. InInternational conference on machine learning 2019 May 24 (pp. 3519-3529). PMlR.