- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
M2U addresses cancer prognosis when histology images and omics are available for training, but only histology images are available for a new patient. Frozen omics representations define soft inter-patient neighborhoods, and X-GeoSCL trains a separate histology mapping encoder. At inference, the model uses the new patient's image to retrieve training patients and reads their omics representations through cross-attention. The resulting prediction is combined with a direct image-based prediction, without requiring the new patient's omics. Across four TCGA cancer cohorts, M2U achieves the highest mean AUC among the evaluated deployment-compatible methods in three cohorts and outperforms two multimodal-to-unimodal baselines in all four. Ablations with a fixed reader also support the incremental benefit of the mapping objective.
Critical strengths
-
The deployment setting is practically relevant, and the method offers a distinctive way to use relationships derived from training-patient omics when predicting outcomes for new patients with histology alone.
-
The fixed-reader ablation provides evidence for the incremental contribution of the mapping objective, while results across multiple cancer cohorts support the broader utility of the framework.
Critical weaknesses
-
The geometry used for retrieval at deployment has not been clearly validated. Training optimizes image-to-omics relationships, whereas inference retrieves patients using image-to-image similarity. It is unclear whether the reported KL measure evaluates the neighborhoods actually used for retrieval. This gap limits the evidence that the learned alignment preserves the relationships needed by the deployed system.
-
The reliability of the small AUC gains is not sufficiently established. Some key comparisons improve AUC by only 0.002, and paired uncertainty intervals for the AUC differences are not provided. The current evidence therefore does not establish how reliably the full framework improves over strong baselines.
Questions for authors
-
Validation of deployment retrieval: Is the reported KL measure computed using the same image-to-image similarities and candidate patients used at inference? If not, what evidence shows that the actual retrieval neighborhoods preserve the intended omics-derived relationships?
-
Uncertainty of the gains: Can the authors provide paired uncertainty intervals for AUC differences against the strongest deployment-compatible baselines using matched evaluation splits, particularly for comparisons with gains around 0.002? Do those estimates support a reliable improvement?
We thank the reviewer for the clear and focused review, and for recognizing the deployment setting and the fixed-reader ablation. Both concerns are addressed with new analyses below.
Q1. Validation of deployment retrieval.
The KL in Table 2 measures slide-to-omics agreement, which is the quantity X-GeoSCL optimizes. To evaluate the retrieval geometry itself, we computed a second KL using the same image-to-image cosine similarity and the same candidate patients (the training-fold gallery) that are used at inference. It compares the molecular target distribution p (Eq. 2) with the distribution r induced by WSI-to-WSI similarity in the mapped space (τ=0.07, self-pairs excluded; mean ± SEM over five folds, lower is better):
X-GeoSCL gives the closest match to the molecular targets in all four cohorts, so the alignment learned across modalities carries over to the image-to-image space used for retrieval.
A second, functional test uses held-out patients directly. We replaced the K=10 retrieved neighbors with random training patients and retrained the reader. AUC on held-out patients drops in all four cohorts, with paired 95% intervals excluding zero on KIRC (+0.025 [0.009, 0.043]) and PAAD (+0.037 [0.006, 0.070]). The neighborhoods actually retrieved at inference therefore carry predictive molecular information that random neighborhoods do not. We will add both analyses to the paper.
Q2. Uncertainty of the gains.
We performed a paired fold bootstrap over the five matched test folds, enumerating all 3,125 possible resamples. We report ΔAUC=AUC(M2U)−AUC(baseline), with 95% CI (in bold).
Fold-bootstrap results:
On KIRC, M2U significantly outperforms WSI retrieval (+0.115), AMIL (+0.108), and TransMIL (+0.034). On LGG, it significantly outperforms TransMIL (+0.158), MoMKD (+0.170), and M$^2$Surv (+0.186), where AMIL is strong. On PAAD, the improvement over TransMIL (+0.204) is significant, while LUAD shows positive but statistically uncertain gains. No significant degradation is detected against any evaluated baseline.
Regarding the reviewer's concern about the +0.002 margin over M$^2$Surv on KIRC, the confidence interval [−0.059, 0.052] does not establish superiority. Differences against M$^2$Surv on LUAD (+0.054) and PAAD (+0.045) also remain within uncertainty. Overall, M2U is significantly better in 7 of 20 comparisons and not significantly worse in any; the improvements are cohort-specific rather than uniform.
Summary.
We addressed the questions and comments with new analyses: the retrieval space is measured with the same similarity and gallery used at inference, and every AUC difference, including the 0.002 margin, has a paired confidence interval.
We thank the reviewer for the comments and believe that they improved the paper.