- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
Existing methods for multi-modal survival prediction may suffer from the loss of tissue context during patch aggregation and insufficient modeling of cross-modal interactions. To address this problem, the authors proposed Multimodal State Space Fusion (MSSF-Surv), a framework that preserves spatial organization before conditioning pathology readout on molecular profiles. In MSSF-Surv, the dual-granularity design can capture tissue architecture alongside callular morphology, while multidirectional state-space modeling can address long sequences of fine-graned WSI patches with linear complexity. Molecular queries can retrieve information from these spatially contextualized representations, rather than from isolated patch features. A shared statespace model combines the retrieved features with omics representations through modality-specific gates, linking tissue context to molecular information for survival prediction.
Experimental results on 6 TCGA cancer cohorts shows the effectiveness of the proposed methods.
Critical strengths
- Instead of just concatenating sequences or computing cross-modal attention directly across tens of thousands of visual tokens, the framework uses the omics profile as queries to compress pathology features. This keeps the sequence length strictly bounded for the final multimodal fusion stage, ensuring high efficiency and a lightweight design.
Critical weaknesses
-
The scanning method is a direct plug-and-play from standard 2D Vision Mambas. The authors do not incorporate domain-specific histopathological spatial priors—such as tissue-cluster-aware ordering, spiral trajectories, or morphological topology-guided scanning paths. Consequently, the architecture primarily combines pre-existing building blocks with limited foundational novelty for computational pathology.
-
While motivated by avoiding the Transformer bottleneck, the paper lacks hardware profiling metrics—such as peak GPU VRAM, FLOPs, training time, and inference throughput (seconds per slide).
Questions for authors
Please provide concrete hardware profiling metrics comparing MSSF-Surv against standard MIL baselines, specifically reporting: (1) peak GPU VRAM usage during training/inference, (2) FLOPs, and (3) inference latency per WSI (seconds per slide). I am willing to consider raising my score if the authors can convincingly address the following concerns during the rebuttal: