- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The authors propose a JEPA-based pretraining framework for multi-view cardiac MRIs, focusing on feature consistency between long-axis views. Their evaluation focuses on cross-view phenotype prediction, while additional representation analyses (including probes and retrieval) are also provided.
Critical strengths
1. Multiple Evaluations and Analyses
The authors provide multiple evaluations of their representations, including probing, retrieval, and cross-view transfer. Additional ablation studies are provided in the appendix. Note that despite the abundance of evaluations and analyses, the resulting findings are hard to follow because many evaluations are not clearly motivated (see also weakness 2)
Critical weaknesses
1. Limited Contributions with unclear motivation
The proposed work is a minor adaptation of the JEPA framework to cardiac MRI representation learning. However, the authors’ method contributions are very limited, as similar JEPA-based frameworks have been widely studied:
- Multi-modal JEPA frameworks have conceptual similarities with the proposed method. For example, M3-JEPA [1] uses a cross-model predictor, making it conceptually very similar to the cross-view predictor proposed in this work (while differing in implementation details). However, the authors did neither cite nor compare their work to any multimodal JEPA framework.
- MR-JEPA (already cited by the authors) has already explored JEPA on cardiac MRIs, although they ignored multi-view relationships.
Furthermore, their contribution focuses solely on multi-view alignment and cross-view transfer of long-axis views. It is unclear or not thoroughly motivated:
- Why focus on shared features (alignment) instead of learning to fuse information from multiple views (like many multimodal JEPA frameworks)
- Why is cross-view transfer performance so relevant? If we want to focus on inference with only a subset of views (or just a specific view), why can’t we simply train on that specific view if training data is typically available anyway (as the common cardiac MRI acquisition strategy contains several long-axis views)
- Why the authors focus on long-axis views while ignoring short-axis views
Overall, the chaotic structure of the paper makes it hard to understand the motivation of the proposed method, while the method contributions appear minor. Without clear motivation and significant contributions, the proposed work is of limited relevance to the machine learning community.
[1] Lei, Hongyang, et al. "M3-jepa: Multimodal alignment via multi-gate moe based on the joint-embedding predictive architecture." ICML 2025, arXiv:2409.05929 (2024).
2. Inconsistent Selection and Presentation of Evaluation Tasks with Sometimes Limited Performance Benefits
The selection of evaluation tasks (i.e., target classes/phenotypes) is not well motivated and is inconsistent between sections and with existing literature. Furthermore, the presentation of the experiments and results makes it hard to follow the paper and judge the performance benefits of the proposed method and understand the overall findings. Specifically:
- In 5.1 (cross-view prediction) the authors evaluate on 17 image-derived phenotypes while in 5.5. (frozen representations), they consider only 2 (LVEF and RVEF)
- Evaluation on disease labels, which is commonly done in previous cardiac MRI pretraining / foundation model works, is hidden in the appendix and only aggregated results are discussed. Notably, on several tasks, the proposed method underperforms the contrastive baseline (see Table S17 on p. 23). Furthermore, some baselines are excluded from this table
- The target mixture experiment (Sec. 5.3) is not motivated and the resulting findings are unclear.
Overall, the many different cohorts and evaluations without clear motivation, consistent targets, and consistent baselines, while being scattered between the main paper and the appendix, make it hard to judge the actual benefits of the proposed method in comparison to existing works. The paper focuses heavily on cross-view prediction performance (without providing motivation for why it is relevant), while lacking a clear, coherent presentation of the typical downstream performance (e.g. diagnosis) that is common in similar works.
Questions for authors
- Why focus on shared features (alignment) instead of learning to fuse information from multiple views (like many multimodal JEPA frameworks)
- Why is cross-view transfer performance (contribution (ii)) so relevant?
- What about short-axis views?
- What is the purpose of the target mixtures in Sec. 5.3