- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This work focuses on the significant heterogeneity in medical image federated learning, where different clients may vary in data modalities, model architectures, and learning objectives, making conventional federated learning difficult to apply through direct model sharing and aggregation. To address this issue, the authors propose xHetMed-FL, which preserves client-specific modeling while establishing a unified representation interface shared across clients, enabling clients with different modalities, network architectures, and supervision settings to collaboratively learn within a common federated framework.
Critical strengths
- The paper addresses a practically relevant and challenging federated learning setting, where heterogeneity exists simultaneously in data modalities, model architectures, and learning objectives across clients.
- The proposed framework is flexible in accommodating heterogeneous clients, allowing each client to retain its modality-specific preprocessing pipeline, encoder architecture, and learning objective rather than enforcing a unified local model.
- The framework provides a simple and modular design for heterogeneous federated learning, separating client-specific components from the federated component and thereby avoiding direct aggregation of structurally incompatible local models.
- The paper considers both supervised and self-supervised clients within the same federated framework, reflecting a realistic medical imaging scenario in which annotation availability may differ across institutions and modalities.
- The paper includes post-hoc explainability analysis for different types of clients, using modality-specific visualization and quantitative attribution statistics to provide additional analysis of the learned models and representations.
Critical weaknesses
- The validity of the shared representation is insufficiently verified because FedProx only constrains the shared projection parameters to remain close across clients, while parameter proximity does not demonstrate that the projection performs the same function or encodes semantically consistent knowledge across different modalities, architectures, and learning objectives.
- The paper does not demonstrate that federated collaboration itself improves performance because no local-only or non-federated baseline is provided.
- Comparisons with representative heterogeneous federated learning methods are missing, making it difficult to assess the practical advantage of xHetMed-FL over existing approaches. For example,
[1] FedRolex: Model-Heterogeneous Federated Learning with Rolling Sub-Model Extraction (NeurIPS 2022); [2] MH-pFLID: Model Heterogeneous Personalized Federated Learning via Injection and Distillation for Medical Data Analysis (ICML 2024); [3] Bridging the Generalization Gap of Heterogeneous Federated Clients Using Generative Models (ICLR 2026).
Questions for authors
- How do the authors demonstrate that the shared projection learns semantically consistent and transferable knowledge across heterogeneous clients?
- Does federated collaboration actually improve each client compared with local-only or non-federated training?
- How much does the shared projection itself contribute compared with independently trained client-specific projections?
- How does xHetMed-FL compare with representative existing federated and heterogeneous federated learning methods? Does the shared projection consistently benefit all clients, or does federated aggregation cause negative transfer for some clients?