- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes DuetMoE, a mixture-of-experts framework for fair medical image analysis. The authors consider two aspects of fairness: inter-subgroup fairness and intra-subgroup robustness. DuetMoE uses subgroup-specific routers and patient-specific clinical information to guide expert selection and feature processing. For datasets without clinical records, DuetMoE+ combines subgroup routing with KL-based distributionally robust optimization. Experiments are conducted on PI-CAI, radiotherapy, and Harvard-FairSeg datasets.
Critical strengths
-
The paper studies a meaningful problem in medical image analysis. Considering both inter-subgroup fairness and intra-subgroup robustness is reasonable, since good average performance cannot guarantee good performance for every patient.
-
The overall framework is well motivated. Combining subgroup information with patient-specific clinical context is an interesting direction for personalized medical image analysis.
-
The experiments cover different imaging modalities and clinical tasks, including prostate cancer detection, radiotherapy segmentation, and retinal segmentation. Both multimodal and unimodal settings are considered.
-
The experimental evaluation is relatively comprehensive. The authors compare with several fairness and segmentation baselines, and provide subgroup-level results, patient-level performance distributions, and ablation studies.
-
The proposed methods achieve improvements in several settings, especially in the worst-performing subgroups and low-performance patient groups. These results show some practical potential of the framework.
Critical weaknesses
-
Limited scalability and flexibility of subgroup-specific routing. This is my main concern. Fairness can be evaluated under many different sensitive attributes, such as age, sex, race, and institution. However, the proposed method requires a predefined subgroup partition and constructs a separate router for each subgroup. If the fairness attribute changes from institution to age or sex, it seems that the routers need to be reconstructed or retrained. Moreover, in real applications, multiple sensitive attributes may need to be considered simultaneously. Constructing routers for all combinations of attributes will introduce more parameters and data sparsity problems, especially for small subgroups. The method also requires subgroup labels during inference. Therefore, I think this design is difficult to scale to general fairness settings, and its practical applicability is limited. The paper does not sufficiently discuss or evaluate this issue.
-
Limited methodological novelty. The proposed framework mainly combines several existing techniques. Subgroup-specific routing is inherited from dMoE, clinical information is incorporated through standard cross-attention mechanisms, and the intra-subgroup optimization is based on existing KL-DRO. The two proposed variants also use different mechanisms to improve intra-subgroup robustness, rather than showing a unified solution. I think the paper does not clearly explain what new technical insight is introduced beyond combining these existing components. More importantly, the necessity of subgroup-specific MoE routing is not sufficiently justified. A simpler shared router conditioned on subgroup embeddings, or other conditional feature adaptation methods, may achieve similar results. The current experiments do not clearly show why the proposed routing design is necessary.
Questions for authors
See the weakness.