- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes Hierarchical Gating Mixture-of-Experts (HG-MoE) for joint medical image segmentation across heterogeneous, known domains. Built on Swin-U-Net, the intended approach combines input-adaptive feature modulation with domain-guided expert allocation. The first component aims to improve the representations available to the experts, while the second uses domain-related information to select and combine experts. The method is evaluated on mixed-domain organ segmentation using FLARE22 and AMOS22, and separately on lesion segmentation using MSWAL. The evaluation includes comparisons with existing methods, ablations of the two gating components, and additional two-dimensional and three-dimensional visualizations.
Critical strengths
Learning a shared segmentation model while accommodating differences between data sources is a meaningful problem. The paper considers feature representation and expert allocation together, rather than treating routing as an isolated operation. The idea that better representations may support more useful expert selection is plausible and worth investigating.
Critical weaknesses
- The mixed-domain experiments focus primarily on abdominal organ segmentation, with substantial overlap in anatomical structures and segmentation targets across the selected datasets. Although the datasets differ in imaging modality and provenance, the evaluation does not clearly establish what specific difficulties these differences create for a shared segmentation model or how the proposed domain-aware mechanism addresses them. The current benchmark therefore provides limited evidence for the necessity of the proposed design and its ability to handle domain heterogeneity.
- The approach primarily augments an existing segmentation backbone with domain-aware processing and expert allocation, followed by joint training on mixed-domain data. While this is a reasonable design, it currently appears more like a combination and extension of established mechanisms than a clearly differentiated methodological contribution. The experiments also do not establish what substantial advantage the two-level gating provides over simpler domain-conditioned alternatives. Further evidence is therefore needed to show that the added mechanisms deliver benefits commensurate with the paper’s claimed contribution.
Questions for authors
- How should the Top- aggregation in Eqs.(7)-(8) be reconciled with the all-expert aggregation described in Appendix~A.3.1? Please specify the value of , whether routing is performed per token or per sample, and whether the router uses or . A consistent forward-pass description should also explain the roles of the bottleneck task gate and task-specific segmentation heads, together with the complete training objective.
- What benefit does the proposed hierarchy provide over a shared Swin-U-Net, a standard Top- MoE with conventional load balancing, and a simpler domain-conditioned router? Please clarify whether initialization, training data, domain supervision, output heads, and model capacity are controlled in Table~5. The discussion should also explain the operational differences from and SegMoTE. Direct comparisons with SegMoTE's reported scores would require matching the prompting and evaluation conditions.
- The macro-level router relies on a predicted domain identity at inference. Please report domain-recognition accuracy and explain how uncertain or incorrect predictions affect expert selection. Comparing routing based on ground-truth and predicted domain identities would help determine whether the segmentation gains depend on reliable domain recognition and how much performance is lost when that assumption fails.