- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes a neural architecture search framework for 3D medical image segmentation that separates local feature extraction from global context aggregation. The central design introduces two learned components: a searched local cell that combines wavelet transforms, convolutions, and channel weighting operations within a differentiable search space, and a Communication Unit (CU) that exchanges information across multiple parallel network clones through a gated cross-clone messaging mechanism. The motivation is that existing segmentation networks couple local and global operations within the same architectural units, making it difficult to independently optimize each. By decoupling these roles and searching for efficient local cells, the framework aims to reduce the parameter count and FLOPs of the search supernet while maintaining competitive segmentation accuracy.
The framework is evaluated on multiple 3D medical segmentation benchmarks including Synapse multi-organ segmentation, and supplementary 2D experiments are also provided. Ablations examine the contribution of the CU, the searched versus hand-designed cells, clone count, network depth, wavelet operations, and computational cost. The appendix provides detailed analyses of communication patterns, clone scaling, depth sensitivity, wavelet component effects, and efficiency comparisons.
Critical strengths
S1: The decoupled design of local search and global expansion has practical value. Separating the searched local cell from the cross-clone communication module provides a cleaner architectural decomposition than methods that couple these roles. The reported reductions in supernet parameter count and FLOPs relative to comparable search frameworks are meaningful from an efficiency standpoint.
S2: Experiments cover multiple 3D segmentation tasks with 2D supplementary results. The evaluation is not limited to a single benchmark, and the inclusion of both 3D and 2D settings provides broader coverage than is typical for architecture search papers in medical imaging.
S3: The appendix provides relatively rich supporting analyses. Analyses of communication patterns, clone count scaling, network depth, wavelet component contributions, and computational cost are included, which gives reviewers more material to assess the design choices than the main paper alone would allow.
Critical weaknesses
W1: The architectural advantage of multi-clone expansion is not sufficiently isolated. The paper motivates multi-clone expansion as a way to achieve a favorable accuracy–cost tradeoff. However, the clone-number ablation changes model capacity and computational cost together with the number of clones. It therefore does not establish whether the gains arise specifically from the multi-clone organization or from increased capacity. A comparison with a wider single U-Net using the same searched cells and PAM, under matched parameter or computational budgets, would help isolate the benefit of clone-based expansion. The existing results demonstrate the effectiveness of the overall system, but provide limited evidence that this macro-architectural choice offers an advantage over alternative ways of allocating the same budget.
W2: The benefit of gated communication remains confounded with additional model capacity. In Table 12, replacing No Comm. with CU increases the parameter count from 26.92M to 42.86M, approximately 59%. Direct addition improves performance with almost no parameter increase, supporting the usefulness of cross-clone communication. However, the additional improvement achieved by CU cannot be cleanly attributed to its gating mechanism, since CU also introduces substantial convolutional capacity. Although the authors acknowledge this limitation, two controls would strengthen the attribution: retaining all CU convolutions while blocking cross-clone messages, and comparing against a parameter-matched non-gated fusion module. These comparisons would help distinguish the effects of communication, gating, and additional feature transformation.
W3: The advantage and stability of the architecture search require stronger evidence. Table 8 shows that replacing hand-designed cells with searched cells improves Dice by 0.69 percentage points without CU and PAM, and by 2.25 percentage points with both modules. These results support the usefulness of the discovered architecture. However, the hand-designed baseline relies on standard convolutions and average pooling and does not establish whether the search procedure outperforms simpler alternatives within the same operation space. Budget-controlled comparisons with randomly sampled architectures and stronger manually configured cells would help distinguish the benefit of architecture search from that of the search space itself. In addition, the paper does not clearly establish whether the reported three runs include independent architecture searches or only retraining of a fixed searched architecture. Reporting variability across independent searches would strengthen the evidence for the robustness of the search procedure.
Questions for authors
The independence between architecture selection and final evaluation is unclear. Appendix D.1 states that network depth, node count, and clone count are chosen based on validation Dice and efficiency, and Appendices E.4–E.6 present these comparisons on Synapse. The main Synapse results use 18 training cases and 12 validation cases. It is therefore unclear whether the 12 validation cases used to select clone count, depth, and node count are the same cases used to report the main results. If they are, the reported numbers serve simultaneously as model selection criteria and final evaluation, which introduces optimistic bias from selection. Three training runs with different random seeds do not resolve this issue. The authors should clarify the data usage at each stage, confirm whether an independent held-out set or nested validation was used, and state whether baseline methods received a comparable hyperparameter tuning budget.