- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The authors proposed a method called MaskMed. It brings Mask2Former-style mask classification into an nnU-Net framework, with three novel contributions: (1) Masked Multi-Scale SegHead, (2) Finest-scale bipartite matching, and (3) FSD-Transformer. The method is comprehensively evaluated across four benchmarks; it reports gains over nnU-Net on AMOS22 Task 1 (+2.0) and Task 2 (+1.3), ACDC (+1.7), BTCV (+0.9), and BraTS23 (+1.0).
Critical strengths
-
The paper has a comprehensive evaluation on four benchmarks across different modalities CT, MRI, cardiac and brain tumor data, with official leaderboard submissions for AMOS and BraTS.
-
Sharing the finest-scale matching across stages is a good fix for deep supervision under bipartite matching.
-
The 3D MaskFormer and Mask2Former baselines isolate the effect of the mask-classification paradigm itself. This is good to clarify the novelty.
-
The paper discusses efficiency and lists limitations, which is very informative.
Critical weaknesses
-
The novelty is somehow overstated. Mask2Former-style query decoders with masked cross-attention for 3D medical segmentation already exist. 3D TransUNet (Chen et al., 2023) uses learnable queries with coarse-to-fine masked attention on a U-Net backbone. MaskSAM (you already cited) is also mask classification for volumetric segmentation. Deformable multi-scale attention bridging CNN encoder features was introduced for 3D medical segmentation by CoTr (Xie et al., MICCAI 2021).
-
Its not clear if each baseline number comes from re-run under the same protocol, or copied from leaderboards and papers. Please clarify that.
-
MaskSAM appears for AMOS Task 1 but is dropped from Task 2. Its Task 1 margin (0.905 vs 0.913) is the smallest in the paper. Please be consistent and have apple-to-apple comparison with benchmarks and existing methods.
-
Missing efficient transformer baselines on BTCV and ACDC (Tables 2 and 3). Please add these efficient hybrid transformers designed for volumetric segmentation, which are missing from both tables: UNETR++ [1], Slim UNETR [2], and MedNeXt [3].
[1] A. Shaker, M. Maaz, H. Rasheed, S. Khan, M.-H. Yang, and F. S. Khan. UNETR++: Delving into Efficient and Accurate 3D Medical Image Segmentation. IEEE Transactions on Medical Imaging,
[2] Y. Pang, J. Liang, T. Huang, H. Chen, Y. Li, D. Li, L. Huang, and Q. Wang. Slim UNETR: Scale Hybrid Transformers to Efficient 3D Medical Image Segmentation Under Limited Computational Resources. IEEE Transactions on Medical Imaging,
[3] S. Roy, G. Koehler, C. Ulrich, M. Baumgartner, J. Petersen, F. Isensee, P. F. Jaeger, and K. H. Maier-Hein. MedNeXt: Transformer-driven Scaling of ConvNets for Medical Image Segmentation. In Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2023.
Questions for authors
-
Which split does each of Tables 1 and 5–11 use?
-
Were any design or hyperparameter choices made using test-leaderboard results?
-
How were the 3D MaskFormer and Mask2Former baselines tuned, and did they get the differential learning rates?
-
How does MaskMed compare with 3D TransUNet, UNETR++, nnU-Net, and MedNeXt?
Follow-up with the authors
Dear authors,
I have read the other reviewers’ comments and would appreciate a rebuttal addressing both the concerns I raised and the ones identified by the other reviewers. If these concerns remain unaddressed, I may lower my score.
Thanks!