- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper first evaluates the segmentation performance of SAM/SAM 2 on medical images under oracle settings and investigates their preferences for different prompt modes. It then proposes RFMedSAM 2, which first uses a UNet to generate masks for prompt generation and subsequently leverages SAM 2 to refine the segmentation using inter-frame relationships. To bridge UNet and SAM 2, the authors further introduce an adapter designs termed QRefine-Former. However, this paper reads more like an evaluation report and engineering adaptation of SAM/SAM 2 to medical domain. The technical novelty is limited, the effectiveness of the proposed method is not sufficiently validated, and the emphasized SAM-based refinement brings only marginal improvements over the UNet predictions. Therefore, I do not think this paper is suitable for publication at ICLR.
Critical strengths
-
The paper provides a detailed evaluation of SAM/SAM 2 under different prompt modes for medical image segmentation, which may provide useful information for future work.
-
The engineering organization and integration of the proposed framework are reasonable.
Critical weaknesses
-
The technical innovation is quite limited. Adapting SAM/SAM 2 to volumetric medical image segmentation has already been widely studied, including approaches with automatic prompt generation [1,2,3]. It is therefore unclear what substantial advantages the proposed method offers over these existing approaches.
-
The contribution of the proposed QRefine-Former also appears limited. For example, the DSC improves only from 0.867 to 0.868 on BTCV, from 0.907 to 0.910 on AMOS-CT, and from 0.884 to 0.886 on AMOS-CTMRI. Improvements of this magnitude could potentially result from experimental randomness. It is unclear whether these improvements are robust and whether QRefine-Former is effective.
-
I am also concerned that, according to Table 6, SAM 2 provides only marginal refinement over the UNet segmentation, with improvements of 0.003 DSC on ACDC, 0.005 on BTCV, and 0.002 on AMOS-CTMRI. This suggests that SAM 2 contributes very little to the final segmentation performance on these datasets, while introducing substantial additional model parameters and computation compared with U-Net alone. So why is SAM 2 even needed in this framework?
-
The authors claim that their method provides efficient adaptation. However, the efficiency analysis is mainly limited to parameter counts. Computational costs such as FLOPs, GPU memory consumption, and inference speed are not reported, although these metrics are important for practical applications. I suggest that the authors provide these results and compare them with other baselines.
[1] Xing Y, Wu J, Bu Y, et al. SAM2-SGP: Enhancing SAM2 for medical image segmentation via Support-Set Guided Prompting[J]. arXiv preprint arXiv:2506.19658, 2025. [2] Li C, Ibn Sultan R, Khanduri P, et al. Autoprosam: Automated prompting sam for 3d multi-organ segmentation[C]//Proceedings of the Winter Conference on Applications of Computer Vision. 2025: 3570-3580. [3] Xie B, Tang H, Duan B, et al. Masksam: Towards auto-prompt sam with mask classification for volumetric medical image segmentation[J]. arXiv preprint arXiv:2403.14103, 2024.
Questions for authors
Please see weakness for the questions.