- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes PoPNet to bridge the gap between vision foundation model (VFM) representations and the task-specific features needed for medical image segmentation. It also introduces a reconstruction loss to support segmentation training. Although the VFM integration strategy seems a little boring, the reconstruction loss is somehow interesting.
Critical strengths
-
Clear presentation. The paper is well organized, and the figures clearly illustrate the key components and workflow, making the method easy to follow.
-
Broad experimental coverage. Although the choice of VFM (mainly using general VFM) limits the experiments to 2D medical image segmentation, the evaluation covers multiple datasets under both supervised and semi-supervised settings. The appendix also reports repeated runs with different random seeds, making the evaluation more complete.
Critical weaknesses
- Lack of 3D medical image segmentation setting.
- Even if general VFMs are difficult to apply directly to 3D data, models pretrained on 3D medical images, such as VoCo, Hi-End-MAE, MambaMIM, and nnFoundation, could provide feature priors. The reconstruction loss also appears straightforward to extend to 3D. Given the importance of 3D segmentation in medical imaging, the lack of these experiments limits the evidence for PoPNet’s generality.
- Some ablations of key components.
- The method introduces spectral clustering regularization to combine VFM representations with bottleneck features. However, how would performance change if spectral embedding prediction and feedback modulation were removed, leaving only gated fusion?
- Is a VFM necessary? What happens if it is replaced with a plain ViT (or some hierarchical variants) trained from scratch? How do segmentation gains vary with VFM size, and do stronger VFM representations lead to better segmentation? Do these designs can extend to 3D medical image segmentation?
- PoPNet appears to be a general framework whose designs could, in principle, transfer to U-shaped segmentation networks beyond U-Net. The authors should evaluate whether these designs yield consistent improvements across different network architectures.
Questions for authors
I hope the authors can address the concerns raised in the Weaknesses section above and provide further clarification on reproducibility:
- The paper does not include a reproducibility statement, usually placed before the References section, or describe any plans to release the code.