- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes SSL-SAM, demonstrating that on-the-shelf self-supervised pre-trained vision encoders already contains enough semantic representations to support promptable segmentation. SSL-SAM consists of several important components, including PGSE, FSG, and SCT. On multiple benchmarks, it achieves strong performance.
Critical strengths
- SSL-SAM is training-free and demonstrates promising performance compared with models in the SAM family.
- Extensive experiments are conducted to assess the effectiveness of the proposed methods.
Critical weaknesses
- Prototype-based segmentation built on DINO models is a well-established and extensively studied paradigm. The primary contribution of this paper lies in converting different types of prompts into prototypes. From this perspective, the paper’s overall contribution appears limited.
- Although SSL-SAM, unlike SAM, does not require training on large-scale annotated datasets, its performance still depends fundamentally on DINOv3, which has undergone large-scale unsupervised pretraining. Moreover, while the paper claims that SSL-SAM outperforms SAM across several prompt modes, SSL-SAM currently lacks support for some of SAM’s capabilities, such as text-based referring segmentation.
- In the experiments, why is evaluation limited to 200 randomly selected images from each dataset rather than the full dataset? Are SSL-SAM and SAM evaluated at the same image resolution? How does SSL-SAM ensure temporal consistency when applied to video object segmentation?
Questions for authors
Please refer to Weaknesses.