- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper presents DINO-KNN, a training-free method for one-shot multiclass in-context segmentation based on frozen DINOv3 features and nearest-neighbor classification. The method adopts the positional debiasing technique from INSID3, constructs a labeled feature bank from a single reference image, and assigns each target patch a semantic label through inverse distance weighted k-NN voting. DINO-KNN also jointly predicts multiple foreground classes and background without the learned segmentation decoder and class-wise inference.
Critical strengths
The proposed method requires no task-specific training, additional segmentation decoder, or auxiliary foundation model. Its straightforward design makes it easy to implement and potentially useful as a practical baseline for in-context segmentation.
The experiments cover seven datasets from different visual domains. The results demonstrate that simple feature-based classification can be competitive with more elaborate training-free segmentation pipelines.
DINO-KNN substantially outperforms INSID3 on CAMUS, FASS, and PSFHS. These results suggest that direct feature matching can be preferable to clustering-based segmentation in certain domains.
Critical weaknesses
The main method is based on standard k-NN classification over frozen DINOv3 features, with positional debiasing adopted from INSID3. The main contribution appears to be a simpler application of existing techniques rather than a substantially new method. Therefore, I believe this paper lacks novelty.
Section 4.1 in this paper states that the foreground label set contains only the classes shared by the reference and target images. This raises a concern about whether target ground-truth information is used to construct the evaluation episodes. In a practical one-shot ICS setting, the classes present in the target image are not known beforehand.
The zero CCR is guaranteed by assigning a single label to each patch. Moreover, DINO-KNN-Binary already achieves a CCR of approximately 1% and nearly identical mIoU. Therefore, it is unclear how much the proposed joint multiclass prediction contributes beyond enforcing mutually exclusive labels.
Questions for authors
How is the foreground label set determined for each evaluation episode? Does the construction require access to the target annotations, and how would the results change if all classes in the reference annotation were retained?
Can the authors compare DINO-KNN with INSID3 using a post-hoc conflict resolution strategy? This would help clarify whether joint multiclass prediction offers an advantage beyond eliminating overlapping predictions.
DINO-KNN underperforms INSID3 on COCO and LVIS, while most of the average improvement comes from the ultrasound datasets. What explains this difference? How sensitive are the results to the choice of reference image?