- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Visual Concept Transportation for SAM3 (VCT-SAM3), a training-free approach to few-shot semantic segmentation. The key observation is that SAM3 can propagate a concept from a visual prompt to other instances within the same image, whereas standard FSS provides the exemplar and target in separate support and query images. Instead of learning cross-image correspondence or concatenating the full support and query scenes, VCT-SAM3 extracts the annotated support foreground and inserts it into the query image. The inserted object and its tight bounding box then serve as an in-context visual prompt, allowing frozen SAM3 to discover and segment query instances of the same concept.
To choose a safe insertion location, the method constructs a semantic prior from SAM3 features. The authors observe positional bias in these features and introduce Position-Debiased Semantic Matching (PDSM), which estimates a position-related feature subspace from a content-free image and removes it before matching. The resulting prior protects likely target regions during support-object placement. The method requires no training and no auxiliary vision model.
Critical strengths
-
Transporting only the annotated object into the query turns a cross-image problem into within-image concept propagation, enabling SAM3 to perform both target discovery and segmentation without training or an external matching model. This is conceptually clean and practically attractive.
-
The foreground-cutout comparison isolates the effect of irrelevant support context, while random-subspace and content-free-input controls provide evidence that PDSM is doing more than arbitrary feature suppression. The paper also analyzes thresholds, rank, feature sources, placement feasibility, efficiency, and fold-level behavior, which substantially strengthens the empirical case.
Critical weaknesses
-
A pasted support object can differ from the query in scale, resolution, illumination, style, and boundary statistics. SAM3 may respond partly to copy-paste artifacts or contextual discontinuities rather than only to concept identity. The paper does not compare blending strategies, quantify artifact sensitivity, or test whether the approach remains reliable under strong support-query domain shifts. This issue is central because input manipulation is the mechanism of the method.
-
Experiments use only PASCAL-5i and COCO-20i with clean ground-truth support masks. The approach directly depends on accurate foreground extraction and available placement space, and multi-shot insertion can increasingly alter the query. Results under mask noise, crowded scenes, fine-grained concepts, parts, and cross-domain datasets are missing. The fold-level PASCAL 5-shot results also show that adding more support evidence does not consistently outperform existing methods.
Questions for authors
-
How sensitive is VCT-SAM3 to copy-paste artifacts? Please compare hard cutout insertion with alpha blending, boundary smoothing, color/statistics matching, and a control that pastes an unrelated object or the correct object with a deliberately artificial border. These experiments would help determine whether SAM3 follows the intended concept rather than synthetic-image cues.
-
How does the method perform with imperfect support masks? Please evaluate erosion/dilation, boundary corruption, missing object parts, and masks predicted by a realistic upstream segmenter. Since foreground isolation is a core advantage over tight-box crops, this directly affects the practical validity of the method.
-
Can the authors provide results on at least one cross-domain or specialized FSS benchmark and one fine-grained or part-segmentation benchmark? This would test whether PDSM and object insertion remain effective when support and query styles differ substantially or when semantic distinctions are subtle.
-
What explains the mixed PASCAL-5i 5-shot fold results? Please report performance as a function of the number of inserted support objects and compare inserting all objects with selecting one or a subset. An analysis of prompt interference would materially affect the assessment of the claimed few-shot scalability.
-
Beyond performance after subspace removal, what evidence shows that the estimated low-rank subspace specifically encodes position rather than other low-level or semantic statistics? Spatial probing or visualization across different content-free inputs and model layers would strengthen the interpretation of PDSM.
Dear Authors,
We are approaching the end of the discussion period, and I note that no response has been provided to the reviewers' comments.
Please confirm if you intend to submit a rebuttal. If you have decided to withdraw this submission, please officially withdraw it through the system. If you are no longer able to respond, I will proceed with the evaluation based on the current reviews on file.
Best regards, Area Chair