- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes PinPoint, a training-free referring image segmentation framework using frozen vision-language models (VLMs) and SAM. Given a VLM-predicted bounding box, PinPoint combines color saliency, edge density, local entropy, and a Gaussian spatial prior to select informative interior points. A frozen VLM then labels these points as positive or negative, followed by confidence filtering and SAM-based segmentation. Experiments on RefCOCO, RefCOCO+, RefCOCOg, and ReasonSeg demonstrate competitive performance without task-specific training. Controlled comparisons and ablations investigate the contributions of point selection, semantic verification, and filtering.
Critical strengths
-
Convincing improvements under controlled experimental settings. The paper keeps the VLM, SAM, predicted bounding boxes, and maximum point budget fixed when comparing prompt-selection strategies. PinPoint consistently improves over bounding-box-only prompting and uniform point sampling. The additional comparisons with non-uniform point selectors in Appendix H further strengthen the empirical evidence.
-
A practical training-free framework. PinPoint improves segmentation without task-specific model updates. The ablation studies demonstrate that point selection, semantic verification, and confidence filtering jointly contribute to performance, highlighting the importance of prompt construction in frozen VLM–SAM pipelines.
Critical weaknesses
-
Limited methodological novelty. The overall select-then-label framework is closely related to SAM4MLLM's PQPP, which also samples points within predicted bounding boxes and uses a VLM to determine their labels. Furthermore, automatic point selection using visual cues has been explored in SAMAug. PinPoint primarily combines existing visual cues, spatial suppression, VLM verification, and confidence filtering. The distinct methodological contribution beyond these established techniques is therefore somewhat limited.
-
Insufficient evidence for the necessity of the full four-cue design. Appendix H shows that a simpler saliency-plus-Gaussian-prior selector with Soft-NMS already achieves 73.5/77.3/70.9 cIoU on RefCOCO val/testA/testB, compared with 75.9/81.7/71.1 for the full method. The additional gains are modest on some splits, particularly testB (+0.2). Moreover, Table 6 shows that adding the selected points as positive prompts alone does not improve upon bounding-box-only segmentation; substantial gains emerge after VLM-based point labeling and confidence filtering. These results raise questions about the independent contribution of the proposed four-cue selection mechanism.
-
Incomplete comparisons with recent training-free RIS methods. Although the paper includes several relevant baselines, it does not discuss or compare recent training-free approaches such as RefChess (ICML 2026) and Hybrid Global-Local (CVPR 2025). While these approaches differ in their inference mechanisms, discussing their technical differences and providing comparisons under compatible protocols would help establish PinPoint's competitiveness within recent training-free RIS research.
-
Unclear hyperparameter selection protocol. Appendix B repeatedly refers to both validation and testB performance when justifying the default hyperparameter settings. It is therefore unclear whether testB results influenced parameter selection. If so, the independence of the reported test evaluation would be compromised. The authors should clarify whether all hyperparameters were fixed using validation data before examining test results.
-
Limited evidence of generalizability and practical efficiency. The main experiments rely on a single Qwen2.5-VL-7B and SAM 2-L configuration. It remains unclear whether the proposed point-selection strategy and confidence filtering generalize to other foundation models, especially since verbalized confidence scores can be model-dependent. Additionally, although point selection itself is lightweight, the complete pipeline requires two VLM calls and approximately 4.95 seconds per query on an A6000 GPU (Appendix F). More direct accuracy–latency comparisons would help clarify its practical advantages over alternative training-free methods.
Questions for authors
-
Methodological novelty: What are the key technical differences between PinPoint and SAM4MLLM's PQPP or SAMAug, beyond the choice and combination of point-selection heuristics?
-
Four-cue design: Given the strong results of the simpler saliency-plus-Gaussian-prior baseline in Appendix H, what additional evidence supports the necessity of the edge and entropy cues? Under what conditions do they provide consistent benefits?
-
Recent training-free baselines: Could the authors discuss and, where feasible, compare with RefChess (ICML 2026) and Hybrid Global-Local (CVPR 2025), considering differences in backbone models and inference budgets?
-
Hyperparameter selection: Were all default hyperparameters determined exclusively using validation data before examining testB results? Please clarify the experimental protocol.
-
Generalization and efficiency: Does PinPoint achieve consistent improvements with other VLM or SAM backbones? How does its end-to-end accuracy–latency trade-off compare with alternative training-free pipelines?