- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
In this paper, the authors propose VERA, a training-free framework for 3D referring segmentation. It constructs a query-relevant shortlist based on OneFormer3D instance proposals, with optional Grounding DINO recovery and preserves each point-level mask. Subsequently, a frozen MLLM validates the candidate schemes through global, contextual, and object-level visual evidence, and may revise the initial selection through pairwise comparisons. The final selected proposal mask is returned as the segmentation result. Experiments are conducted on the ScanRefer, Nr3D, and Multi3DRefer datasets.
Critical strengths
1.The paper addresses a useful problem: reducing dependence on expensive annotations between language semantics and point-level information. Separating 3D candidate region generation from MLLM-based semantic selection makes sense, as the perceptual model provides point-level masks, while MLLM handles language understanding and instance disambiguation. 2.The use of global views, RGB context, and object crops is well motivated. These cues cover scene layout, spatial relations, and appearance, while self-refinement provides a reasonable alternative that allows for direct acceptance of top-ranked proposals. 3.The evaluation covers ScanRefer, Nr3D, and Multi3DRefer and reports competitive training-free results. In particular, the self-refinement improves ScanRefer Multiple mIoU from 29.8 to 41.0, and the ablations support the value of the proposed visual inputs.
Critical weaknesses
1.The difference in methodology between VERA and recently untrained 3D grounding agents is not yet fully clear. Especially, SPAZER also utilizes global and local visual evidence to validate 3D candidates. VERA preserves a point-level mask for each candidate and adds conditional refinement for 3D referring segmentation, but the paper does not clearly show whether its validation mechanism itself is new or mainly based on improvements to existing paradigms. 2.Table 3 supports the overall benefit of self-refinement and its visual evidence sources. However, it does not isolate candidate verification, alternative candidate search, and pairwise comparison, so the contribution of each decision stage is not yet unclear. 3.VERA directly returns masks from OneFormer3D, thus setting strict performance limits on candidate region recall and mask quality. Although the paper cites OneFormer3D, it does not identify the exact checkpoint or the data used to train that checkpoint, which is crucial for understanding the statement 'no training required'. In addition, all three benchmark tests used the ScanNet scenario, so the cross dataset generalization ability is not clear. 4.The actual benefits of the Candidate Filter have not yet been fully determined. Table 4 only reports the improvement of the oracle candidate metrics and does not show whether the Candidate Filter has improved the final performance [email protected] Or mIoU. Figure 3 reports per-query inference time for different MLLMs, but does not separately list the Candidate Filter or additional costs for self-improvement.
Questions for authors
1.What specific changes does VERA make to candidate verification and refinement compared with SPAZER, beyond retaining point-level masks for 3D referring segmentation? 2.Could the authors isolate the contributions of candidate verification, alternative search, and pairwise comparison? Table 3 establishes the overall gain, but does not distinguish these decision stages. 3.Which OneFormer3D checkpoint and training data were used? Could the authors assess whether VERA's results hold with a different proposal backbone or on scenes outside ScanNet? 4.How much does the Candidate Filter change final [email protected] and mIoU, and how much additional inference time does it require?