- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes ARIADNE, a disambiguation-guided active perception framework for zero-shot 3D visual grounding. The method first decomposes natural-language referring expressions into visual claims and continuously tracks the unresolved claims for each candidate to identify missing evidence. Subsequently, its Relation-Centric Observation Construction (RCOC) module establishes a shared visual context for directly comparing candidates against anchor objects by providing three complementary views: local, stitched, and rendered. Next, the Online Evidence Transport (OET) module integrates graph and history regularization to model view selection as a transport problem, jointly matching and selecting the optimal next observation view for competing candidates. Experiments on the ScanRefer and Nr3D datasets demonstrate that this approach surpasses existing zero-shot visual grounding baselines in overall accuracy.
Critical strengths
(1) Zero-shot 3D grounding is an important research question with great potential. The paper identifies a critical bottleneck in current zero-shot 3D visual grounding: static object-centric or global perspective views often fail to capture the shared visual context and spatial relations needed to distinguish similar candidates. The motivation to use "unresolved visual claims" to actively guide the perception loop directly addresses this candidate disambiguation problem, making the approach intuitive and valuable.
(2) The proposed framework forms a complete and logically sound perception loop. Specifically, formulating the joint view selection for multiple competing candidates as an optimal transport problem (Online Evidence Transport) is insightful.
(3) The paper achieves leading results on two major benchmarks (ScanRefer and Nr3D) compared with other zero-shot baselines. The ablation studies systematically verify the individual contributions of different view sources (Local, Stitch, Render), the OET module, and its specific regularization terms.
Critical weaknesses
(1) While the paper acknowledges that the active perception loop increases inference time and token usage, it lacks concrete quantitative comparisons of computational overhead against baselines like SPAZER or SeqVLM. This makes it difficult to evaluate the framework's efficiency for real-world deployment.
(2) The disambiguation loop completely relies on pre-generated object proposals. If the target object is missed or incorrectly merged during the initial generation or filtering stages, the system cannot rediscover it during active exploration, limiting its fault tolerance.
(3) The experiments primarily rely on Seed 2.0 Lite (with a brief mention of DeepSeek in the appendix). The paper lacks a comprehensive evaluation using a broader, diverse set of widely adopted and smaller open-source MLLMs (e.g., Qwen series from 9B-27B-35BA3B). This leaves the framework's generalizability and robustness across different MLLM backbones insufficiently validated.
(4) Lack of discussion and comparison of recent and highly relevant works [1]
[1] Think, Act, Build: An Agentic Framework with Vision Language Models for Zero-Shot 3D Visual Grounding, 2026 EMNLP
Questions for authors
Please see the weakness.
3 comments
Response to Reviewer g4cX (continued)
W3: Does ARIADNE generalize to smaller open-source MLLM backbones such as the Qwen series?
With fixed prompts and no backbone-specific tuning, ARIADNE generalizes to open-weight Qwen backbones (9B–27B; reported here and to be added to the main text) and to DeepSeek-V4.1-Flash (Table 8 in the Appendix of the paper). First, under the same backbone, ARIADNE is the best of the four frameworks:
| MLLM backbone (ScanRefer [email protected] / @0.5, 250 queries) | SeeGround | SeqVLM | SPAZER | ARIADNE (Ours) |
|---|---|---|---|---|
| Seed 2.0 Lite | 53.2 / 47.6 | 57.2 / 52.0 | 60.8 / 52.8 | 62.4 / 55.6 |
| Qwen3.8-27B | 52.8 / 45.6 | 53.6 / 47.6 | 58.4 / 50.8 | 61.6 / 54.4 |
| Qwen3.6-27B | 51.6 / 45.2 | 52.0 / 46.4 | 57.6 / 49.2 | 59.6 / 52.4 |
On Qwen3.8-27B, ARIADNE beats SPAZER (+3.2% / +3.6%), SeqVLM (+8.0% / +6.8%, at [email protected] / at [email protected]), and SeeGround (+8.8% / +8.8%, / ); on Qwen3.6-27B, it beats SPAZER (+2.0% / +3.2%), SeqVLM (+7.6% / +6.0%, / ), and SeeGround (+8.0% / +7.2%, / ). Second, ARIADNE itself stays strong across backbones:
| MLLM backbone | ARIADNE on ScanRefer ([email protected] / @0.5, 250 queries) |
|---|---|
| Seed 2.0 Lite | 62.4 / 55.6 |
| DeepSeek-V4.1-Flash | 61.2 / 54.0 |
| Qwen3.8-27B | 61.6 / 54.4 |
| Qwen3.6-27B | 59.6 / 52.4 |
| Qwen3.5-27B | 60.0 / 53.2 |
| Qwen3.5-9B | 51.6 / 45.6 |
It is worth noting that a 9B model is not a common setting: prior zero-shot 3DVG work uses backbones of about 30B parameters or larger, or proprietary models such as GPT-4o. In this common setting (Seed 2.0 Lite, DeepSeek-V4.1-Flash, and three 27B Qwen models), ARIADNE consistently reaches 59.6–62.4 / 52.4–55.6, showing that its agentic workflow transfers across MLLMs without any tuning.
W4: Missing discussion of and comparison with the recent TAB (EMNLP 2026)
Thank you for pointing to TAB (EMNLP 2026), an insightful concurrent agentic framework for proposal-free 3DVG that combines 2D detection/segmentation (Grounding DINO + SAM3) with VLM reasoning and is a useful point of comparison; we will cite, discuss, and compare with TAB in Sections 2 and 4 of the revised manuscript. However, TAB targets a complementary bottleneck with different trade-offs: its 13-step skill commits to the target on one static reference frame from raw video before tracking 2D masks, whereas ARIADNE performs dynamic multi-round disambiguation across competing 3D candidates driven by unresolved claims (parts of the query not yet verified for a candidate) and synthesizes views beyond raw video frames (stitched panoramas and targeted renders). For a fair comparison, we give ARIADNE SAM3 2D masks and the refined queries introduced by TAB (manually rewritten queries):
| Method (250 queries per benchmark) | ScanRefer [email protected] / @0.5 | Nr3D Acc. |
|---|---|---|
| TAB (proposal-free) | 71.2 / 46.4 | 68.0 |
| TAB (with Mask3D proposals) | 71.6 / 61.6 | 67.2 |
ARIADNE (Ours, with SAM3 2D masks and refined queries) | 72.6 / 64.0 (mean of two runs) | 77.2 |
TAB's numbers are computed from its officially released inference results. With these inputs, ARIADNE beats TAB on both benchmarks: 72.6 / 64.0 vs. 71.6 / 61.6 on ScanRefer and 77.2% vs. 67.2% on Nr3D (+10.0%). Because the two methods start from different perception inputs, we also compare them on the 208 ScanRefer queries where our proposals contain the target, so that both are judged only on disambiguation: there ARIADNE is correct on 75.0% vs. 71.6% for TAB. Given the same perception inputs as TAB (the table above), ARIADNE still grounds the target more accurately, which confirms that its advantage comes from the multi-round disambiguation workflow itself rather than from its perception inputs.
Brief summary of our responses
Dear Reviewer g4cX,
Thank you again for your thoughtful review. We appreciate your time during this busy period, and as the discussion comes to a close, we briefly summarize our main responses below.
We added stage-split runtime, call, and token comparisons (10.2 s median single-query time, 3.3×–5.6× faster than prior baselines and 45× fewer calls than TAB) and evaluated simple proposal-recovery fallbacks (lifting ScanRefer from 62.4 / 55.6 to 66.8 / 58.8, and Nr3D target coverage from 84.0% to 98.0% and accuracy from 68.0% to 72.4%). Across open-weight Qwen MLLMs (9B–27B), ARIADNE remains the strongest framework (61.6 / 54.4 on Qwen3.8-27B, 59.6 / 52.4 on Qwen3.6-27B), and with SAM3 masks and TAB's refined queries it surpasses concurrent TAB on both ScanRefer (72.6 / 64.0 vs. 71.6 / 61.6) and Nr3D (77.2% vs. 67.2%).
We welcome any feedback on whether our responses address your concerns, and we would be glad to clarify any remaining questions.
Response to Reviewer g4cX
Thank you for your careful, constructive review and for recognizing our unresolved-claim active perception loop, Online Evidence Transport formulation, and systematic ablations. Our General Response also summarizes six studies on equal-budget planning, score-matched OET, runtime/token efficiency, extended-set evaluation and five-run stability, results with open-weight Qwen MLLMs, and proposal fault tolerance and
TAB. We address your questions and concerns below.W1: How does ARIADNE's computational overhead compare quantitatively with SPAZER and SeqVLM?
ARIADNE's median single-query time is the lowest among the compared methods (10.2 s vs. 37.9 s for SPAZER, 57.1 s for SeqVLM, and 34.1 s for SeeGround), because its extra MLLM calls (6.5 vs. 1.9 on average) are spent only on the 34% of queries still ambiguous after initial screening. Below we report single-query time (one query at a time), MLLM calls, and tokens on ScanRefer under the same MLLM; for TAB, times and proposal-free accuracy come from its paper, while calls and tokens were measured on 20 random queries using its released code and MLLM (to be added to the revised manuscript):
SAM3masks and refined queries; please see the response to W4)W2: The loop depends on pre-generated proposals: can a missed or merged target be recovered (fault tolerance)?
We agree: in the paper setting, a target missed or merged during proposal generation or filtering cannot be rediscovered by the disambiguation loop. This was a deliberate compromise for fairness: like prior zero-shot 3DVG work, ARIADNE uses pre-generated Mask3D proposals and prior class-name filters (SeqVLM's on ScanRefer, SPAZER's on Nr3D) without modifying proposals or recovering lost objects, so Tables 1–2 and 6 isolate our active disambiguation workflow rather than better perception. To add fault tolerance rather than a benchmark-specific design, we tested two simple, generic fallbacks (reported here; the limitation in Appendix C will move to the main text); prior pipelines already use similar fallbacks (SPAZER screens all proposals on zero label match; SeqVLM's code falls back to ZSVG3D on VLM failure), whereas our paper used none. (i) Zero-match fallback: if no candidate passes the target category, screen the remaining scene proposals. (ii) 2D open-vocabulary masks (
SAM3, as in TAB): also keep proposals supported by 2D masks of the target class. Each alone recovers lost targets:SAM32D masks onlyThe same fallbacks also help on Nr3D (250 queries). In the paper setting, the target is among the candidates for 84.0% of queries and accuracy is 68.0% (Table 2 of the paper). With (i), accuracy rises to 69.2%; with (i) + (ii), the target is among the candidates for 98.0% of queries and accuracy rises to 72.4% (+4.4% over the paper setting). These gains show that ARIADNE's workflow improves directly with better perception inputs, further supporting its generality.