- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The submission addresses language-guided grounding in large-scale 3D Gaussian scenes. The method operates at query time without learning scene-specific semantic features. In the first stage, Active Query-guided View Exploration (AQVE), capture observations across views, accumulates visibility-aware positive and negative evidence, and then selects subsequent views based on the current hypotheses. In the second stage, Evidence-Guided Structural Refinement (ESR), combines multi-view foreground/background evidence with local geometric constraints to refine the selected Gaussian support. The submission also introduces AeroRef3D, a new benchmark covering four query types. The final results show significant improvements over the evaluated baselines. And the additional alblation experiments examine component contributions, backbone choices, and computational costs.
Critical strengths
-
The method addresses two distinct sources of issue rather than treating grounding as a single retrieval problem.
Distinguish similar targets and recovering their spatial extent require different evidence. The separation between AQVE and ESR is well motivated, and the cumulative ablation in Tab. 3a supports this design: hypothesis maintenance and active acquisition improve target grounding, while posterior fusion and geometric refinement provide further gains.
-
Visibility-aware negative evidence is useful in the design.
A failed detection in an aerial image is not sufficient evidence that a target is absent. Conditioning negative updates on expected visibility is a sensible way to avoid penalizing occluded hypotheses. Besides, the sensitivity experiment in Tab. 6 also provide evidence that negative updates matter: removing them reduces pre-ESR mIoU on SZIIT from 83.35 to 79.60.
-
The reported improvements are substantial and extend beyond the proposed benchmark.
AeroGround leads the evaluated methods on all six AeroRef3D scenes and also perform strong on the two open-vocabulary segmentation benchmarks. The latter results are important, because they show that the gains are not limited to the authors’ query construction procedure. Sharing the reasoning backbone across MLLM-based baselines is also a useful experimental control.
Critical weaknesses
-
I am unsure how much of the improvement comes from AQVE and ESR, rather than the stronger MLLM + SAM 3 pipeline.
Tab. 3b shows that image-conditioned MLLM localization significantly outperforms text-only segmentation. And, the main baselines retain their method-specific segmentation and preprocessing components, rather than sharing AeroGround’s SAM 3 configuration. This is reasonable for comparing complete systems, but it will leave uncertainty about how much of the large headline improvement comes from AQVE and ESR versus stronger initial masks. Tab. 3a helps, but a more explicit matched-backbone / matched-mask comparison would make it clearer.
-
The evidence for active disambiguation is less conclusive than the evidence for reduced view consumption.
In Tab. 5, AQVE achieves nearly the same accuracy as fixed ranking while using fewer views, which support an efficiency claim, but the comparison changes both view selection and stopping behavior. Tab. 3a provides a matched-view-count ablation, yet do not directly show whether AQVE resolves competing candidates more reliably. A fixed-ranking policy with the same stopping rule, together with results on genuinely ambiguous queries, would better show the value of hypothesis-guided acquisition. Besides, Eq. 12 is an uncertainty-and-visibility heuristic rather than an explicit expected information-gain calculation.
-
The claim of recovering complete 3D support is only indirectly evaluated.
The quantitative evaluation measures rendered masks at held-out camera poses. This is useful, but it does not directly establish the correctness of unobserved or weakly observed parts of the selected Gaussian support. Point-cloud visualization provide qualitative evidence, not a quantitative completeness measure. The conclusions should distinguish improved novel-view segmentation from demonstrated recovery of complete 3D object extent.
-
The pipeline relies on many hand-designed decisions whose individual contributions are unclear.
The appendix includes several thresholds and special cases for association, representative-view fusion, topology-dependent support retention, graph construction, component acceptance, and rendering calibration, which improve reproducibility, but make it difficult to find which principles are responsible for the gains. The sensitivity study covers only a small subset of these choices on one scene. In particular, the unchanged results across the tested graph weights raise the question of how much the pairwise graph term contribute beyond unary evidence and the subsequent acceptance rules.
Questions for authors
-
Can you separate adaptive selection from early stopping?
In particular, how does fixed ranking perform with AQVE’s stopping criterion, and how does adaptive selection perform without early stopping at matched view counts?
-
What are the benchmark counts and results for zero-, single-, and multi-target queries, each reasoning type, and empty versus nonempty evaluation masks?
It's better to report an always-empty baseline and a scene-level target-presence metric.
-
How were the many thresholds and special-case rules selected?
Was a separate development set used, and were all settings frozen before evaluating the six benchmark scenes? Please also clarify how often the relation-supported fallback and topology-dependent rules are activated.
3 comments
Thank you for the careful responses and additional experiments, and sorry for my delayed reply. I also met some deadlines these a few days.
I have carefully read all your responses, and most of my concerns have been addressed. For example, the matched-backbone comparison provide strong evidence for the contributions of AQVE and ESR. The view-selection ablations also provide clearer evidence for AQVE’s benefits beyond early stopping. The additional analyses of the special-case rules and ESR components is also reasonable, which help to clarify their individual contributions. The full responses are supported by experiments that strengthen the authors’ explanations. Although the ambiguous-query experiment remains limited in scale, the additional evidence sufficiently strengthens the submission. I will therefore raise my rating to weak acceptance.
To reviewer vULC
Thank you for taking the time to carefully read our responses and additional experiments. We really appreciate your thoughtful and constructive feedback. We will present these additional experiments in greater detail in the revised manuscript.
To reviewer vULC
We appreciate your thoughtful review and encouraging assessment. We address your concerns below.
1. Matched-Backbone Comparison
We conduct a controlled comparison on UrbanBIS-Ref using the same query planner, Qwen3.5-35B-A3B + SAM 3 frontend, 3DGS geometry, and evaluation protocol. Unlike the direct-query SAM 3 baseline in Table 3a, our fixed-retrieval controls use the same MLLM-assisted localization as AeroGround. We compare fixed retrieval and AQVE, each with and without ESR, to isolate their respective contributions.
AQVE improves mIoU/mBIoU over matched fixed retrieval by 3.96/2.87 points without ESR. ESR adds 3.33/2.13 points to fixed retrieval and 4.02/5.66 to AQVE. Overall, AeroGround gains 7.98/8.53 points over matched fixed retrieval.
2. Active Disambiguation
Eq. (12) uses uncertainty and visibility, not exact expected information gain.
Controlled ablation. We compare pre-ESR view selection on 21 ambiguous SZIIT instance annotations (N = 21), with identical candidate pools, budget (B = 24), hypothesis updates, and stopping rules when enabled. Target Acc. is the percentage of annotations with the correct target selected.
Even without early stopping, AQVE improves mIoU/mBIoU over fixed ranking by 1.78/1.65 points. When both use the same stopping rule, AQVE gains 4.66/1.12 points and improves Target Acc. from 42.86% to 66.67%, highlighting the benefit of active view selection beyond early stopping.
3. Scope of 3D Support Evaluation
Following query-mask annotation paradigms in ReasoningGD (ReasonGrounder [1]) and REALM3D (REALM [2]), AeroRef3D pairs queries with human-verified 2D masks. As in Gaussian Grouping [3] and Unified-Lift [4], we evaluate Gaussian support via held-out-view rendered masks (mIoU/mBIoU). All baselines, including ReasonGrounder [1], ReLaGS [5], and REALM [2], follow the same protocol.
This measures novel-view segmentation, not exact 3D completeness, especially in unobserved regions. ESR improves mIoU/mBIoU from 74.47/62.56 to 78.49/68.22 (Table 3a); 3D visualizations suggest better spatial coverage. We will replace “complete 3D support” with “improved spatial coverage and consistency of Gaussian support” and acknowledge the lack of direct 3D completeness evaluation.
4. Heuristic Design and Graph Contribution
All following ablations use UrbanBIS-Ref.
Special-case rule ablation. We evaluate the relation-supported fallback and non-enclosed target retention rules by measuring their activation frequencies and performance changes after removal.
Both rules activate in a minority of cases, and removing them together reduces mIoU/mBIoU by only 0.34/0.38 points. This indicates that AeroGround's overall improvements are not primarily driven by special-case heuristics.
ESR ablation. We conduct a cumulative ablation starting from AQVE, progressively adding Gaussian posterior fusion, unary/component refinement, local geometric evidence, and pairwise graph regularization.
ESR improves mIoU/mBIoU over AQVE by 4.02/5.66 points. Posterior fusion contributes 2.29/4.32 points, while later refinements add 1.73/1.34 points, including 0.25/0.27 points from pairwise graph regularization.
References
[1] Liu et al., “ReasonGrounder: LVLM-Guided Hierarchical Feature Splatting for Open-Vocabulary 3D Visual Grounding and Reasoning,” CVPR, 2025.
[2] Shi et al., “REALM: An MLLM-Agent Framework for Open World 3D Reasoning Segmentation and Editing on Gaussian Splatting,” CVPR, 2026.
[3] Ye et al., “Gaussian Grouping: Segment and Edit Anything in 3D Scenes,” ECCV, 2024.
[4] Zhu et al., “Rethinking End-to-End 2D to 3D Scene Segmentation in Gaussian Splatting,” CVPR, 2025.
[5] Xie et al., “ReLaGS: Relational Language Gaussian Splatting,” CVPR, 2026.