- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper presents OAVP-Splat, an active semantic reconstruction framework built on 3D Gaussian Splatting. The method extends semantic uncertainty-based view planning with object-level observation histories and an ObjectVOI score, together with a two-stage coverage/refinement planner, local pose refinement, and trajectory optimization. It further introduces a post-hoc semantic contribution reweighting scheme based on per-Gaussian response strength and connected-component support. Experiments on Replica and Matterport3D show improved semantic reconstruction over ActiveSGM while maintaining comparable geometric and rendering quality.
Critical strengths
- The paper addresses a meaningful limitation of entropy-based active semantic mapping.
Modeling observation history, temporal disagreement, and view novelty at the object level provides a reasonable mechanism for identifying complementary observations rather than repeatedly selecting views based only on current semantic uncertainty.
- The semantic reweighting component is isolated experimentally and provides consistent gains.
The fixed-map ablation shows that per-Gaussian response weighting and component support improve mIoU from 84.60 to 85.69 without changing the acquired observations or geometry.
Critical weaknesses
- The empirical contribution of ObjectVOI, which is the most conceptually novel component, is relatively small.
In Table 2, adding ObjectVOI improves mIoU by only 0.21, 0.22, and 0.80 points on the three reported scenes. In contrast, a substantial portion of the overall gain comes from semantic reweighting, which appears more incremental conceptually. This weakens the claim that object-aware view planning is the main source of improvement.
- The current planning ablations do not cleanly attribute the gains to individual planning components.
The “Frontier exploration” control simultaneously disables ObjectVOI, local pose refinement, B-spline processing, and semantic reweighting, while retaining an SGM-style score with frontier fallback. Therefore, the relatively large gap between this control and the full method cannot be directly interpreted as evidence for the proposed object-aware planner.
Questions for authors
-
Could the authors provide a more controlled decomposition of the planning improvements, e.g. ActiveSGM-style planning -> + frontier completion -> + two-stage planning -> + ObjectVOI -> + local refinement, under the same observation budget and without semantic reweighting? This would clarify which planning component actually contributes to the performance gain.
-
Given that ObjectVOI provides relatively modest gains in the reported ablation, while semantic reweighting contributes a larger improvement, could the authors clarify whether the main contribution should be interpreted primarily as object-aware active planning or as the combination of planning and improved semantic aggregation?
5 comments
Thank you very much again for your thoughtful and constructive review. We are sincerely grateful for your careful reading of the paper and for the valuable questions you raised.
We posted our rebuttal several days ago, and we would like to very respectfully follow up. As the discussion period is drawing to a close, we would be most grateful if you might have a chance to let us know whether our response has helped address your concerns.
For ease of reference, our rebuttal mainly addressed the following points:
-
Individual contributions of the planning components: We conducted an incremental planning ablation under identical observation budgets with SCR disabled. In this setting, adding ObjectVOI-guided planning improves mIoU by +2.794 pp, and further adding local pose refinement and B-spline trajectory optimization increases the cumulative improvement to +3.064 pp. We hoped this would help more clearly separate the contributions of the planning components.
-
Separating planning gains from semantic reweighting: We also compared OAVP-Splat and ActiveSGM under both Raw and identical SCR settings across all eight Replica scenes. OAVP-Splat achieves +0.493 pp mIoU without SCR and +0.591 pp with matched SCR, together with a 12.2% reduction in Depth L1 error, which we hoped would clarify that the gains are not solely explained by semantic reweighting.
-
Interpretation of the main contributions: In our rebuttal, we also clarified that we view object-aware planning and SCR as complementary. In particular, planning improves the acquired observations and reconstructed geometry, while SCR improves semantic aggregation on top of the resulting maps.
We truly appreciate the opportunity for constructive discussion, and if convenient, we would be very grateful to hear whether these clarifications have been helpful. If there are still aspects that remain unclear, we would be more than happy to further explain them while the discussion period remains open.
Thank you once again for your time and consideration.
Thank you for the additional ablations. I have two follow-up questions regarding Table R1:
-
Could the authors report the per-scene Raw mIoU/F1 results for room0 and room1, rather than only their equal-weight mean?
-
Could the authors clarify exactly what “A: Standard view planning” corresponds to? Is configuration A intended to be equivalent to ActiveSGM, or is it an internal baseline based on the authors’ planning framework? If it is not ActiveSGM, please explain the differences and preferably include ActiveSGM under the same room0/room1 Raw evaluation setting in Table R1 for reference.
We sincerely thank you for your constructive feedback on the step-by-step planning decomposition under Raw mode and the complementary roles of active view planning and Semantic Contribution Reweighting (SCR).
1. ObjectVOI-Guided Two-Stage Planning Without SCR (CW1 & CW2; Q1)
Table R1 reports an incremental planning ablation on
room0androom1(equal-weight mean), under identical observation budgets in Raw mode (without SCR).Table R1. Incremental planning ablation under Raw mode.
Raw mIoU improves monotonically as ObjectVOI guidance and then pose/trajectory refinement are added to standard view planning, yielding total gains of +3.064 pp mIoU and +3.004 pp F1, entirely without SCR:
Adding ObjectVOI-guided view planning to A (A → B): Incorporating ObjectVOI guidance into standard view planning improves Raw mIoU by +2.794 pp and F1 by +2.682 pp. ObjectVOI guides the acquisition of complementary observations for ambiguous and under-observed objects, improving mapping quality without semantic post-processing.
Adding local pose refinement & B-spline to B (B → C): Geometry-guided pose refinement and trajectory optimization further improve Raw mIoU by +0.270 pp and F1 by +0.322 pp.
Summary: Under Raw mode, adding ObjectVOI-guided view planning to A improves mIoU by +2.794 pp, while pose/trajectory refinement brings the cumulative gain to +3.064 pp, independently of SCR.
2. Interpreting the Contributions of Planning and SCR(CW1 & Q2)
We applied identical SCR to ActiveSGM's final maps across all eight Replica scenes. Table R2 presents the 2 × 2 comparison (Planner × Readout Mode) under Raw and + SCR settings.
Table R2. Eight-scene Replica averages under Raw and matched SCR settings.
Summary: Our main contribution is the complementary combination of object-aware active planning and SCR. Active planning improves 3D geometry (−12.2% Depth L1) and multi-view semantic evidence (+0.493 pp Raw and +0.591 pp with SCR in mIoU over ActiveSGM), while SCR exploits 3D connected-component support to further improve semantic predictions (+1.094 pp mIoU).