- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
ActiveLang is an active open-vocabulary 3D mapping system given RGB-D observations and ground-truth camera poses. It uses dual Gaussian branches with shared centers for geometry/appearance and language features, online feature adaptation with a prototype bank, and a next-view planner combining geometric coverage, semantic uncertainty, and travel cost. The paper evaluates 2D view segmentation and localization, 3D point-cloud segmentation, and reconstruction on Replica and ScanNet++.
Critical strengths
-
This paper brings online language-feature adaptation, dense 3D mapping, and autonomous view selection into one loop. Its class-agnostic prototype mechanism addresses imbalanced semantic observations
-
The paper provides a comprehensive experimental evaluation covering 2D and 3D semantic understanding, as well as 3D reconstruction performance.
Critical weaknesses
-
Limited Novelty. The paper primarily appears to be a system-level integration of active reconstruction and open-vocabulary semantic understanding. The active reconstruction component builds upon prior work (ActiveGAMER + SplaTAM), while the semantic representation and compression modules are also largely derived from existing methods (OnlineLangSplat). Overall, the contribution seems incremental, with limited methodological novelty beyond combining existing techniques.
-
The main and Appendix 2D results conflict. For ScanNet++, Table 2 reports ActiveLang 2D SLAM/NVS mIoU of 21.01/20.13, whereas averaging the eight scenes in Table A4, explicitly presented as its per-scene breakdown, gives approximately 30.86/30.67. All four 2D columns for all three methods disagree, while the 3D columns agree. The reported results are inconsistent across different tables, raising serious concerns about their reliability and credibility. These inconsistencies make the experimental findings difficult to trust and represent a significant issue that needs to be addressed.
-
Limited Effectiveness of the Proposed Modules. The ablation results in Table 4 suggest that the proposed modules do not consistently improve performance. In several cases, removing certain modules actually leads to better or even the best results, raising concerns about their effectiveness and necessity.
-
Limited Ablation Evaluation. Why are the ablation studies conducted on only four scenes from the Replica dataset instead of all eight? Given the previously mentioned inconsistencies in the reported results, I would also like to see the ablation results on all eight ScanNet++ scenes to further verify the reliability and consistency of the proposed method.
Questions for authors
-
Please verify and correct the ScanNet++ 2D results reported in Tables 2 and A4, and explain the reasons for the inconsistencies.
-
Although the paper claims lower computational costs for online reconstruction, it does not provide a fair and comprehensive comparison of end-to-end runtime with existing methods to substantiate this claim.
-
Concerns about Evaluation Fairness. Do active exploration and SLAM reconstruction start from the same camera position? Figure A3 (Office2 and Room1) suggests that their starting positions may differ. Additionally, do both methods use the same number of frames for reconstruction? Differences in the number of input frames could compromise the fairness of the comparison. Furthermore, the blue test split appears to contain only virtual camera viewpoints oriented toward a single central point, which may not adequately evaluate novel view synthesis performance.
4 comments
Ablation Study on Scannet++
We conduct ablation studies on four ScanNet++ scenes (3f15a9266d, 5eb31827b7, 6115eddb86, and acd95847c5), following the settings in Table 4. Consistent with the Replica ablations, the full pipeline outperforms the ablated variants on eight of the nine evaluation metrics. The best score for each metric is highlighted in bold.
| Method | 2D/SLAM mIoU ↑ | 2D/SLAM Loc ↑ | 2D/NVS mIoU ↑ | 2D/NVS Loc ↑ | 3D mIoU ↑ | 3D mAcc ↑ | PSNR ↑ | SSIM ↑ | LPIPS ↓ |
|---|---|---|---|---|---|---|---|---|---|
| w/o Gate | 26.67 | 49.42 | 21.27 | 39.28 | 17.11 | 23.15 | 22.86 | 0.881 | 0.213 |
| w/o Proto | 27.18 | 50.73 | 22.32 | 41.04 | 20.29 | 28.97 | 23.03 | 0.879 | 0.218 |
| w/o Uncert | 29.12 | 50.16 | 21.40 | 37.91 | 17.65 | 26.20 | 23.29 | 0.882 | 0.215 |
| 6DoF camera | 19.73 | 48.73 | 14.50 | 36.19 | 12.96 | 18.19 | 22.39 | 0.872 | 0.222 |
| ActiveLang (full) | 31.45 | 54.02 | 29.29 | 49.67 | 20.45 | 28.27 | 26.12 | 0.928 | 0.161 |
Official Review by Reviewer ZBf1
Thank you for the clarifications and additional experiments, including the ScanNet++ ablations. While these address some of my concerns, I remain concerned about the limited methodological novelty, and the earlier reporting inconsistencies still affect my confidence in the experimental evidence. Overall, I will retain my original score.
Thanks for the feedback
We thank Reviewer ZBf1 for remaining engaged in this discussion, even if we do not completely agree.
We argue that we are addressing a novel problem, active open-vocabulary semantic mapping, that has been challenging current techniques in various ways. Our methodological novelty centers on two contributions, as detailed in our response to Reviewer PT1s’s W1: (1) learned semantic uncertainty (Eq. 1) which provides an exploration criterion for open-vocabulary setting , where a semantic probability mass function is difficult to specify; (2) prototype-balanced, separation-preserving adaptation (Eqs. 3–4) which addresses the imbalanced semantic stream induced by active exploration, which prior open-vocabulary mappers do not explicitly account for.
We hope that the "earlier reporting inconsistencies" have been fully resolved with our responses and new pdf file. They were due to a copy/paste error in a table caption, which had nothing to do with the data being reported.
Response to R3(ZBf1)
Thank you for raising these questions.
W1. Limited Novelty
Please refer to our response to R2(PT1s) W1.
W2 / Q1. The main and Appendix 2D results conflict.
Thank you for catching this error in the caption. The ScanNet++ 2D results in Table 2 evaluate all classes, whereas Table A4 uses the top-10 most frequent classes per scene; the 3D results are top-10 classes in both tables. We apologize that the captions did not distinguish these settings. We've submitted a revised version with corrected captions and evaluation descriptions, top-10 averages, and per-scene all-class results added to the appendix. The changes are highlighted in blue.
W3. Limited Effectiveness of the Proposed Modules
W4. Limited Ablation Evaluation.
Q2. Runtime analysis
Please refer to reseponse to R2(PT1s) W2.
Q3. Concerns about Evaluation Fairness