- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
UniGS-SLAM combines monocular Gaussian reconstruction with a separate sparse voxel map for open-vocabulary semantics. It uses Depth Anything 3 predictions to guide pose and depth estimation, then lifts region-language observations into voxels using the reconstructed geometry. By retaining each observation’s contribution, the system can retract and reproject semantic evidence when earlier poses or depths change. The voxel map also guides Gaussian floater filtering and local surface refinement. The paper evaluates tracking, rendering, geometry, semantics, and runtime on Replica and ScanNet, plus four selected static KITTI-360 segments. It reports a 4.00 dB ScanNet PSNR gain over the strongest listed RGB-only baseline and a ScanNet open-set mIoU of 0.50 versus 0.38 for RADIO-ViPE. Removing historical semantic revision lowers ScanNet mIoU by 4.43 percentage points.
Critical strengths
-
Keeping semantic contributions separate from Gaussian parameters makes it possible to revise evidence after a pose or depth correction. This is well matched to an evolving SLAM map, and the ScanNet ablation in Table 7 gives useful evidence that retracting old contributions matters: mIoU rises from 45.43 without revision to 49.86 with it.
-
The reported results cover several aspects of the system rather than rendering alone. ScanNet rendering and geometric reconstruction improve substantially in the stated protocol, while the open-set semantic evaluation improves on both Replica and ScanNet. The component ablations also give some support to the geometry, revision, and refinement stages.
Critical weaknesses
-
The paper does not compare with OpenMonoGS-SLAM, a particularly relevant prior monocular Gaussian SLAM system with open-set semantics. It appears in the bibliography but not in the evaluation or substantive related-work discussion. The paper also does not make clear which reconstruction baseline results were rerun with identical scenes, image resolution, and evaluation frames. This makes the size of the reported cross-method advantage harder to judge.
-
The ablations show that revision helps within this system, but they do not fully separate the effects of the decoupled semantic representation from those of its strong geometry and semantic frontends. The progressive reconstruction ablation covers Replica, while the largest rendering gain is reported on ScanNet. Table 9 measures total reconstruction time, but does not show the memory cost or processing backlog from storing and revising historical semantic observations. Those measurements matter to the claimed efficiency of online semantic mapping.
Questions for authors
-
Could you compare against OpenMonoGS-SLAM under a common protocol? If its implementation or evaluation protocol prevents this, please explain the limitation and discuss the closest results that can be compared.
-
Which reconstruction baseline numbers were reproduced using the same scenes, resolution, and evaluation frames? Are rendering metrics computed on held-out frames for every method?
-
On ScanNet, can you report the geometry and semantic results with the major components disabled while keeping the same Depth Anything 3 prior and region-language frontend? How much memory and processing time do stored contributions and asynchronous semantic revisions add?
4 comments
Response to Reviewer Fuit (Part 2/2: Q3)
Q3 (a): Component ablations on ScanNet
We evaluated six ScanNet scenes, disabling historical revision and semantic-guided refinement independently. All four semantic variants retain the same DA3 prior, geometry enhancement, region-language frontend, and voxel representation; the bare SLAM backbone is included as a reference.
| Configuration | Historical revision | Semantic-guided refinement | PSNR ↑ | Depth L1 (cm) ↓ | mAcc (%) ↑ | 3D mIoU (%) ↑ |
|---|---|---|---|---|---|---|
| SLAM backbone (reference) | — | — | 24.22 | 12.337 | — | — |
| Full system without revision or refinement | No | No | 26.30 | 11.485 | 54.13 | 44.38 |
| Full system without refinement | Yes | No | 26.53 | 11.400 | 60.61 | 49.70 |
| Full system without revision | No | Yes | 28.52 | 9.500 | 55.85 | 45.43 |
| Full UniGS-SLAM (ours) | Yes | Yes | 28.65 | 9.388 | 60.80 | 49.86 |
The components serve complementary roles: historical revision corrects misplaced semantic evidence as geometry evolves, while semantic-guided refinement improves reconstruction through better surface selection and floater filtering. Combining them gives the strongest overall results. The original Appendix Table 12 further shows that semantic guidance improves upon the same geometric refinement without semantic cues.
Q3 (b): Contribution of semantic decoupling
The ablations in Q3 keep the geometry and semantic frontends fixed, isolating the contribution of historical revision and semantic-guided refinement. Without refinement, historical revision improves 3D mIoU from 44.38% to 49.70%. Our decoupled voxel map enables independent maintenance of semantic evidence, allowing outdated contributions to be retracted and re-fused without coupling semantic updates to Gaussian optimization.
Q3 (c): Storage and revision overhead
We profiled semantic mapping on Office0, enabling historical storage and then asynchronous revision:
| Configuration | Measured time (s) | Peak CPU (MB) | Peak GPU (MB) |
|---|---|---|---|
| Decoupled mapping | 78.21 | 1542.37 | 413.14 |
| + Historical storage | 79.69 | 1620.39 | 413.14 |
| + Asynchronous revision | 124.74 | 1694.27 | 413.14 |
Caching historical evidence adds little processing time; the main overhead comes from reprojecting and re-fusing observations after geometry changes. This trades additional CPU memory and computation for a semantic map consistent with the corrected reconstruction, without increasing the measured semantic-mapping GPU peak.
Thank you for the clarifications and additional experiments. The OpenMonoGS-SLAM comparison and fixed-frontend ScanNet ablations address much of my concern, particularly by demonstrating the benefit of historical semantic revision.
Differences in evaluation frames and resolutions still limit cross-method comparisons, and the online memory and revision costs warrant clearer discussion. Nevertheless, the response strengthens the paper sufficiently for me to raise my rating from 2 to 3.
Response to Reviewer Fuit
We sincerely thank the reviewer for the thoughtful follow-up and constructive suggestions. We appreciate the recognition of our additional experiments and the improved rating.
Regarding evaluation frames, we ensure that pose evaluation uses the same frames with valid GT poses across reproduced methods. For rendering, we follow the evaluation protocol adopted by traditional Gaussian SLAM methods (like MonoGS), evaluating every fifth non-keyframe. Since different SLAM methods select keyframes with different frequencies, identical evaluation frames cannot always be guaranteed under this protocol. Including keyframes in a fixed-interval evaluation could also introduce bias, as keyframes typically achieve better rendering quality due to direct optimization. We therefore consider the current non-keyframe protocol a reasonable compromise for fair comparison.
Regarding resolution, we use each baseline's recommended resolution where available to allow it to perform at its best, with the goal of ensuring a fair comparison. We also acknowledge that resolution differences may affect cross-method comparisons. We will conduct additional experiments with fully matched resolutions and include the results in the final version.
Regarding online overhead, we have conducted further analyses of online memory and revision costs, including memory and revision time scalability with increasing sequence lengths (Table 17) and the memory and computational overhead of large-scale pose corrections (Table 18). These experiments further characterize how memory consumption and revision time scale with the number of retained and affected observations. We will also provide additional analysis of asynchronous processing backlog in the final version.
We sincerely appreciate the reviewer's valuable feedback, which has helped improve the rigor and clarity of our work.
Response to Reviewer Fuit (Part 1/2: Q1–Q2)
Q1: Comparison with OpenMonoGS-SLAM
We could not locate a public implementation of OpenMonoGS-SLAM, preventing a matched rerun. We therefore provide its published tracking, rendering, and closed-set segmentation results as the closest available comparisons:
Our results indicate stronger rendering and closed-set segmentation, while OpenMonoGS-SLAM reports lower ScanNet ATE. The rendering protocols differ: it evaluates all non-keyframes at 512-pixel width, whereas we sample every fifth non-keyframe at each method's native resolution. Its open-set evaluation reports 2D segmentation rather than 3D mIoU. We will add these comparisons and discuss the methodological differences in the revised manuscript.
Q2: Evaluation settings and result sources
For reproduced methods, we follow the evaluation procedure of DROID-Splat: ATE is computed on all frames with valid GT poses, and rendering metrics on every fifth non-keyframe, excluding each method's keyframes. We use the same evaluation scenes, but retain repository-recommended resolutions, which may differ across methods. The rendering metrics are evaluated on non-keyframes, although the exact frame sets may differ due to method-specific keyframe selection.
Paper-reported results are used for Open-set SLAM, Hier-SLAM++, and OpenMonoGS-SLAM in Table 1, and for Open-set SLAM, SGS-SLAM, GS3LAM, OpenGS-SLAM, and OpenMonoGS-SLAM in Table 4. The remaining entries are reproduced. We will label these sources explicitly; the common sampling rule does not imply identical frame sets across methods.