- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents GSMem, a zero‑shot embodied exploration and reasoning framework built upon 3D Gaussian Splatting (3DGS). It aims to address the problem that conventional spatial memory struggles to retrieve visual evidence of historical scenes. Existing scene‑graph or keyframe‑based memory generally relies on object detection outputs or fixed viewpoints obtained during initial observations. When a target is misdetected or only observed from unfavorable viewpoints, the agent may fail to recover relevant information from its stored memory.
Critical strengths
This paper proposes GSMem, a zero-shot embodied exploration and reasoning framework that uses 3D Gaussian Splatting (3DGS) as persistent spatial memory. It enables agents to re-observe previously explored regions from novel viewpoints without physically revisiting them. The framework combines object-level and semantic-level retrieval, optimal viewpoint selection, and a hybrid exploration strategy based on semantic relevance and geometric information gain. Experiments on OpenEQA and GOAT-Bench show consistent improvements over existing baselines, supported by ablation studies and additional evaluations of robustness and efficiency.
Critical weaknesses
- The paper presents 3DGS-based persistent spatial memory and post-hoc re-observation as key contributions. However, similar ideas have already been explored in GaussNav [1], 3DGSNav [2], and GLMap [3]. In particular, 3DGSNav also uses 3DGS as spatial memory and renders virtual views to assist navigation. Therefore, the use of 3DGS for scene re-observation alone does not establish sufficient novelty.
- The geometric information-gain score uses the trace of the incremental Fisher Information Matrix, which does not explicitly account for information already captured in the current map. It is therefore unclear whether this score accurately reflects the information gained from new observations. Moreover, the paper does not explain how the incremental Fisher matrix is estimated for unexplored frontiers. Although the ablation results show that hybrid exploration improves performance, they do not isolate the contribution of the proposed information-gain metric.
[1] Lei, Xiaohan, et al. "Gaussnav: Gaussian splatting for visual navigation." IEEE Transactions on Pattern Analysis and Machine Intelligence 47.5 (2025): 4108-4121.
[2] Zheng, Wancai, et al. "3DGSNav: Enhancing Vision-Language Model Reasoning for Object Navigation via Active 3D Gaussian Splatting." arXiv preprint arXiv:2602.12159 (2026).
[3] Zhang, Sixian, et al. "Multi-Scale Gaussian-Language Map for Zero-shot Embodied Navigation and Reasoning." arXiv preprint arXiv:2605.01736 (2026).
Questions for authors
Since 3DGSNav already leverages persistent 3DGS memory, free‑view rendering, and target re‑verification under virtual views to assist navigation decision‑making, authors are requested to clarify the essential differences in core mechanisms between GSMem and 3DGSNav, elaborate on the capabilities enabled by the proposed multi‑level retrieval and viewpoint‑selection mechanism that cannot be achieved by existing systems, and add detailed methodological comparisons against GaussNav, 3DGSNav and GLMap, with direct performance comparisons under identical experimental settings whenever feasible.