- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies how to retain and efficiently use past observations when an agent pursues consecutive object goals within the same scene. LociNav maintains a pose-indexed visual feature store organized by spatial landmarks and viewing-direction sectors. It selects candidates based on goal relevance and graph distance, and prepends a memory block consisting of candidate, path, and live frames to the VLM's input. A spatial pose bias communicates relative pose information, while a ViT cache and KV prefix reuse reduce inference cost. The authors organize existing HM3D ObjectNav and HM3D-OVON episodes into tours and train and evaluate the model together with GOAT-Bench. Results show improved SR on multiple splits and substantially lower inference latency than some memory-augmented baselines, although SPL does not consistently outperform the strongest baselines.
Critical strengths
-
The paper presents a coherent design addressing a concrete bottleneck in iterative navigation. The persistent pose-indexed visual feature store, goal-directed retrieval, memory block with different update frequencies, and compute reuse jointly address information retention and inference cost, rather than simply increasing the context length. On the fixed OVON-Tour subset used in Table 4, the full memory block improves SR/SPL from 41.2/22.0 to 61.6/31.6. In Table 6, additive attention bias improves SR from 44.4 without pose injection to 61.6. These results support the value of spatial organization and route guidance.
-
The efficiency evaluation is concrete and complements results across multiple benchmarks and hardware platforms. In Table 5, the two reuse mechanisms reduce per-step latency from 0.41 s to 0.25 s, with Table 8 in the appendix providing a breakdown into ViT encoding, KV prefilling, and decoding. Evaluation on workstation GPUs and Jetson Orin, together with the storage–accuracy–latency trade-offs in Table 9, provides evidence of practical utility beyond success rate alone. This is an important consideration supporting acceptance.
Critical weaknesses
-
The controlled comparison of memory block designs could be strengthened. Tables 4 and 6 support the effectiveness of the candidate/path/live structure and spatial pose bias. However, the configurations in Table 4 also differ in the number of memory frames provided, making it difficult to fully distinguish the benefit of organizing frames by role from that of supplying more historical visual information. A simple goal-relevant top-k retrieval baseline with the same number of memory frames or the same token budget would more clearly establish the additional value of route previews and local guidance.
-
The efficiency ablation could report navigation metrics more explicitly. Table 5 reports RtL/E2EL and discusses improved SPL relative to the non-memory baseline, but does not report SR/SPL for its configurations. Although Table 4 supports the navigation benefit of the memory block, reporting SR/SPL alongside the latency results would help verify that the reuse mechanisms preserve navigation performance and clarify the interpretation of the E2EL gains.
Questions for authors
-
Contribution of the memory block structure. Could the candidate/path/live structure be compared with goal-relevant top-k retrieval using the same number of memory frames or the same token budget, to distinguish the benefit of memory organization from that of additional input information?
-
Metrics supporting the efficiency ablation. Could you report SR/SPL for the configurations in Table 5, including the non-memory baseline, and confirm whether navigation performance remains unchanged when ViT cache and KV prefix reuse are enabled?
-
Spatial pose bias and KV prefix reuse. In Eq. (2), is the egocentric frame tied to each frame's observation pose or to the agent's current pose? As the agent moves, how is attention computation within the cached prefix kept unchanged?
Kindly requesting for feedback on our rebuttal
Dear Reviewer,
Thank you again for your detailed review. We have posted a response addressing each weakness and question, including a same-budget comparison with top-k retrieval baselines that isolates the benefit of the candidate/path/live structure from the number of frames (W1+Q1), SR and SPL results added to the efficiency ablation confirming that the reuse mechanisms preserve navigation performance (W2+Q2), and a clarification of the pose bias reference frame and the layer-wise KV reuse argument with empirical verification (Q3). New experiments conducted for this rebuttal include the same-budget retrieval baselines trained from scratch. We have also uploaded a revised paper that addresses these points with changes highlighted in red.
We would be grateful to know whether these address your concerns, in particular the controlled comparison of memory block designs and the metrics supporting the efficiency ablation. If anything remains unclear, we would welcome further discussion.
With a few days remaining in the discussion period, we would appreciate any additional comments at your earliest convenience.
Thank you for your time and consideration.