- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes RecallWAM for object navigation, extending world-action learning with an explicit Recall capability. The model combines recent observations with spatially retrieved history to predict which traversable regions in the current view have already been explored, and directly conditions the navigation policy on this predicted state. Recall is jointly trained with future-observation prediction and action learning, while balanced exploration trajectories are introduced to provide history-dependent search experience. The method achieves strong results on HM3D, MP3D, and OVON, with ablations supporting the contributions of the exploration-state input, memory design, and Recall objectives.
Critical strengths
The main idea is simple and well motivated: visually similar observations may require different actions depending on which areas have already been explored, and representing this information explicitly is useful for avoiding repeated search. The method is also evaluated across three benchmarks, and the ablations clearly separate the effects of spatial and temporal memory, the explicit exploration-state input, and the Recall and Foresight objectives.
Critical weaknesses
The spatial retrieval procedure relies on accurate odometry and field-of-view overlap, but its robustness to pose or localization errors is not evaluated. The paper also does not report the memory and runtime overhead of storing and retrieving historical visual latents, which would be useful for understanding how the method scales to longer episodes.
Questions for authors
-
How sensitive is spatial retrieval and exploration-state prediction to noise in the estimated camera pose?
-
What are the memory and runtime costs of maintaining and retrieving the historical latents as the episode becomes longer?
We thank Reviewer MtJy for recognizing the motivation behind history-dependent exploration, the effectiveness of explicit exploration-state conditioning, and our carefully controlled ablations. We address the concerns through evaluation with estimated poses and profiling of long-term memory overhead.
1. Evaluate localization robustness using estimated poses
RecallWAM maintains comparable navigation performance when ground-truth poses are replaced with RGB-based MASt3R estimates. We evaluate this change on OVON Val-Unseen using the main model jointly trained on HM3Dv2, MP3D, and OVON.
Table S1. Navigation performance with different pose sources on OVON Val-Unseen.
Performance decreases by only 0.7 SR points and 0.1 SPL points, indicating that Recall-guided navigation remains effective when spatial retrieval uses estimated camera poses rather than perfect simulator poses.
2. Quantify memory and retrieval overhead over longer episodes
Historical cache usage and retrieval latency both scale approximately linearly with episode length, while the policy maintains a fixed-size context of four spatially retrieved and four recent observations. We profile both costs on a single NVIDIA RTX 5090.
Table S2. GPU history-cache usage and retrieval latency at different episode lengths.
Episodes average 153 steps in our evaluation. Even at 500 steps, the maximum episode length allowed by the benchmark, the historical cache occupies only 333.60 MiB, with 56.65 ms retrieval latency. The policy input remains fixed in size regardless of episode length.
The current retrieval implementation evaluates candidate views sequentially, resulting in approximately linear scaling with history length. Further acceleration is possible by batching or parallelizing candidate-view projection, coverage computation, and scoring.