- Rating
- 4(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents NaviWAM, a World–Action Prediction framework for embodied navigation. The method combines navigation trajectory prediction (Policy) and next-frame visual feature prediction (NF) through a shared dual-stream predictor, while using a Vision-Language Model (VLM) to encode language instructions and historical visual observations. Experiments across multiple Vision-and-Language Navigation (VLN) and PointGoal navigation benchmarks demonstrate competitive performance. The results further show that incorporating additional video data and performing target-scene adaptation can improve navigation success rates.
Critical strengths
- The paper addresses an important problem: leveraging videos without waypoint annotations to improve navigation performance and enable adaptation to new environments. This direction has clear practical value.
- The proposed framework combines navigation trajectory prediction with next-frame visual feature prediction, allowing the model to benefit from additional video data without requiring future visual feature prediction during inference.
- The experimental evaluation is comprehensive, with competitive results across multiple VLN and PointGoal navigation benchmarks. The authors also provide ablation studies examining factors such as video data volume, prediction objectives, and visual encoders.
Critical weaknesses
- Some important architectural choices are not sufficiently justified through ablation studies. Although the results demonstrate the benefits of NF supervision, it remains unclear whether the shared dual-stream predictor and patch-level feature prediction are necessary to achieve these improvements.
- The evaluation of target-scene adaptation could be more comprehensive. While the results show that incorporating target-scene videos improves navigation performance, comparisons with alternative adaptation methods are missing. In addition, the target-scene videos are generated in simulation, leaving the effectiveness of the approach with real-world videos unclear.
Questions for authors
- Could the authors further clarify the necessity of the shared dual-stream predictor? How would the proposed approach compare with a simpler architecture that combines a navigation policy with an auxiliary visual prediction task?
- Why are the improvements in coarse-grained navigation relatively limited? Table 3 shows that additional waypoint supervision leads to substantial improvements. Could the authors explain why NF supervision provides smaller gains in this setting?
2 comments
Thank you for the detailed response and the additional experiments. I appreciate the authors' efforts to address my concerns.
The new shared-versus-separate predictor ablation provides convincing evidence for the proposed architecture. The additional video-source analysis and real-world experiments also strengthen the evaluation, while the explanation regarding coarse-grained navigation is reasonable.
Overall, I believe the authors have adequately addressed my main concerns, and the new evidence has substantially strengthened the paper. I have therefore decided to increase my rating from 3 to 4.
Shared Prediction, Video-Based Transfer, and Coarse Navigation
We thank the reviewer for the constructive feedback on predictor design, adaptation, and coarse-grained navigation. We added controlled architecture/feature and video-source ablations, plus real-scene and physical-robot evidence. The results support shared Policy–NF prediction, clarify which visual features matter, and distinguish NF from direct waypoint supervision.
Overall, these controls establish the benefits of shared Policy–NF prediction, current-frame spatial features, and video-based adaptation while explaining the complementary value of target-domain waypoint labels.