- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents FutureNav, a VLM-based framework for vision-and-language navigation (VLN) with auxiliary world-modeling objectives. It jointly trains four training objectives: action policy, inverse dynamics, forward dynamics, future generation within a VLM-based architecture, and leverages the auxiliary world modeling objectives to augment its VLN capability. At inference, the auxiliary prediction heads are removed and the model directly decodes navigation actions through the policy branch. Experiments on simulated benchmarks and real-world deployment demonstrate the effectiveness of the proposed approach.
Critical strengths
The implementation is simple and practical, allowing the model to benefit from additional supervision while retaining direct action decoding at inference. The ablation studies provide empirical evidence for the effectiveness of the world-action objectives and spatial latent representation.
Critical weaknesses
Overclaim on novelty. The four world-action training objectives -- policy learning, inverse dynamics, forward dynamics, future generation -- have substantial precedent in previous works. UWM (UWM; Zhu et al., RSS 2025) already shows that policy, forward dynamics, inverse dynamics and video generator can be unified in one model; LDA-1B (Lyu et al., RSS 2026) further utilizes this paradigm and performs world action modeling in visual latent space. Moreover, as for VLN tasks, SpaAct (Li et al., 2026) explores using backward action reasoning and forward transition prediction for dynamic spatial awareness. The novelty of FutureNav relative to these prior methods should be clarified more carefully. Overclaim on performance. The paper claims that the performance of FutureNav surpasses all prior single-RGB SOTA methods (section 4.2). However, the paper doesn’t compare FutureNav with previous published works, such as CorrectNav (Yu et al., 2026), a prior monocular RGB-based VLA navigation method that reports 65.1/62.3 SR/SPL on R2R-CE and 69.3/63.3 on RxR-CE. It exceeds FutureNav's best RxR-CE result of 63.9/54.8. Other works like AwareVLN (Guo et al., 2026) also report stronger results under comparable settings. In this case, the claim of surpassing all prior single-RGB SOTA methods does not appear to be supported by the current comparison. The proposed formulation may be better characterized as auxiliary predictive representation learning rather than unified world-action modeling. The forward and future-generation objectives predict a one-step pooled latent representation of the next observation, and these predictions are used only as training supervision rather than for rollout or planning at inference. It is therefore unclear what additional world-modeling capability is demonstrated beyond the benefit of predictive auxiliary supervision for learning a better policy representation. References: Zhu et al., Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasets, RSS 2025. Lyu et al., LDA-1B: Scaling Latent Dynamics Action Model via Universal Embodied Data Ingestion, RSS 2026. Li et al., SpaAct: Spatially-Activated Transition Learning with Curriculum Adaptation for Vision-Language Navigation, arXiv:2604.27620, 2026. Yu et al., CorrectNav: Self-Correction Flywheel Empowers Vision-Language-Action Navigation Model, AAAI 2026. Guo et al., AwareVLN: Reasoning with Self-awareness for Vision-Language Navigation, CVPR 2026.
Questions for authors
Novelty: Could the authors clarify the key methodological novelty of FutureNav relative to UWM and LDA-1B, which already jointly model policy, forward dynamics, inverse dynamics, and future visual states? It would also be helpful to discuss the relation to SpaAct, which explores backward action reasoning and forward transition prediction in VLN. Performance comparison: Why is CorrectNav (AAAI 2026) not included in Table 1? Since CorrectNav reports stronger results on RxR-CE under a monocular RGB setting, could the authors clarify whether the evaluation settings are directly comparable and revise the SOTA claim accordingly? World modeling vs. auxiliary supervision: What evidence indicates that the proposed forward/future prediction objectives learn a meaningful world model beyond serving as auxiliary predictive supervision for improving the policy representation? Could the authors further clarify what world-modeling capability is enabled by these objectives? Spatial-feature contribution: Does the policy-only baseline in Table 2 use the same VGGT spatial-feature fusion as the full FutureNav model? Appendix C.3 describes an ablation with alpha=0 to isolate spatial input fusion, but the corresponding quantitative results appear to be missing. Could the authors provide or clarify this ablation?
Dear ICLR 2027 AC, SAC, PC, and Reviewers
Dear ICLR 2027 AC, SAC, PC, and Reviewers,
Thank you and the reviewers for your time and constructive feedback. We summarize the recognized strengths, our responses, and the discussion outcomes below.
Strengths recognized across the reviewers
Reviewer jxEa (rating: 3, confidence: 4)
Reviewer ddQL (rating: 3, confidence: 4)
Reviewer iVW4 (rating: 2, confidence: 3)
In summary, all three reviewers acknowledged that the additional experiments strengthen the empirical evidence; after jxEa raised the rating, both high-confidence reviewers (jxEa, ddQL) support weak acceptance. On the shared novelty concern, FutureNav outperforms matched re-implementations of six prior paradigms (50.1–53.0 vs. 55.1 SR).
We hope this summary helps your assessment of the paper in light of the additional evidence and the reviewers' feedback.
Best regards,
The Authors