- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents PreAct-Nav, a training-free framework for urban navigation that integrates structured subgoal memory, action-conditioned video prediction, and VLM-based action review and revision. By combining predictive reasoning with execution feedback, the framework aims to improve action selection without updating the underlying model parameters. Experiments on UrbanNav and CityWalker, as well as evaluations with different navigation policies, demonstrate improvements in navigation performance.
Critical strengths
-
The paper is generally well written and clearly presented. It addresses a relevant problem in urban navigation and proposes a training-free framework integrating VLM reasoning, predictive world modeling, and execution feedback.
-
Experiments across multiple datasets and navigation policies show promising performance improvements.
Critical weaknesses
- The technical novelty remains insufficiently established relative to existing closed-loop planning and memory-based methods. The contributions of the proposed reasoning and memory mechanisms are not clearly distinguished from generic VLM-based action refinement, while the reliability of prediction assessment and the computational cost of the framework are not sufficiently validated.
Questions for authors
-
PreAct-Nav combines structured subgoals, action-conditioned video prediction, and execution feedback in a training-free framework. However, prior work such as CLOVER [1] has explored generative visual planning and closed-loop feedback, while Reflexion uses execution feedback to improve subsequent decisions. What fundamental technical advance does PreAct-Nav offer beyond these approaches, particularly in its use of VLM-based action review and revision?
-
Table 4 shows that the Reasoning Harness alone improves SR by 2.42 percentage points. However, it remains unclear whether this gain stems from the proposed Preview–Review–Revision mechanism or from generic VLM-based action critique and refinement. A comparison with a simpler critique-and-refine baseline using the same VLM and a comparable number of calls would help establish the specific contribution of the proposed reasoning design.
-
PreAct-Nav maintains intermediate subgoals through four fields: Objective, Visual cues, Open question, and Status. Although the ablation results show improvements from Navigation Memory, it remains unclear whether these gains arise from the structured subgoal representation itself or simply from providing additional interaction history. Would simpler history-based context or alternative memory designs achieve comparable gains?
-
Table 4 shows that adding the Predictive Sandbox to Navigation Memory improves SR by 1.01 percentage points. Although Figure 3 suggests greater benefits on longer routes and routes with more turns, Tables 12–13 in Appendix G report additional video generation and VLM inference costs. What is the end-to-end latency of the complete system, and how does the actual frequency of predictive rollouts affect the trade-off between performance and computational cost?
-
PreAct-Nav relies on the same VLM to assess predicted videos, evaluate candidate actions, and update memory based on execution feedback. However, inaccurate predictions may mislead the reasoner, and some feedback labels in the appendix are generated by the VLM itself rather than independent ground-truth annotations. Could the authors provide an independent evaluation of prediction quality or analyze the relationship between the reasoner's judgments and actual navigation outcomes to better establish the reliability of the proposed closed-loop mechanism?
[1] CLOVER: Closed-Loop Visuomotor Control with Generative Expectation for Robotic Manipulation, NeurIPS 2024.