- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper presents NavWorld, a framework for long-horizon language-conditioned outdoor navigation. The authors propose an automated data pipeline that converts crowdsourced Mapillary imagery into navigation trajectories with language instructions and hierarchical subtask annotations, resulting in a dataset of over 1.5 million frames across 365 cities. Based on this dataset, they train a navigation VLA model that combines a Qwen3-VL backbone for subtask generation and progress tracking with a flow-matching action expert for continuous motion prediction. Experiments on 400 episodes in Habitat-GS show that NavWorld achieves a 43% success rate with NavWorld-generated instructions, substantially outperforming the evaluated navigation VLA baselines. The authors also investigate the impact of training data scale on navigation performance.
Critical strengths
1. Scalable data construction for outdoor language navigation. The paper proposes an automated pipeline that transforms crowdsourced Mapillary imagery into language-labeled navigation trajectories. By leveraging publicly available data, it constructs a geographically diverse dataset with over 1.5 million frames across 365 cities, reducing the need for costly robot-specific data collection and manual annotation.
2. Promising zero-shot outdoor navigation performance. NavWorld demonstrates substantial improvements over existing baselines on unseen Habitat-GS environments. The evaluation provides evidence that the automatically constructed dataset and trained policy can support effective closed-loop outdoor language navigation.
Critical weaknesses
1. Limited methodological novelty. The methodological novelty of the paper is relatively limited. The proposed NavWorld-VLA largely builds upon existing VLA architectures, combining a pretrained VLM backbone, hierarchical language subtasks, and a flow-matching action expert. While these components are adapted to outdoor navigation, the overall design closely follows established approaches such as π0.5, and the paper does not clearly demonstrate substantial technical innovations beyond their integration. Consequently, the main contribution appears to lie in data construction rather than model development.
2. Insufficient ablation studies to validate the proposed model design. The experimental evaluation primarily focuses on comparisons with existing methods and data scaling, with limited analysis of the proposed model components. In particular, the paper lacks ablations examining the effectiveness of hierarchical subtask generation, subtask-aware attention masking, and the multi-stage training strategy. Without these experiments, it is difficult to determine which design choices contribute to the reported performance improvements or whether the proposed architecture is necessary to achieve them.
Overall, I find the proposed dataset valuable, and the authors demonstrate promising navigation performance by leveraging this data with a relatively standard model architecture. However, I believe the primary contribution of this work still lies in the dataset, while both the problem formulation and the methodological design largely build upon existing approaches. Furthermore, the paper lacks several important ablation studies needed to validate the contributions of individual model components. These concerns limit my assessment of the paper's overall novelty and technical contributions, leading to my final rating.
Questions for authors
- Are the automatically generated instructions further filtered or validated after annotation? How do the authors handle potentially incorrect, ambiguous, or visually ungrounded instructions, and how is the overall annotation quality evaluated?
- Could the authors provide ablations on hierarchical subtask generation and subtask-aware attention masking? How much does each component contribute to navigation performance?
- Could the authors provide ablations on the three-stage training strategy? In particular, how does Stage 3 affect performance across different navigation lengths and numbers of subtasks?
3 comments
Response to Authors
Thank you for the additional experiments and clarifications. I appreciate the authors' efforts. The new results provide useful evidence for the effectiveness of the dataset and hierarchical design. But I think my main concern about methodological novelty remains, as the overall architecture still largely builds on existing approaches.
However, considering the demonstrated effectiveness of the approach and the paper's primary contribution in dataset construction, I have decided to raise my rating to 3.
Dear Reviewer vHME,
Thank you again for your valuable time and for revisiting your assessment. We’re glad the new results helped clarify the value of the NavWorld dataset and the role of subtask supervision in outdoor navigation.
Dear Reviewer vHME,
Thank you for your careful review. We are glad you found our data construction scalable and geographically diverse, and our zero-shot outdoor navigation results promising. We respond to your concerns and questions below.
We agree that our main contribution is the data engine and dataset, and we designed it that way. We believe a diverse, large-scale outdoor dataset would further improve current VLN policies and help them generalize to outdoor environments. NaVILA's released weights reach 0.50% SR on our Habitat-GS episodes, and with our data, it improves to 16.75% SR. NavWorld provides a scalable way to produce outdoor supervision from crowdsourced imagery: 1.58M frames across 365 cities, with ordered, boundary-aligned subtask instructions.
We propose the NavWorld model to leverage the dataset's structure: it generates the next subtask, tracks progress, and restricts action prediction to the active subtask's context. The matched-data experiments in the open response show that the dataset and this design each contribute:
We thank the reviewer for vHME’s advice on showing ablations for hierarchical subtask generation and attention masking. We train a flat policy without subtask supervision or prediction and evaluate it on the same 400 Habitat-GS episodes:
Removing the subtask hierarchy halves SR and SPL, while OSR barely changes (38.00 vs. 38.50). Both policies reach the goal region about equally often, but the flat policy stops there only half as often. The hierarchy's main contribution is therefore progress tracking: knowing which part of the instruction is done and when to stop, which is what subtask generation and the controller are for.
Please also refer to our central thread for more details on this topic.
In our final model, we do not use Stage 3. The new comparisons use a two-stage NavWorld model. They demonstrate that the reported benefits are achievable without the Stage 3 curriculum. To reiterate:
We hope these results address your concerns, and we're happy to answer any further questions.