- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes SNAIL-VLN for long-horizon vision-and-language navigation. The framework jointly trains a shared multimodal language model for exploration, action prediction, spatial understanding, and task planning, while a runtime harness maintains spatial memory and coordinates subtask execution. To support training, the authors construct spatial-topology annotations and DFS-guided exploration trajectories, from which they derive five types of QA supervision. Experiments on LH-VLN show improved navigation performance, with a multi-stage success rate of 11.40%. The paper also provides runtime component ablations and model-scaling experiments to study the contributions of the system components and model capacity.
Critical strengths
- The paper involves substantial work in data construction, model training, and system implementation. It provides useful practical experience on adapting pretrained multimodal models to VLN and building a harness to support long-horizon navigation.
Critical weaknesses
- The experiments are limited to training and evaluation in Habitat, without evaluation in other simulators or on real robots. Although the method improves over the reported baselines, the absolute success rate remains low: most configurations have an SR below 10%, and the full system reaches 11.40%. These results are still far from reliable task completion. Given the small test set and low success rates, the results may also be sensitive to randomness, and repeated runs or confidence intervals would help assess their stability.
- Although the related work section covers several agentic VLN methods, the specific differences between the proposed harness and existing VLN harnesses are not sufficiently clear. A more detailed comparison of their designs and capabilities is needed to clarify the novelty of the proposed system.
Questions for authors
- Is DFS the most suitable strategy for constructing exploration trajectories? For example, when searching for food, an agent should reasonably prioritize the kitchen or living room, whereas DFS may visit the bathroom first. Although the dataset includes semantic region annotations, DFS itself does not prioritize regions according to their relevance to the target. Could this limit the model's ability to learn goal-directed semantic exploration? A comparison with a target-aware exploration strategy would be helpful.
- What challenges do the authors expect when transferring this system to the real world?
- With close to 90% of full episodes still failing, what are the main causes of failure? It would be useful to break down failures into categories such as exploration, spatial memory, subtask management, and action execution, and discuss which direction is most important for further improvement.