- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes SEDualVLN, a dual-system framework for vision-language navigation in continuous environments. System 1 builds on StreamVLN and incorporates geometry-feature supervision from a frozen VGGT model, together with passage-focused visual representations obtained using GroundingDINO and SAM. System 2 constructs an online 3D map, renders views along candidate frontier paths, and uses a general-purpose multimodal model to select navigation waypoints. The two systems operate at different frequencies to combine action generation with deliberative planning. Experiments on R2R-CE and RxR-CE report improvements over the included baselines, supported by component ablations and qualitative real-world demonstrations.
Critical strengths
-
A well-motivated combination of complementary spatial representations. Geometry supervision and passage-focused features target local action decisions, while map-based candidate-path visualization supports higher-level planning. Providing the planner with rendered route observations is an interesting way to connect language instructions with spatial choices.
-
Consistent improvements on two established VLN-CE benchmarks. Compared with the reported DualVLN baseline, SEDualVLN improves success rate by 3.0 percentage points on R2R-CE and 2.5 points on RxR-CE. The component ablations also suggest that geometry supervision and passage-focused representations contribute to performance.
Critical weaknesses
-
The methodological novelty is insufficiently established. Fast–slow navigation architectures already exist in DualVLN and R3. Moreover, the global spatial enhancement closely resembles GLaD [1], which aligns the LLM’s visual-token hidden states with frozen VGGT features for VLA. GLaD is neither cited nor discussed, and the paper does not establish a substantive methodological advance over this prior geometry-distillation approach.
-
The ablations do not adequately isolate the core spatial-enhancement mechanisms. System 1 ablations demonstrate the utility of geometry supervision and passage-focused features, but do not distinguish their benefits from generic auxiliary supervision or additional visual features. More critically, System 2 lacks comparisons isolating the top-down map, candidate-path rendering, and two-stage reasoning. The standalone-versus-combined system comparison supports collaboration, but does not establish the contribution of the proposed rendering-based planning mechanism.
[1] GLaD: Geometric Latent Distillation for Vision-Language-Action Models
Additional Concerns
- Real-world evaluation is purely qualitative. The real-world section reports only a few qualitative rollouts in Figure 4, with no success rate, trial count, or baseline comparison. Claims such as “conclusively demonstrate” and “bridges the sim-to-real gap” are not supported by this evidence and should be substantially softened or backed by quantitative trials.
- The comparison table is narrow. Table 1 includes only a handful of baselines, while the related-work section cites many recent VLN-CE methods. Including more of these—or justifying their exclusion—would make the state-of-the-art claim more convincing.
Questions for authors
- What substantive technical advances distinguish the global spatial enhancement from GLaD-style geometry distillation?
- What evidence isolates the contributions of top-down maps, candidate-path rendering, and two-stage reasoning in System 2 under comparable model and inference budgets?
- For System 1, what evidence shows that the gains specifically arise from geometric supervision and passage information, rather than generic auxiliary supervision or additional visual tokens?
- How are selected waypoints translated into actions, and how are plans updated when the agent moves during asynchronous reasoning?
- Are all geometric inputs, including those used for voxel pruning, mapping, and traversability estimation, derived exclusively from observed RGB frames?
- Answers to the additional concerns.