- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes VLN-MEM, a scene-memory-guided vision-language navigation framework for reliable goal arrival. The method constructs an offline scene graph from reference trajectories, retrieves next-hop geometry through graph search, and integrates spatial information into an existing VLN policy using residual fusion. A training-free stop verification module further improves termination decisions. Experiments on R2R-CE and RxR-CE demonstrate improved navigation success rates.
Critical strengths
- The paper identifies two practical navigation failure modes: failing to reach the goal and failing to stop after arrival.
- The framework demonstrates improvements over its training-budget-matched baseline, with component-wise ablations supporting the reported gains.
Critical weaknesses
W1. Questionable problem formulation and insufficient justification for using VLN. My primary concern is the practical and scientific motivation of the proposed problem setting. Unlike standard VLN, the method assumes that the environment has been mapped offline and that the goal pose and reference image are explicitly provided. The scene memory is constructed using reference trajectories, including those from evaluation scenes. Under these assumptions, conventional mapping, localization, and graph-based planning methods could already provide a straightforward navigation solution. In fact, the proposed method itself uses A* to retrieve next-hop geometry. The paper does not demonstrate why integrating a VLM-based navigation policy offers meaningful advantages over conventional navigation pipelines. Moreover, the reliance on preconstructed maps and explicit goal information substantially reduces the need for language grounding and limits generalization to previously unseen environments.
W2. Limited methodological novelty. The proposed framework primarily combines established components, including scene graph construction, CLIP-based retrieval, A* planning, residual feature fusion, and DINOv2-based visual matching. The stop verification mechanism is essentially a rule-based combination of visual similarity, spatial proximity, and temporal consistency. These components are reasonable engineering choices but do not constitute substantial methodological innovations.
W3. Questionable effectiveness of stop verification under stricter arrival criteria. A considerable portion of the reported improvement comes from stop verification rather than improved navigation capabilities. On R2R-CE, stop verification contributes approximately 9 percentage points to the total 14.5-point success-rate improvement. More importantly, Figure 4(b) shows that stop verification significantly reduces arrival precision under stricter distance thresholds. At a 1m threshold, the success proportion decreases from 39.9% to 14.6%. This suggests that the method primarily benefits from the benchmark’s relatively permissive 3m success threshold rather than achieving more accurate goal arrival.
W4. Limited consideration of obstacle avoidance and lack of real-world validation. The proposed framework introduces no dedicated obstacle-avoidance mechanism or systematic evaluation of collision handling. Furthermore, all experiments are conducted in simulation, without real-robot deployment. Given its dependence on accurate localization and preconstructed scene memory, its robustness and practical applicability remain unclear.
Questions for authors
- What advantages does VLN-MEM offer over conventional SLAM-based localization and graph-based navigation under the same mapping assumptions?
- How does the method perform under stricter arrival thresholds and with imperfect localization or incomplete maps?
- How is collision avoidance handled, and can the authors provide quantitative evaluations of obstacle-related failures?