- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
GroundingVLN addresses the challenge of Vision-and-Language Navigation (VLN) in continuous environments by employing a shared "grounding" interface that bridges structured reasoning with spatial execution. The framework integrates coordinate-based visual evidence with pixel-level goals, which are dynamically adjusted as navigation progresses and executes these goals via an RGB-D geometric planning module. The authors constructed a dataset, GroundingCOTVLN-188K, which features temporally aligned grounding annotations, and introduced GEAR: a reinforcement learning phase based on a "group-relative" mechanism that combines "execution-aware" goal rewards with supervisory signals for actions, subtasks, and grounding. Empirical validation includes evaluations on the R2R-CE and RxR-CE benchmarks, cross-dataset transfer, component ablation studies, real-world deployment, and supplementary analyses regarding reasoning efficiency and the impact of depth noise.
Critical strengths
- The design specifically tailored for "grounding" has been validated through comprehensive component ablation studies (Table 3). These comparative experiments provide compelling evidence that both the grounding-based supervision mechanism and the "execution-aware" optimization strategy contribute to improved navigation performance, thereby confirming the technical value of the training design proposed in this paper.
- This method demonstrates robust navigation performance and strong cross-dataset transferability. On the "unseen" validation splits (val_unseen) of R2R-CE and RxR-CE, the method outperform ABot-N0 by 3.5 and 5.8 percentage points. When trained exclusively on R2R data, the method attains a 59.9% success rate on RxR-CE, compared to only 39.8% for AwareVLN. These results confirm the effectiveness of the complete system and its capacity for generalization.
Critical weaknesses
The "progress-aligned pixel-goal selection" method lacks an ablation study that isolates this specific component. Section 3.3 notes that restricting goal candidates to the current subtask segment is the key distinction between this method and "farthest-visible-point-based supervision." However, Table 3 does not include a variant in which only this "semantic boundary constraint" is removed. In the "w/o Subtask Decomposition" ablation, the paper does not explicitly clarify how goal segmentation and subtask rewards are adjusted, making it difficult to disentangle the contribution of "goal selection" from other effects of the decomposition. This, to some extent, weakens the empirical support for the study's core contribution.
Questions for authors
- In the "w/o Subtask Decomposition" variant, how are the target-segment constraints and subtask rewards handled? Could the authors isolate the effect of "progress alignment" by removing only the boundary constraints for the current subtask—while keeping the remaining target-construction constraints, training procedure, and execution pipeline intact?
- Can the training-data comparison be expressed using a common counting unit and comparable task coverage? Otherwise, please explicitly qualify the 0.9% figure as a ratio of heterogeneous reported training counts.
3 comments
Q2: Comparable training-data counts
Q2: Comparable training-data counts
We agree that the original 0.9% figure combines heterogeneous counting units. We report the trajectory-count comparison alongside comparisons of instruction-following training samples and reasoning examples:
| Comparison basis | GroundingCOTVLN-188K | ABot-N0 (Chu et al., 2026) | Our count / ABot-N0 |
|---|---|---|---|
| Training trajectories | ≈21K R2R/RxR trajectories | 16.9M reported trajectories | ≈0.12% |
| Instruction-following training samples | 188K R2R/RxR decision-level examples | 2.8M instruction-following samples | ≈6.71% |
| Reasoning examples | 188K grounded image–CoT examples | 5.0M additional reasoning examples | 3.76% |
Our 188K decision-level examples come from approximately 21K R2R/RxR trajectories, include the 16K GEAR subset. ABot-N0's 2.8M instruction-following samples cover R2R/RxR, door traversal, person search, and short-horizon navigation (Section 3.2.2); these are clip-derived training instances, while its 5.0M reasoning corpus has broader coverage. Using the reported trajectory counts gives 21K / 16.9M ≈ 0.12%. These ratios therefore describe reported counts with different task coverage and supervision.
Dear Reviewer,
I hope this message finds you well. With less than a day left in the discussion period, I wanted to kindly check whether our responses have addressed your concerns, or whether there are any remaining points you would like us to clarify. We would be happy to respond promptly. If our response has been satisfactory, a brief confirmation would be very helpful.
Thank you again for your time and for reviewing our paper.
W1&Q1: Independent progress-alignment ablation
We thank the reviewer for the feedback. Our responses are provided below.
W1&Q1: Independent progress-alignment ablation
We have added an independent w/o current-subtask boundary ablation to Table 3 in the main paper and expanded the analysis in Section 4.3.
Original decomposition ablation. w/o Subtask Decomposition removes only the initial decomposition step at inference, with unchanged model weights and no retraining. The checkpoint was trained with the original progress-aligned targets and subtask rewards; the remaining reasoning format is unchanged.
Independent boundary ablation. To isolate progress alignment, we retain the original reasoning annotations, subtask labels and reward, all other target-construction constraints, the SFT + GEAR training procedure, and the executor. We replace subtask-bounded pixel goals with the farthest visible path points, update target-related annotations and goal-reward maps consistently, and retrain the model.
Table R2. Progress-alignment ablation on R2R-CE
val_unseen.As shown in Table R2, removing the target boundary leaves OSR nearly unchanged (74.8% vs. 74.5%) but lowers SR from 69.9% to 58.2%, a drop of 11.7 percentage points. Case analysis shows that the additional failures mainly involve farther goals beyond the destination or continued motion after arrival. The agent can still enter the goal vicinity but fails to stop reliably, supporting the role of progress alignment in judging task boundaries.