- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper introduces GuidedNav, a training-time guidance framework for vision-and-language navigation. It combines subtask attention supervision, landmark attention supervision, and VGGT-based spatial feature distillation to improve direct action prediction without intermediate textual reasoning or an online geometric teacher at inference. Guided-R2R and Guided-RxR augment existing navigation data with active subtask spans and landmark masks. Evaluations include R2R-CE, RxR-CE, component ablations, representation analyses, and real-robot experiments.
Critical strengths
- The framework coherently addresses instruction progress, landmark grounding, and spatial understanding through training-time supervision. The annotation-enriched datasets are useful resources, and removing the teacher and auxiliary projectors at inference is practically relevant.
- The evaluation is extensive. Matched component comparisons support the guidance modules, measured inference efficiency supports deployment benefits, and attention-localization and spatial-probing analyses provide additional evidence of better task grounding and spatial representations.
Critical weaknesses
- The novelty appears to lie mainly in the particular supervision position and temporal spatial objectives rather than the general use of attention guidance and geometric alignment. The paper acknowledges related approaches, but the additional value of supervising native pre-action attention, compared with a different supervision position under the same policy and targets, remains less clearly isolated.
- The individual attention-guidance variants reveal a trade-off that needs explanation. In Table 3, subtask and landmark guidance increase SR from 59.3 to 62.9 and 62.6, but reduce SPL from 56.1 to 55.2 and 55.8. The OSR-SR gap increases from 4.5 to 9.4 and 9.5 percentage points. The full model improves both SR and SPL, so this concern is specific to the individual attention modules.
Overall, the integrated framework, data resources, and broad empirical evidence constitute a worthwhile contribution. The remaining attribution and behavioral questions temper my enthusiasm, but I lean toward a weak accept.
Questions for authors
- Which specific design choices account for the main advance beyond existing attention supervision and geometric alignment? If available, a comparison varying the attention-supervision position while keeping the policy, targets, and training budget fixed would help clarify the contribution.
- Do the lower SPL and larger OSR-SR gap for the individual attention variants reflect less efficient trajectories, inaccurate stopping, or both? Trajectory-length statistics and analysis of episodes that enter the success region but fail at termination would help. How does spatial guidance mitigate these effects in the full model?
3 comments
W2 & Q2: Path-efficiency and termination trade-offs of individual attention guidance.
A2:
Thank you for this insightful observation. It motivated us to examine the behavioral effects of attention guidance more closely and provides an opportunity to clarify our original motivation for combining semantic and spatial guidance, as well as their complementary roles in navigation.
-
Trade-offs of individual attention guidance.
Subtask and landmark guidance improve SR from 59.3% to 62.9% and 62.6%, respectively. These gains are accompanied by trade-offs in path efficiency and termination behavior. First, mean normalized path efficiency among successful episodes, computed as , decreases from 94.6% for Base to 87.8% and 89.1%—reductions of approximately 6.8 and 5.5 percentage points. These averages describe each model’s successful-episode set. Second, the proportion of reached episodes that ultimately fail, computed as , increases from 7.1% to 13.0% and 13.2%. Episode-level records further clarify the termination behavior. For landmark guidance, 175 of 1,326 episodes that entered the success region ultimately failed. Of these, 173 ended outside the 3 m region, while two remained inside but exhausted the action budget. The dominant observed pattern is therefore reaching the goal vicinity and subsequently leaving it without completing successfully.
These findings highlight the different behavioral effects of semantic guidance: it improves overall task success, while path efficiency and termination behavior exhibit accompanying trade-offs. This motivates combining semantic and spatial guidance to support both recognition of relevant instructions and landmarks and the movement and stopping decisions needed to complete navigation efficiently.
-
Complementary gains from spatial guidance.
The existing component ablation shows that Spatial guidance alone increases SPL from 56.1% to 57.2%. The additional Subtask +Landmark guidance configuration without Spatial guidance achieves 63.7% SR and 56.4% SPL, whereas the full model reaches 65.4% SR and 59.1% SPL, improving these metrics by 1.7 and 2.7 percentage points, respectively. The behavioral diagnostics also show improved efficiency and completion. Among the 1,155 episodes in which both Landmark and the full model reached the success region, unsuccessful completion decreases from 142/1,155 (12.29%) to 92/1,155 (7.97%). On the 980 episodes successfully completed by both models, mean normalized path efficiency increases from 90.71% to 92.12%.
Together, these results support the complementary roles of the three guidance objectives: subtask and landmark supervision improve semantic grounding, while spatial supervision contributes geometric and temporal information for navigation. Their combination achieves a better balance between task completion and path efficiency than individual attention guidance.
Follow-up on Additional Ablations and Behavioral Analysis
Dear Reviewer QBXU,
Thank you again for your thoughtful feedback. May we ask whether our additional experiments and analyses have addressed your concerns? Briefly:
- Design contributions: Controlled ablations support the benefits of native pre-action supervision, history-conditioned geometric targets, and spatial alignment at a deep, non-final layer.
- Efficiency and stopping: Episode-level analysis identifies both reduced path efficiency and failures after entering the goal region with individual attention guidance. Adding spatial guidance improves path efficiency and successful completion, supporting their complementary roles. These findings have been incorporated into the revised manuscript. We would greatly appreciate any further suggestions or clarification of remaining concerns.
Best regards,
The Authors
A1:
Thank you for your suggestion, which have been invaluable in helping us refine our work. We conducted three controlled experiments to examine the supervision position, temporal context, and spatial-guidance depth beyond the existing component ablations.
We compared supervision positions using Subtask (S) + Landmark (L) guidance without Spatial guidance, keeping the policy architecture, targets, training data, initialization, and training budget fixed. First, we jointly moved S and L among current-image end, input-end marker, and native pre-action. All three positions access the complete navigation input, but only pre-action directly supplies the hidden state predicting the first action token. Second, we moved only S to instruction end or before the current image, keeping L at pre-action so that its landmark targets remained accessible under causal attention.
Table A. Attention-supervision positions on R2R-CE val-unseen.
Overall, native pre-action supervision achieves the strongest goal-reaching performance among the tested positions, with an SR of 63.7%. It improves SR by 3.1 and 2.6 percentage points over current-image-end and input-end supervision, respectively. Since these positions share complete input access, the results support the benefit of supervising the action-prediction interface. With L fixed at pre-action, placing S at pre-action also outperforms instruction-end and before-current-image supervision in both SR and SPL, reaching 63.7% and 56.4%. Together, these comparisons support native pre-action as an effective supervision position, combining current-image access with direct guidance of the action readout.
We additionally examined the local temporal window and the historical context used to construct long-horizon teacher targets. For the window comparison, we jointly varied the neighboring frames used for fusion and Local supervision while keeping the long-horizon branch fixed. For the teacher-context comparison, we retained the four-frame local window and the student’s historical observations, removing history only from the long-horizon VGGT teacher.
Table B. Local temporal window and long-horizon VGGT teacher context.
The four-frame window achieves the best performance. Expanding the window to eight frames reduces SR and SPL by 3.5 and 5.5 points relative to four frames, showing that a larger local window does not necessarily improve navigation. Removing history from the long-horizon teacher reduces SR by 1.7 points, despite preserving the student’s historical inputs. This supports the value of history-conditioned geometric targets beyond single-frame distillation.
We compared alignment at 25%, 50%, 75%, and 100% of LLM depth, keeping attention supervision, the geometric teacher, and the remaining spatial components fixed.
Table C. Depth of the student LLM representation receiving spatial alignment.
Block 27 performs best among the tested layers across all four metrics, exceeding final-block alignment by 2.3 points in both SR and SPL. This supports a relatively deep, non-final representation as the spatial-alignment site in our policy.
We have added the supervision-position and temporal-context comparisons to Tables 4 and 5, and the spatial-alignment-depth comparison to Table 14. We have also added comparisons of attention-supervision depth and the number and grouping of supervised attention heads to Tables 12 and 13, respectively.