- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces a framework called SeekVLN, which improves progress anchoring in visual-language navigation through active evidence seeking. The authors identify a failure mode known as “progress myopia,” in which agents make confident navigation decisions even when visual evidence is insufficient. SeekVLN employs a dual-mode strategy that allows agents to choose between direct navigation and acquiring supplementary observations before reasoning and action. The proposed training workflow includes Future-Guided Reverse Generation (FRG) that uses offline expert trajectories to construct supervision for evidence search and progress reasoning, and Counterfactual Comparison Strategy Optimization (C2PO) that estimates the benefits of evidence acquisition by comparing evidence-search branches with direct-navigation branches. Experiments on R2R-CE and RxR-CE demonstrate that this method achieves improvements over baseline models and previous competitive approaches. Additional ablation experiments and qualitative real-world demonstrations further validate the effectiveness of the proposed method.
Critical strengths
-
The paper highlights an important limitation of navigation agents operating under partial observations. Allowing an agent to seek additional visual evidence before making uncertain decisions is a practically relevant direction for embodied navigation.
-
C2PO provides a reasonable mechanism for assigning credit to evidence-seeking decisions based on subsequent navigation progress. The reported improvements are substantial, and the ablations indicate that the counterfactual reward contributes additional benefits beyond standard reinforcement fine-tuning.
Critical weaknesses
-
Unclear whether the model genuinely learns to recognize insufficient visual evidence. As shown in Table 2 of Appendix B, FRG generates SEEK supervision using predefined proportions conditioned on expert actions. For example, 30% of forward actions and 75% of turns with a cumulative rotation of 45° are labeled as SEEK. Therefore, the initial SEEK supervision is constructed using action-dependent heuristics rather than directly assessing the sufficiency of available visual evidence. Moreover, the SEEK mode always acquires three fixed views (left, front, and right), without actively selecting where to observe. While the results demonstrate that the model can learn when to acquire supplementary views, they do not sufficiently establish that it genuinely recognizes insufficient visual evidence, which is a central claim of the paper.
-
Limited flexibility and generality of the proposed evidence-seeking mechanism. Despite its reasonable motivation, the proposed framework relies on a relatively constrained evidence-seeking mechanism. Specifically, the model switches between direct navigation and a predefined three-view observation procedure, rather than adaptively determining which additional observations would be most informative. Furthermore, recent VLN approaches have increasingly emphasized more general instruction understanding and task-level reasoning, which may not require explicit landmark identification at every decision step. The paper does not sufficiently discuss how its evidence-seeking mechanism generalizes to these navigation paradigms. These limitations weaken the generality and methodological novelty of the proposed framework.
Questions for authors
-
Generalizability across different VLN backbones. Is the proposed evidence-seeking framework applicable to other VLN architectures beyond Aux-Think? Why did the authors choose Aux-Think as the base model instead of stronger methods such as Progress-Think or StreamVLN, which achieve better performance in Table 1? Evaluating the framework on additional backbones would provide stronger evidence of its generalizability and contribution.
-
Performance gains on more challenging navigation benchmarks. RxR-CE generally involves longer and more challenging navigation trajectories than R2R-CE, where reliable progress grounding is particularly important. However, the proposed method improves SR from 54.8% to 67.5% on R2R-CE, compared with 52.2% to 59.7% on RxR-CE. Could the authors explain the relatively smaller improvement on RxR-CE? More importantly, how much of the improvement comes from standard reinforcement fine-tuning, and how much can be specifically attributed to the proposed counterfactual evidence-seeking optimization? Although Table 6 provides a relevant ablation on R2R-CE, an equivalent analysis on RxR-CE would help clarify this distinction. This requires further research by the authors to determine whether the performance improvement can genuinely be attributed to the proposed evidence-seeking framework.
-
Insufficient comparisons with recent VLN methods. Table 1 includes only one method from 2026, despite the emergence of several recent VLN approaches. In particular, the paper discusses methods such as AwareVLN and Dual-Anchoring in the related work but does not include them in the experimental comparisons. Could the authors provide comparisons with more recent and relevant methods under compatible evaluation settings, or explain why these methods were excluded? Such comparisons would help establish the competitiveness of SeekVLN against current VLN approaches.
I would currently lean toward a borderline reject, but I would be open to increasing the rating if the rebuttal provides clarifications on the questions and concerns.
7 comments
Consolidated Response to Reviewer D1hG (Q2)
Question 2: Smaller RxR gains and the contribution beyond standard RL.
Response:
Thank you for raising these questions. SeekVLN’s RxR-CE results are obtained without any RxR training, and our ablations show that counterfactual optimization improves over standard PPO on both benchmarks. We have clarified this transfer setting and added the corresponding RxR-CE reward ablations.
Q2.1 RxR-CE is evaluated without RxR training.
"Performance gains on more challenging navigation benchmarks. RxR-CE generally involves longer and more challenging navigation trajectories than R2R-CE, where reliable progress grounding is particularly important. However, the proposed method improves SR from 54.8% to 67.5% on R2R-CE, compared with 52.2% to 59.7% on RxR-CE. Could the authors explain the relatively smaller improvement on RxR-CE? "
We believe that training exclusively on R2R-CE is the main reason for the smaller gains on RxR-CE. Neither SFT nor RFT uses any RxR data, so RxR-CE evaluation is an out-of-distribution, zero-shot transfer test. Nevertheless, with only approximately 4.8K R2R-CE training episodes across the two stages, SeekVLN improves RxR-CE SR by 7.5 percentage points over Aux-Think. This gain supports the effectiveness of evidence seeking for progress reasoning and grounding in longer-horizon navigation tasks.
Q2.2 C2PO improves over standard PPO.
"More importantly, how much of the improvement comes from standard reinforcement fine-tuning, and how much can be specifically attributed to the proposed counterfactual evidence-seeking optimization? "
The w/o CF Reward variant in Table 6 of the original submission is standard PPO fine-tuning: it retains the FRG-SFT initialization and outcome reward but removes the counterfactual reward. This comparison therefore isolates C2PO’s additional contribution beyond standard reinforcement fine-tuning. As shown in Table R.2, Full C2PO improves SR and SPL over this variant by 3.43 and 1.96 percentage points, respectively. The w progress reward control additionally rewards the SEEK branch’s own progress without counterfactual comparison; Full C2PO improves SR/SPL by 2.13/2.66 points over this control. These results are reported in Section 4.3, Table 3 of the revised manuscript.
Table R.2. C2PO reward ablations on R2R-CE Val-Unseen-613 (%).
| Variant | SR ↑ | SPL ↑ |
|---|---|---|
| SeekVLN-FRG-SFT | 60.70 | 55.80 |
| w/o CF Reward | 65.09 | 60.40 |
| w progress reward | 66.39 | 59.70 |
| Full C2PO | 68.52 | 62.36 |
Q2.3 The benefit also transfers to RxR-CE.
"Although Table 6 provides a relevant ablation on R2R-CE, an equivalent analysis on RxR-CE would help clarify this distinction. This requires further research by the authors to determine whether the performance improvement can genuinely be attributed to the proposed evidence-seeking framework."
The added RxR-CE ablations show that C2PO’s benefit over standard PPO generalizes beyond the training benchmark. All variants are trained on R2R-CE and evaluated on RxR-CE Val-Unseen without RxR training. As shown in Table R.4, Full C2PO improves SR and SPL over w/o CF Reward by 2.59 and 0.64 percentage points, respectively, and achieves the best SR, SPL, and NE among the tested variants.
Table R.4. Reward ablations under zero-shot transfer to RxR-CE.
| Variant | SR (%) ↑ | SPL (%) ↑ | NE ↓ |
|---|---|---|---|
| SeekVLN-SFT | 55.70 | 47.40 | 5.8 |
| w/o CF Reward | 57.10 | 49.70 | 5.0 |
| w progress reward | 57.75 | 50.15 | 5.1 |
| Full C2PO | 59.69 | 50.34 | 4.9 |
Thank you for the detailed rebuttal and substantial additional experiments. I appreciate the efforts to address my concerns. In particular, the budget-matched triggering comparisons and the new RxR-CE reward ablations provide stronger evidence for the effectiveness of adaptive seeking and the additional contribution of C2PO over standard PPO.
However, several key concerns remain before increasing the rating:
Does the proposed SeekVLN genuinely recognize insufficient visual evidence? The new TRED analysis is valuable, and the higher SEEK probability under evidence-insufficient states is encouraging. Nevertheless, the original FRG supervision remains strongly dependent on expert action types, while evidence insufficiency may also correlate with turning actions and difficult decision points. Therefore, the observed correlation does not fully establish that the model learns evidence sufficiency rather than action-dependent seeking priors. Could the authors report SEEK probabilities or selection rates under sufficient and insufficient evidence within the same expert-action categories? Additionally, Table R.3 evaluates the SFT model rather than the final C2PO-trained policy. An equivalent analysis of the final policy would directly strengthen the central claim.
Consolidated Response to Reviewer D1hG (W1&W2)
Weakness 1: Insufficient evidence that SeekVLN has learned to recognize insufficient visual evidence.
Response:
We agree that the original end-to-end results and trigger analyses alone do not establish recognition of insufficient evidence. We have therefore revised our diagnostic experiments, introducing Task-Relevant Evidence Diagnosis (TRED) and evidence-conditioned SEEK measurements.
In TRED, an expert VLM reasons over the instruction and observation history to label evidence-sufficient and evidence-insufficient states. We evaluate representative agents on these annotated expert trajectories. All three agents exhibit markedly higher action error rates when evidence is insufficient. Table R.1 shows that SeekVLN reduces errors relative to Aux-Think by 15.98 percentage points under insufficient evidence and 7.14 under sufficient evidence. These results appear in Figs. 1(c) and 3(a) of the revised manuscript, with the diagnostic design in Appendix A.
Table R.1. Action error rates (%) by evidence sufficiency.
On the same offline expert-trajectory states as Table R.1, SeekVLN-SFT’s mean SEEK probability and selection rate increase by 10.79 and 17.07 percentage points under insufficient evidence (Table R.3). This supports its ability to proactively seek at evidence-insufficient states. This analysis is also included in Section 4.4 and Fig. 3(a) of the revised manuscript.
Table R.3. SEEK decisions of SeekVLN (%).
Gap = insufficient − sufficient; pp = percentage points. R.3 reports offline SFT decisions, with probabilities normalized over SEEK/NAV.
FRG’s action-conditioned sampling (Table 2, Appendix B of the original submission) primarily supplies a behavioral prior. C2PO’s counterfactual reward is the key optimization signal designed to train adaptive seeking, measuring its navigation benefit over a matched direct-navigation branch. Together, the new diagnosis and behavioral analyses support SeekVLN’s ability to identify evidence-insufficient states and proactively seek additional observations.
Weakness 2: Fixed three-view seeking limits flexibility and generality.
Response:
The three-view procedure is a specific implementation of evidence seeking; C2PO is not restricted to this design. With sufficient resources, evidence-seeking data could cover different viewing angles and numbers of views, active viewpoint selection, or exploratory movements. Given time and cost constraints, we supplement the current observation with left and right views to demonstrate evidence seeking for reliable progress grounding.
Regarding methods emphasizing general instruction understanding and task-level reasoning, these capabilities alone do not resolve Progress Myopia. Aux-Think explicitly uses task-progress reasoning, yet still exhibits markedly higher action errors under insufficient evidence (Table R.1). This difficulty stems from the physical limitation of partial observability, rather than simply limited reasoning or representation: stronger reasoning over existing observations cannot supply task-relevant visual evidence that has not been observed.
More broadly, C2PO could help VLN models learn proactive reasoning and exploration behaviors beyond evidence seeking. SeekVLN thus addresses an information limitation that understanding and reasoning alone cannot resolve, while C2PO has the potential to support more general proactive behavior learning.