- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes SeeNav-Agent, combining dual-view visual prompting with step-level reinforcement fine-tuning for vision-language navigation. Visual prompts add target bounding boxes, navigation lines, and action markers to frontal and bird’s-eye views, while SRGPO normalizes step rewards within randomly sampled cross-task groups and combines them with episode-level advantages for policy optimization. GPT-4.1+VP achieves 86.7% SR on Embench-Nav, and Qwen2.5-VL-3B+VP+SRGPO achieves 72.3%/39.1% SR on Embench-Nav/R2R-CE.
Critical strengths
1. The visual-prompt ablations demonstrate how presentation affects the use of additional spatial information.
In Table 2, adding dual views and view alignment alone reduces SR from 65.0% to 45.0%, whereas the complete prompting configuration achieves 86.7%. This provides useful empirical insights into navigation interface design in settings where privileged information is available.
2. SRGPO substantially outperforms a baseline using the same process rewards.
Compared with VP+GiGPO using the same VPR, VP+SRGPO improves SR by 15.1/11.0 percentage points on Embench-Nav/R2R-CE. Grouping-strategy ablations and cross-scene evaluations further support the training scheme’s effectiveness in the evaluated settings.
Critical weaknesses
1. The method relies on privileged spatial and target information at test time, without establishing its practical availability or comparison fairness.
The authors directly use simulator ground truth to construct bird’s-eye views and target boxes, together with agent poses to draw target-direction lines, providing target-location cues even when the target leaves the frontal view. On the one hand, this substantially limits its practical applicability, as such information is often unavailable in real-world settings. On the other hand, since the main baselines are not shown to receive equivalent information, the reported gains cannot separate the contribution of visual prompting from the advantage of additional ground-truth information, limiting the conclusions for conventional VLN settings.
- SRGPO’s central justification conflates consistent reward semantics with comparable action values across states.
Equation (1) rewards immediate distance reduction or restored target visibility, but necessary detours may receive zero reward while repeatedly looking away and reacquiring the target may receive repeated positive rewards, so these signals do not directly represent actions’ long-term value across states. The paper neither analyzes these biases nor compares against policy optimization using the same dense rewards with ordinary batch normalization, leaving the algorithmic contribution of random grouping beyond reward shaping unestablished.
Questions for authors
1..How much benefit does visual prompting provide after controlling for access to ground-truth information? Please compare against baselines receiving equivalent spatial and target information, and evaluate performance when predicted BEVs, detected boxes, or noisy poses replace ground truth.
2.How does the process reward handle necessary detours and repeated recovery of target visibility? Please specify clarify whether the step-level reward conflicts with eventual task success in these cases.
3.What is the independent contribution of random grouping over ordinary reward normalization? Under identical inputs, process rewards, and environment-interaction budgets, does SRGPO consistently outperform full-batch reward normalization or standard return estimation?