- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
One value-guided Navigation is proposed to learn dense traversability-aware and goal-conditioned planning representations for downstream navigation. Extensive experiments across multiple outdoor datasets, closed-loop simulation environments, and real-world deployment on a Unitree Go2 robot demonstrate effective RGB-based traversability estimation and local motion planning
Critical strengths
The training strategy is interesting. Without relying on collected trajectory demonstration, VGC generates pseudo-labels from RGB images, which allows training from static image data with on relying on real‑robot interaction.
The representation is learned goal‑aware cost‑to‑go representations in image space for downstream planners.
The evaluations are extensive, such as open‑loop cross‑dataset generalization, simulation closed‑loop navigation
Critical weaknesses
VGN performs on 2D images, with not considerations of depth, 3D geometry. As such, It lacks explicit depth estimation, which may introduce ambiguous traversability for tall grass, uneven terrain, foreground occlusions.
The supervision pipeline relies on GroundingDINO + SAM for semantic segmentation, plus manually hand‑coded traversability prior ranges for each terrain category. The quality of pseudo‑labels is not accurate and degrade the performances and downstream generalization ability.
The ablation studies show modest marginal gains from cost‑to‑go. Specifically, Table 5 shows only moderate navigation improvements when adding learned cost‑to‑go on top of pure traversability.
Questions for authors
Check the detailed comments in Weaknesses part.
3 comments
Response Reminder
Dear Reviewer,
As we approach the end of the discussion period, we invite you to review the authors’ response to your comments. Please update us on whether your concerns have been sufficiently addressed and whether you wish to pose further questions to the authors.
We greatly appreciate your contribution.
The authors mainly address my comments and provide additional experiments to address my comments on the performance gains of the GroundingDINO + SAM. I maintain my previous rating.
W1: We agree that the absence of explicit depth and 3D geometric reasoning is a limitation of VGN, as already acknowledged in Section 5 of the original submission. Our focus is on learning navigation-oriented representations directly from monocular RGB images without explicit geometric reconstruction. We specifically discuss challenges involving ambiguous traversability in tall grass and uneven terrain, foreground occlusions, and nearby obstacles. Incorporating depth- and geometry-aware planning remains an important direction for future work.
W2: We acknowledge that errors in GroundedSAM predictions and manually assigned traversability priors may propagate to the student and affect generalization. To further assess prediction quality beyond teacher-generated pseudo-labels, we added an evaluation against traversability references derived from human-annotated semantic labels (revised paper Table 3). On RUGD, VGN achieves MAE 0.082 and IoU 0.663, compared with 0.085 and 0.664 for the teacher. On Cityscapes, VGN achieves MAE 0.056 and IoU 0.929, compared with 0.042 and 0.936 for the teacher.
Table 3: Traversability evaluation using semantic-label-derived GT.
The lower IoU on RUGD is primarily associated with mulch regions, where GroundedSAM often assigns higher-traversability terrain categories, resulting in elevated teacher and student predictions. Appendix B in the revised manuscript details the reference construction and analyzes this discrepancy. Although these references rely on semantic traversability assumptions rather than physical measurements, they provide complementary evidence beyond teacher–student agreement and the existing human pairwise evaluation (Table 2). We have also explicitly acknowledged the potential impact of pseudo-label errors and handcrafted priors on generalization in the revised manuscript’s Section 5.
Moreover, we have added an independent zero-shot traversability evaluation on the CaT dataset (Appendix B), using externally annotated navigability ground truth. Without any fine-tuning or adaptation, the RUGD-trained VGN achieves an IoU of 0.814 and F1-score of 0.897, compared with 0.706/0.828 for W-RIZZ and 0.806/0.893 for CHUNGUS, respectively. VGN also achieves the highest IoU, F1-score, and recall across all evaluated thresholds (0.3, 0.4, and 0.5). We additionally provide qualitative comparisons.
Table 12: Zero-shot traversability evaluation on the CaT validation set at different prediction thresholds. Best results within each threshold are highlighted in bold.
W3: We agree with the reviewer that adding learned CTG to conventional graph search provides modest improvements, as shown in Table 5 (revised manuscript: Table 6). This is partly because conventional graph search already computes paths using the traversability map, limiting the additional benefit of an explicit cost-to-go representation. However, our objective extends beyond improving conventional graph search to learning an explicit, goal-conditioned planning representation. As demonstrated in our original submission, direct gradient rollout and gradient-guided sampling using learned CTG achieve 68% and 65% success in Forest, and 71% and 68% in City, respectively (original manuscript: Table 4; revised manuscript: Table 5). These results demonstrate that learned CTG can directly guide navigation without relying on conventional graph search. We further added a controlled comparison in Table 8, showing that learned CTG achieves comparable navigation performance to Dijkstra-derived CTG across different planning mechanisms. Beyond this demonstrated utility, its differentiable architecture offers potential for future joint optimization with compatible differentiable planning frameworks.