- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces Vision-Only Long-Horizon Navigation (VoLN), a navigation paradigm in which agents navigate toward visually specified goals without separate language instructions. The task emphasizes long-horizon visual-semantic reasoning through semantic beacons encountered during navigation. The authors construct VoLN-UAV, a benchmark containing 7,210 episodes across 17 simulated environments, with active beacons providing task-relevant guidance and passive beacons serving as distractors. They also propose VoLN-MLLM, a two-stage framework that aligns DINO visual features with CLIP's semantic space and uses a LoRA-adapted Vicuna planner to predict short-horizon waypoints and stopping decisions. The proposed method outperforms the adapted baselines across the reported metrics. However, the absolute success rates remain low, reaching only 7.4%, 4.5%, and 1.8% on the Easy, Normal, and Hard subsets of Test-Unseen, respectively.
Critical strengths
-
The paper proposes a meaningful extension of image-goal navigation by introducing semantic guidance encountered during execution. This setting provides an opportunity to investigate how embodied agents use successive environmental cues to support long-horizon decisions without explicit route instructions.
-
VoLN-UAV includes long-distance navigation, continuous 3D movement, viewpoint variation, and unseen environments. The distinction between active and passive beacons provides a potentially useful mechanism for studying task-relevant visual reasoning under distracting observations.
Critical weaknesses
-
A central contribution of VoLN is the requirement to interpret successive task-relevant semantic beacons while ignoring distracting cues. However, the current experiments do not directly establish whether the proposed model learns this capability. In particular, the ablations focus on visual alignment, LoRA adaptation, and backbone selection, without isolating the effects of active beacons, passive beacons, semantic retrieval, or observation history. Consequently, it remains unclear whether the reported improvements arise from multi-stage semantic reasoning or primarily from stronger visual representations and model adaptation.
-
Although VoLN-MLLM outperforms the evaluated baselines, the absolute success rates remain extremely low, particularly on long-horizon episodes. Moreover, the comparisons rely primarily on adapted versions of older navigation architectures, without evaluating stronger recent image-goal or aerial navigation approaches. The absence of stronger reference baselines or informative upper-bound evaluations makes it difficult to determine whether the low success rates reflect the inherent difficulty of the proposed benchmark, limitations of the selected models, or aspects of the task construction.
Questions for authors
-
Could the authors report controlled experiments that remove active beacons, remove passive beacons, or vary the number of distracting beacons? How does the model distinguish task-relevant cues from visually similar distractors? Such experiments would directly test the central reasoning capability targeted by VoLN.
-
Could the authors include more recent image-goal navigation or UAV navigation baselines, or provide a reference upper bound using privileged route information or reliable beacon interpretation? Given the very low absolute SR, these experiments would help establish the solvability and difficulty of the proposed benchmark.
-
How does performance change when the semantic bank or observation history is removed? Since the proposed framework combines several established components, these ablations are important for determining which components actually contribute to long-horizon visual-semantic reasoning.
-
Appendix B describes a nine-dimensional state vector containing linear velocity, angular velocity, and relative displacement, while the main text excludes GPS and world-frame position. Could the authors clarify how relative displacement is computed and confirm that it does not introduce privileged goal or reference-trajectory information?
I would currently lean toward a borderline reject, but I would be open to increasing the rating if the rebuttal provides clarifications on the questions and concerns.
5 comments
Reply to Reviewer TzpW — Part 2
Q3. How does performance change when the semantic bank or observation history is removed?
We thank the reviewer for suggesting these input ablations. We added Current-only and No-Semantic, with the corresponding input settings applied consistently during both training and testing.
- Current-only retains only the current visual, semantic, and constructed-state inputs, removing the preceding seven observations from the history.
- No-Semantic retains the aligned visual features and eight-observation visual and constructed-state history, while removing the retrieved-descriptor tokens and their similarity embeddings.
Both comparisons retain the same target-confirmation procedure, data split, training budget, and runtime seed pool. Section 6.3 and Appendix B specify the input configurations. Table 2 reports the Test-Unseen results:
| Setting | CT/s ↓ | EER/% ↓ | NE/m ↓ | SR/% ↑ | OSR/% ↑ | nDTW/% ↑ | SPL/% ↑ |
|---|---|---|---|---|---|---|---|
| Full | 1.25 | 0.5 | 94.6 | 15.0 | 16.9 | 49.9 | 10.7 |
| Current-only | 1.05 | 0.9 | 134.8 | 7.8 | 10.2 | 43.8 | 5.3 |
| No-Semantic | 1.40 | 1.1 | 128.9 | 8.7 | 12.7 | 35.5 | 5.0 |
Current-only reduces average cycle time but lowers navigation performance. Retaining recent history allows earlier observations, semantic cues, and motion states to remain available for subsequent waypoint predictions.
No-Semantic also reduces navigation performance while preserving the aligned visual representation. This supports an additional contribution from explicit semantic inputs beyond visual alignment.
Q4. Relative displacement and planner inputs
We thank the reviewer for requesting this clarification. The revision distinguishes platform measurements from the nine-dimensional constructed state supplied to the planner:
The three components are body-frame linear velocity, angular velocity, and displacement between consecutive observation samples.
The displacement term records the UAV's 3D position change between two consecutive RGB observations, sampled 2 s apart, expressed in the body frame at the current observation. It is computed by subtracting the previous measured position from the current position and rotating the difference into the current body frame.
Let be the measured UAV position at observation time , and let rotate the current body frame into the world frame:
The first displacement is set to zero.
The pose measurements come from AirSim in simulation and motion capture on the physical testbed. The planner receives this three-dimensional displacement together with body-frame linear and angular velocities as its nine-dimensional motion-state input.
Sections 3 and 5 and Appendix B now specify these distinctions between platform measurements, state construction, and planner inputs.
Thank you for the detailed rebuttal and additional experiments. I appreciate the efforts to improve the evaluation, particularly the inclusion of TravelUAV-VG, the semantic and observation-history ablations, and the clarification of relative displacement. These additions have addressed several of my original concerns.
Before raising my score, please discuss the issue further:
The No-Passive experiment is useful, but the improvement is relatively modest (15.0% to 16.1% SR). Moreover, removing visual distractors does not directly demonstrate that the model can identify task-relevant active beacons or distinguish their semantic guidance from competing cues. While I understand that removing all active beacons changes the task setting, controlled interventions such as masking selected active beacons or changing their directional semantics could directly assess whether the model relies on these cues for navigation. Such analysis would better support the central motivation of VoLN.
Reply to Reviewer TzpW — Part 1
We thank the reviewer for the suggestions on beacon controls, stronger baselines, and benchmark difficulty.
Q1. Beacon controls and cue relevance
We added No-Passive, which removes passive beacons while preserving active guidance, together with the Left-only placement control.
The comparisons use the same trained checkpoint, paired Test-Unseen episodes, and runtime seeds, without retraining. Standard uses equal-probability left/right placement of active beacons. Left-only fixes them on the left while retaining their forward and vertical offsets and the passive-beacon layout. No-Passive preserves the Standard active-beacon layout. Section 6.3 and Table 3 report:
Removing passive beacons improves route adherence and goal-region entry under unchanged active guidance. This indicates that competing cues remain a source of navigation difficulty for the reference policy. The slight decrease with Left-only shows a modest influence of placement geometry on navigation decisions.
Active beacons provide the route guidance that VoLN is designed to study. Removing them changes the task to image-goal exploration and no longer evaluates how the agent interprets and follows the designated visual guidance. We therefore retain active beacons in the controls examining beacon placement and competing cues.
Regarding cue relevance, the planner receives no active/passive labels, reference route, or future reference waypoints. A global image representation is used to retrieve a semantic descriptor, and its similarity score measures image–descriptor correspondence. The planner combines this semantic input with the recent visual and constructed-state history to predict waypoints.
The planner has no separate per-beacon relevance classifier. Section 5 and Appendix B describe the input flow; Q3 reports the semantic and history ablations.
Q2. Stronger baselines and failure analysis
We added TravelUAV-VG, adapted from the OpenUAV implementation. It replaces language instructions with goal images and uses visual history and constructed motion states to predict eight body-frame 3D waypoints. TravelUAV-VG and VoLN-MLLM use the same Vicuna-7B language backbone, training split, waypoint supervision, controller, target-confirmation procedure, and evaluation budget.
Under the revised protocol, SR requires correct target confirmation and episode termination within 40 m of the target asset's 3D center. OSR records whether the executed trajectory enters the same region. All methods use the same target-confirmation procedure and evaluation criteria.
Section 6.1 describes the baseline adaptation, and Table 1 reports the following Test-Unseen results:
TravelUAV-VG achieves higher SR than the three lightweight baselines across all difficulty levels. VoLN-MLLM further improves on this stronger baseline, with its advantages in SR and nDTW increasing from Easy to Hard.
To examine the remaining failures, Section 6.2 reports the following breakdown across five Test-Unseen runs:
Budget exhaustion before goal-region entry is the dominant recorded failure event. This indicates that reaching the destination within the evaluation budget remains the main challenge for the reference policy, while collision avoidance and reliable termination also affect performance.