- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
GeoRisk-IL augments imitation learning for UAV vision-language navigation with geometric feature alignment to a frozen DA3 model and a clearance penalty on predicted trajectories. Both components are used only during training. Experiments on OpenUAV and HUGE-Bench report improved navigation success and lower collision rates, with ablations showing additional benefits from combining the two objectives.
Critical strengths
The same-backbone comparisons show substantial improvements. On OpenUAV Unseen Map, success rate increases from 23.49% to 44.89%, while collision rate decreases from 63.26% to 38.94%. These results provide meaningful evidence that the added training objectives are useful.
The auxiliary geometry and risk computations are removed at inference. This makes the approach practical without adding these components to the deployed navigation pipeline.
Critical weaknesses
Physical flight validation is missing. The paper does not report closed-loop experiments with a physical drone in real environments. Since the main contribution concerns safer UAV navigation, physical experiments are important for assessing whether the collision reduction transfers under sensing and localization errors, imperfect trajectory tracking, and inference delay. The practical safety benefits remain unvalidated under these conditions.
The methodological novelty appears limited. Geometric feature alignment and a distance-based trajectory penalty are straightforward training objectives. The main added value appears to be their combination and the observed interaction. However, the synergy ablation is restricted to Test Seen, without corresponding validation on unseen maps or HUGE-Bench. Stronger evidence is needed to establish the scope and significance of this combination.
Questions for authors
1: Additional validation: Can you provide a controlled physical-flight comparison against Qwen3-VL Base, reporting success rate, minimum obstacle clearance, and safety interventions? This would directly address the practical safety limitation.
2: Additional validation: Does the interaction between geometric alignment and the clearance penalty persist beyond Test Seen? A corresponding four-way ablation on an unseen split or HUGE-Bench would help answer this.
3: Clarification: Please specify the voxel size, depth history window, and any filtering applied before voxelization. Also explain the L1 assistant rules, including whether interventions alter actions or episode termination and how they affect the reported metrics.
4: Clarification: LongFly’s UO Full NE in Table 1 is 66.74, while Easy and Hard NE are 54.84 and 57.07. If Full averages these subsets, it should lie between their means. Please check the values and evaluation coverage. This concerns a cited baseline and does not directly invalidate the comparison against Qwen3-VL Base.
3 comments
Reviewer Tuyq — Part 2/3
W2.1: The methodological novelty appears limited. Geometric feature alignment and a distance-based trajectory penalty are straightforward training objectives. The main added value appears to be their combination and the observed interaction.
A: We feel there are some misunderstandings. Our focus is not on ‘a new formulation’ or ‘a new architecture’. Instead, our contribution lies in:
-
Identifying imitation learning (IL)’s potential issue of treating all GT trajectories uniformly. A collision-free expert trajectory may still pass close to obstacles, leaving little tolerance for prediction errors. Mimicking the GT trajectories alone cannot distinguish such a demonstration from one with a larger safety margin, and we need other paradigms to help to lower the crash rate.
-
A simple-yet-effective collision-penalty-based extension to vanilla IL to counteract this issue. We are very delighted to see that all reviewers agree on the effectiveness of the proposed method: “the added training objectives are useful” (your assessment), “the method appears effective” (Reviewer nvy5), and “simple and modular” (Reviewer 6jGt). Since this design can greatly alleviate the collision issue, we find it worth sharing with the community. We purposefully choose its simplest form and present it without any bells and whistles to highlight the effectiveness of this design.
-
Identifying the synergy between the collision penalty and the geometric supervision. In our experiment (see Table 3 of the main paper), as opposed to the gains reported in SpatialFly [1], we find that simply adding geometric signals hardly brings any improvement on TravelUAV dataset: SR changes from 64.74% to 64.46%, while CR remains 29.90%. However, when paired with the collision penalty, geometric supervision increases SR from 71.30% to 77.64% and reduces CR from 21.44% to 17.00%. This shows that the benefit of geometric supervision depends on the presence of an explicit risk-learning objective.
We thank you for noticing this synergy between collision penalty and geometry supervision. However, we want to clarify that it does not cover everything we find worth sharing with the community in this paper.
We will clarify this.
References
[1] W. Jiang et al., “SpatialFly: Geometry-guided representation alignment for UAV vision-and-language navigation in urban environments,” 2026, arXiv:2603.21046.
W2.2: However, the synergy ablation is restricted to Test Seen, without corresponding validation on unseen maps or HUGE-Bench. Stronger evidence is needed to establish the scope and significance of this combination.
A: To test whether the collision penalty strengthens the benefit of geometric alignment beyond Test Seen, we added four-way ablations on OpenUAV Test Unseen Object and Test Unseen Map.
On Test Unseen Object, adding geometric alignment to Base increases SR by 0.96 percentage points, whereas adding it to Penalty only increases SR by 3.66 percentage points. On Test Unseen Map, the corresponding gains are 1.56 and 8.15 percentage points. Thus, on both unseen splits, geometric alignment yields larger SR gains when the collision penalty is present.
Table R3-3. Four-way ablation on OpenUAV Test Unseen Object (UO) and Test Unseen Map (UM).
| Split | Variant | Geometry | Collision | CR ↓ | NE ↓ | SR ↑ | OSR ↑ | SPL ↑ |
|---|---|---|---|---|---|---|---|---|
| UO | Qwen3-VL Base | 25.44 | 38.27 | 69.63 | 78.70 | 65.00 | ||
| UO | Geometry only | 26.23 | 41.74 | 70.59 | 76.95 | 65.84 | ||
| UO | Penalty only | 19.24 | 33.33 | 75.99 | 82.83 | 70.30 | ||
| UO | GeoRisk-IL | 15.90 | 31.23 | 79.65 | 85.69 | 73.76 | ||
| UM | Qwen3-VL Base | 63.26 | 108.96 | 23.49 | 27.77 | 21.70 | ||
| UM | Geometry only | 60.44 | 105.65 | 25.05 | 27.77 | 22.91 | ||
| UM | Penalty only | 41.75 | 90.43 | 36.74 | 40.92 | 33.01 | ||
| UM | GeoRisk-IL | 38.94 | 78.24 | 44.89 | 50.52 | 39.59 |
Reviewer Tuyq — Part 3/3
Q1: Additional validation: Can you provide a controlled physical-flight comparison against Qwen3-VL Base, reporting success rate, minimum obstacle clearance, and safety interventions?
A: Please see W1.
Q2: Additional validation: Does the interaction between geometric alignment and the clearance penalty persist beyond Test Seen?
A: Please see W2.2.
Q3: Clarification: Please specify the voxel size, depth history window, and any filtering applied before voxelization. Also explain the L1 assistant rules, including whether interventions alter actions or episode termination and how they affect the reported metrics.
A: We construct training-time obstacles on OpenUAV and HUGE-Bench using m voxels and depth from the current and two preceding observations. Each non-overlapping window supplies its minimum depth and corresponding pixel location. Indices are deduplicated; occupied voxel centers form the obstacle set.
L1 provides one textual hint at each OpenUAV decision using the expert trajectory and recent UAV motion. Its main rules prioritize ascent and descent guidance: take off when the nearby reference point on the expert trajectory is more than 3 m above the UAV, and landing when the nearby reference point on the expert trajectory is more than 7 m below or the UAV is within 10 m horizontally of the expert trajectory’s endpoint. For the remaining decisions, an angular deviation greater than between recent motion and the direction toward the nearby reference point on the expert trajectory produces left or right; otherwise, the hint is cruise. These hints neither replace predicted trajectories with expert actions nor directly terminate episodes, but they guide the model’s trajectory predictions through the input prompt.
Episodes end when the learned stop head triggers (Appendix A.4), a collision occurs, or the limit of 200 decisions per episode is reached. Base and GeoRisk-IL used identical L1 assistance. We also evaluated both models without any assistance; please refer to Table R1-1 (Reviewer 6jGt W1).
Q4: Clarification: LongFly’s UO Full NE in Table 1 is 66.74, while Easy and Hard NE are 54.84 and 57.07. If Full averages these subsets, it should lie between their means. Please check the values and evaluation coverage. This concerns a cited baseline and does not directly invalidate the comparison against Qwen3-VL Base.
A: Thank you for pointing this out. The LongFly results in our Table 1 were taken directly from Table III of the original paper [2]. We re-checked the source and confirmed that our UO NE entries exactly match the values reported in the original paper. However, we believe this inconsistency among the reported NE values does not affect our main conclusions. We will also contact the LongFly authors for clarification.
References
[2] W. Jiang et al., “LongFly: Long-horizon UAV vision-and-language navigation with spatiotemporal context integration,” 2025, arXiv:2512.22010.
Reviewer Tuyq — Part 1/3
Thank you for recognizing our strengths in 'the substantial improvements in same-backbone comparisons', 'the improved navigation success on unseen maps' and for your constructive feedback.
A: Thank you for pointing out this limitation. We agree that physical-flight validation is important, but outdoor tests are beyond our capabilities at this moment due to regulatory reasons. We apologize for being unable to provide physical flight results within the rebuttal period. Nevertheless, we follow [3-5] and conduct simulated flight experiments that account for multiple conditions encountered in real-world flight. We evaluated Qwen3-VL Base and GeoRisk-IL on OpenUAV Test Unseen Map, mimicking real-world conditions and perturbations in Table R3-1.
Under the perturbations, GeoRisk-IL continues to reduce CR by 24.63 percentage points and increase SR by 18.99 percentage points over Base. These results show that its collision-reduction and task-completion benefits persist under joint sensing and execution perturbations.
We will add this and are committed to adding real-world flight experiments in the future.
Table R3-1. Flight simulation settings to mimic real-world noise and perturbations.
Table R3-2. OpenUAV Test Unseen Map results under default and perturbed conditions.
[3] E. Kaufmann et al., “Champion-level drone racing using deep reinforcement learning,” Nature, vol. 620, no. 7976, pp. 982–987, 2023, doi: 10.1038/s41586-023-06419-4.
[4] S.-A. Yu et al., “FlightBench: Benchmarking learning-based methods for ego-vision-based quadrotors navigation,” IEEE Robotics and Automation Letters, vol. 10, no. 7, pp. 6888–6895, 2025, doi: 10.1109/LRA.2025.3573167.
[5] G. Sui et al., “ProtoVis-Nav: Prototypical visual imagination for visual-spatial aligned UAV navigation,” 2026, arXiv:2611.17330.