- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The authors introduce AirGroundVLN, a large-scale benchmark for vision-and-language navigation (VLN) with collaborative UAV and UGV agents. Compared with prior aerial VLN benchmarks, AirGroundVLN focuses on air-ground collaboration, providing 10,281 navigation episodes across 19 Unreal Engine environments. This paper also proposes AG-CoNAV, a framework that incorporates Spatiotemporally Anchored Collaborative Memory (SACM) and Aerial-Guided Regional-to-Local Planning (AGRLP) with a Qwen VLM backbone. In the experiments, AG-CoNAV consistently outperforms both training-free and training-based baselines.
Critical strengths
-
The problem setting with heterogeneous UAV-UGV collaboration for goal-oriented VLN is interesting. Since most prior work focuses on a single UAV agent, this setting opens a new avenue for studying collaboration under asymmetric perception and mobility constraints.
-
The proposed method demonstrates strong empirical performance. The ablation results show that both SACM and AGRLP contribute to the final performance, with SACM providing a relatively large improvement.
Critical weaknesses
-
I think the major weakness lies in the limited fundamental distinction from AeroDuo. AeroDuo also considers a collaborative navigation setting with two UAVs operating from complementary viewpoints, whereas AirGroundVLN appears to replace one of the UAVs with a UGV while retaining a similar hierarchical collaboration structure. The problem formulation is quite close, and the dataset scale is also comparable.
-
It is also unclear whether the proposed method is specifically tailored to AirGroundVLN or whether it generalizes to other collaborative VLN settings. Evaluating AG-CoNAV on the AeroDuo benchmark would be valuable. This would also help clarify whether SACM and AGRLP provide benefits for collaborative navigation more broadly, rather than primarily exploiting the particular structure of AirGroundVLN.
Questions for authors
I have no critical questions but please address weaknesses.
Response to Reviewer 2e2e
Dear Reviewer 2e2e,
We sincerely thank you for your thoughtful evaluation and constructive feedback. We appreciate your positive assessment of the heterogeneous UAV–UGV collaboration setting and the contributions of SACM and AGRLP. We provide detailed responses to your concerns below.
Thank you for highlighting the need to clarify the distinction between AirGroundVLN and AeroDuo.
(1) Benchmark and Task Formulation
(i) AeroDuo studies homogeneous collaboration between two UAVs operating at different altitudes and exploiting complementary aerial viewpoints. In contrast, AirGroundVLN studies heterogeneous air–ground collaboration, where aerial observations guide a UGV toward a language-specified, ground-reachable target. This is not merely a platform substitution, as the UGV operates under ground-specific navigation constraints and has a fundamentally different action space from a UAV.
(ii) AirGroundVLN focuses on ground-reachable targets and includes 955 target instances across six categories: humans, vehicles, urban infrastructure, daily-life services, industrial infrastructure, and other objects.
(iii) AirGroundVLN further introduces an aerial-visibility protocol that distinguishes aerial-visible and aerial-occluded targets, enabling an explicit evaluation of navigation under different aerial visibility conditions. For evaluation, AirGroundVLN contains 962 test-seen and 848 test-unseen episodes (1,810 in total), compared with 350 validation episodes in AeroDuo.
(2) Method Design
Although both methods adopt a hierarchical collaboration structure, their coordination mechanisms and planning objectives are fundamentally different.
(i) AeroDuo uses a high-altitude Pilot-LLM to predict target-region probability maps. As described in Sec. 4.2 of AeroDuo, the high-altitude UAV computes its flight direction and step length from language instructions and compass data. AG-CoNAV jointly predicts UAV and UGV waypoint distributions through a shared memory-augmented multimodal model.
(ii) AG-CoNAV combines collaborative memory and planning. SACM retrieves observations across views and time using spatial anchors, dispersion, and timestamps. The retrieved context informs platform-specific waypoint predictions, and AGRLP combines regional aerial guidance with local UGV planning under ground traversability constraints.
Thank you for your valuable suggestion. To this end, we adapt AG-CoNAV to AeroDuo's two-UAV collaborative navigation setting and evaluate it on the HaL-13k benchmark using its official Unseen Map and Unseen Object splits. Specifically, we retain Qwen3.5-2B as the VLM backbone and replace the UGV with a low-altitude UAV to adapt AG-CoNAV to the two-UAV setting. For SACM, we store one memory entry every five frames, using the corresponding images and camera poses provided in action.json. The waypoint predictions are supervised using the ground-truth waypoints provided in gt_waypoints.json. For evaluation, we follow AeroDuo's original success criterion, using a 20 m success threshold instead of the 5 m threshold adopted in AirGroundVLN.
The results are reported below.
Compared with AeroDuo, the adapted AG-CoNAV achieves consistent improvements on both the Unseen Map and Unseen Object splits. These results provide cross-benchmark evidence for the effectiveness of integrating collaborative memory and coordinated planning in multi-agent navigation.