- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces FLIGHT, a benchmark for instruction-guided UAV navigation and reasoning tasks, combining multi-stage textual instructions with dense 6-DoF trajectory annotations across two splits: Fine-grained VLN and Long-horizon Flow. To address the temporal mismatch between high-frequency control and low-frequency semantic understanding, the authors propose FLIGHT VLA, an asynchronous architecture that decouples a streaming VLM for task-state reasoning from a high-frequency diffusion action model for continuous control, supervised by explicit "Pilot Reasoning" texts. While the paper tackles an important and challenging problem in embodied aerial agents, it suffers from significant limitations regarding real-world validation and the clarification of its technical novelty over existing video-based VLN/VLA frameworks with chain-of-thought reasoning.
Critical strengths
- Comprehensive Benchmark Design: The FLIGHT benchmark addresses gaps in prior datasets by scaling up to multi-stage compositions, dense local referential constraints, and continuous action supervision rather than sparse waypoints or discrete choices.
- Asynchronous Architecture Design: The proposed slow-fast asynchronous architecture (decoupling the streaming Pilot VLM from the high-frequency Diffusion Action Model) is logically sound and practically well-engineered to handle inference latency during deployment.
Critical weaknesses
[! I personally think the authors should submit to the Primary Area: datasets and benchmarks rather than Primary Area: applications to robotics, autonomy, planning. The review is based on the principle in applications to robotics, autonomy, planning]
-
Absence of Real-World Physical Experiments Given that the paper emphasizes real-world deployment challenges—such as latency-aware alignment, continuous control feasibility, and sensor-based telemetry—the complete lack of real-world physical flight experiments severely undermines the claims of practical applicability. To truly substantiate the paper's claims on long-horizon capabilities, the authors must provide real-world hardware experiments demonstrating stable, continuous autonomous flight exceeding 1 minute in duration under complex, multi-stage semantic instructions. Simulation-only results are insufficient to prove that the proposed diffusion action model and streaming VLM are robust against real-world aerodynamic disturbances, visual domain gaps, and sensor noise.
-
Unclear Novelty and Outdated Baseline Selection The paper emphasizes "Pilot Reasoning" (explicitly generating text on current state and next-step planning) to bridge high-level reasoning and low-level control. However, Chain-of-Thought (CoT) reasoning and intermediate task decomposition have already been extensively explored in recent VLN and VLA literature (e.g.,ABot-N0). I think the contribution in method is merely a straightforward domain adaptation of streaming VLM and diffusion action models to UAVs. The chosen baselines (such as CMA+LAG and NaVid) are relatively outdated given the rapid progress in VLN. Recent open-source SOTA frameworks and benchmarks—such as LightNav, NaviDA—should be included as baselines. Comparing only against older models makes it difficult to ascertain whether FLIGHT VLA's performance gains stem from genuine architectural superiority or simply from using a stronger base model and task design.
While the FLIGHT benchmark could potentially serve as a valuable resource for the embodied aerial navigation community, there remains a substantial gap on the methodological side. The paper lacks sufficient novelty over existing CoT/VLN paradigms, relies on outdated baseline comparisons, and lacks real-world physical flight validation to back its claims on long-horizon continuous control.
Questions for authors
See Weakness
2 comments
Thanks for the detailed response. However, after carefully reading the rebuttal, my primary concerns regarding the paper's suitability for the Robotics, Autonomy, and Planning track, its lack of real-world experimental validation, and its methodological novelty and missing sota baselines remain unaddressed. I decide to keep my score.
Thank you for recognizing the contributions of our dataset. Our work is the first to couple long-horizon semantic navigation with fine-grained UAV control, helping unlock the potential of embodied intelligence models, such as vision-language-action (VLA) models, for UAV navigation. We respectfully encourage the reviewer to further consider the potential value of this dataset and benchmark and their contributions to the community.
Although we do not claim to be the first to apply chain-of-thought (CoT) reasoning to navigation, we are the first to systematically incorporate Pilot Reasoning, a navigation CoT modality, into a UAV dataset, together with a dedicated CoT design and annotation pipeline. To the best of our knowledge, existing UAV datasets do not provide a text modality covering fine-grained flight descriptions and task planning during flight. Our method demonstrates the effectiveness of Pilot Reasoning text for task supervision and historical memory management, providing a foundation for future work to incorporate CoT text into training and inference. We hope the reviewer will recognize this contribution to dataset design. Furthermore, our framework couples long-horizon, multi-stage semantic understanding with real-time UAV control, enabling end-to-end semantic understanding and fine-grained control, including obstacle avoidance. To the best of our knowledge, no prior work has achieved this coupling end to end.
Our architecture also differs substantially from ABot-N0. Approaches such as ABot-N0 fully separate navigation CoT reasoning from action generation through explicit if–else branching, effectively using text to pretrain the “Brain” module without supporting in-flight reasoning and memory management. In our architecture, textual reasoning and action generation proceed concurrently during inference. We further integrate latency-aware training with asynchronous inference to fully exploit explicit textual analysis and historical information management during flight, more closely aligning with the purpose of CoT reasoning.
Compared with conventional VLN methods, our design also incorporates several considerations for real-world deployment. Practical constraints prevented us from conducting real-world flight tests in urban environments. Nevertheless, our simulation environment supports continuous control and advances continuously, streaming image frames as the UAV moves. Compared with the stepwise decision-making of conventional baselines, concurrent inference and UAV operation offer an advantage for deployment. The following table provides additional measurements of inference latency.
Latency was measured on an RTX 4090: