- Rating
- 2(+1)
- Confidence
- 3
- Informativeness
- 2(+1)
- Presentation
- 2
- Soundness
- 2(+1)
Read review
Paper summary
This paper proposes RCPNav for aerial vision-and-language navigation. The framework combines a reversible cruise–precision controller, selective keyframe memory, and a language-grounded landmark graph to support long-range navigation and near-target localization. Experiments on CityNav show improvements in success rate and path efficiency.
Critical strengths
RCPNav provides a coherent framework that combines current observations, historical visual evidence, and landmark relations.
The reversible controller addresses premature switching from long-range navigation to local search.
The method achieves strong results on CityNav, and the separately retrained ablations show that all three components contribute to performance.
Critical weaknesses
Limited methodological novelty. The proposed framework mainly combines heuristic mode switching, keyframe memory, landmark-graph encoding, and multimodal fusion. These components are largely standard, making the contribution primarily an engineering integration.
Insufficient justification of the design choices. The experiments do not compare the proposed components with simpler alternatives, so the necessity of the reversible controller, Top-2 keyframe selection, and landmark graph remains unclear.
Limited experimental generalization. The evaluation is restricted to the original and refined versions of CityNav, which are variants of the same benchmark. The ablations are conducted only on one validation split, without statistical variance or significance analysis.
Limited robustness analysis. The method relies heavily on progress estimation, manually selected switching thresholds, and annotated landmarks, but its sensitivity to inaccurate progress predictions, missing landmarks, or different threshold settings is not evaluated.
Questions for authors
See Weaknesses.
11 comments
W3. Experimental Generalization
We selected CityNav because it directly evaluates the task RCPNav is designed for: locating language-described destinations using named landmarks and geographic information. Closely related methods, including HETT (Ding et al., 2026) and HTNav (Fan et al., 2026), report results on both original and refined CityNav, enabling comparisons under a common task setting.
Other aerial VLN benchmarks differ in their navigation objectives, instruction formats, and environments:
CityNav (Lee et al., 2025) provides goal descriptions grounded in nearby landmarks and geographic relationships. Its CityFlight simulator renders real-world 3D point clouds of Cambridge and Birmingham.
AerialVLN (Liu et al., 2023) uses human-written, step-by-step flight instructions aligned with trajectory segments in Unreal Engine 4 and AirSim environments.
OpenFly (Gao et al., 2026) provides automatically generated route instructions and trajectories across Unreal Engine, GTA V, Google Earth, and 3D Gaussian Splatting environments.
UAV-Need-Help (Wang et al., 2025) evaluates target-oriented navigation with different levels of assistant guidance in continuous six-degree-of-freedom UAV simulation.
Section 4.1 describes both CityNav versions. We evaluate navigation performance in scenes unseen during training using CityNav’s val-unseen and test-unseen splits. In the revision, Table 1 adds GeoNav on original CityNav, and Tables 2 and 3 expand the ablations on refined CityNav val-unseen.
W4. Robustness to Progress Estimates, Switching Thresholds, and Landmark Annotations
We report additional sensitivity experiments below on refined CityNav val-unseen. Section 3.3 describes the default switching and STOP rules, Section 3.4 describes the two-frame memory, and Section 4.1 specifies the landmark annotation protocol.
(1) Switching and STOP Thresholds. RCPNav uses three Progress thresholds for entering Precision, returning to Cruise, and STOP confirmation. The default values are 0.80/0.70/0.90, with STOP requiring two consecutive predictions meeting its threshold. We vary these thresholds while keeping the other components unchanged.
| Entry / Return / STOP | NE↓ | SR↑ | OSR↑ | SPL↑ |
|---|---|---|---|---|
| 0.80 / 0.70 / 0.90 (Default) | 48.5 | 21.3 | 34.0 | 19.9 |
| 0.70 / 0.60 / 0.90 | 52.8 | 19.6 | 32.6 | 18.0 |
| 0.90 / 0.80 / 0.90 | 53.2 | 17.7 | 31.6 | 15.9 |
| 0.80 / 0.70 / 0.85 | 52.4 | 20.1 | 30.7 | 18.9 |
| 0.80 / 0.70 / 0.95 | 53.3 | 21.5 | 38.5 | 19.5 |
The default thresholds achieve the lowest NE (48.5 m) and highest SPL (19.9%). Lowering or raising the mode-switching thresholds reduces SR and SPL. Increasing the STOP threshold to 0.95 slightly improves SR and OSR but increases NE and reduces SPL. Overall, the default setting provides a favorable balance between final localization accuracy, navigation success, and path efficiency.
(2) Historical Memory Capacity. We further evaluate different numbers of retained historical keyframes , using the same keyframe selection and readout mechanisms.
| Historical Frames | NE↓ | SR↑ | OSR↑ | SPL↑ |
|---|---|---|---|---|
| K=1 | 54.1 | 19.5 | 32.3 | 17.9 |
| K=2 (Default) | 48.5 | 21.3 | 34.0 | 19.9 |
| K=4 | 50.7 | 22.3 | 35.6 | 20.6 |
Increasing K from 1 to 2 improves all four metrics. Increasing K to 4 further improves SR by 1.0 percentage point, OSR by 1.6 points, and SPL by 0.7 points, although NE increases from 48.5 m to 50.7 m.
Moreover, K=4 doubles the maximum number of retained historical frames and memory tokens compared with K=2, increasing historical visual processing, storage, and attention computation. We therefore adopt K=2 as a compact performance–cost trade-off, achieving the lowest NE while maintaining competitive navigation success and path efficiency.
(3) Landmark Annotations. The original CityNav pipeline (Lee et al., 2025) uses GPT-3.5 to extract landmark names from navigation instructions and retrieves corresponding geographic regions from OpenStreetMap. RCPNav constructs its landmark graph using the named landmarks and geographic footprints provided by CityRefer.
HETT (Ding et al., 2026) manually refined the CityNav annotations by restoring missing landmark references and correcting erroneous associations. HTNav (Fan et al., 2026) also reports manual inspection and correction of missing annotations, extraction errors, and misspelled landmark names.
As described in Section 4.1, we train on HETT-refined CityNav, which corrects landmark annotations and excludes 311 episodes. For retained episodes, the instructions and demonstration trajectories are unchanged. Table 1 reports results on both versions.
We thank the reviewer for the detailed comments. We clarify how RCPNav differs from existing approaches and provide additional controlled experiments supporting our design choices.
W1. Methodological Novelty
RCPNav addresses when to switch between global navigation and local search during long-range aerial navigation. Underestimating the distance to the destination can trigger local search prematurely, and subsequent observations can change the estimated goal location. RCPNav allows the agent to resume cruise as its estimate changes and uses past visual observations and spatial relations among landmarks to refine its estimate of the destination.
Reversible cruise–precision control. HETT (Ding et al., 2026) predicts a coarse goal location and then refines local actions. HTNav (Fan et al., 2026) generates the next waypoint once the agent reaches its current subgoal. RCPNav continues to update its estimated distance to the final destination during precision control. If the updated estimate indicates that the destination is still far away, the agent can resume cruise from its current position, recovering from a premature switch to local search.
Historical memory. HETT aggregates past visual features in a spatial grid, and OpenFly-Agent (Gao et al., 2026) updates its keyframe memory in first-in, first-out order. RCPNav retains two keyframes based on the visibility of landmarks mentioned in the instruction. The agent can therefore use relevant visual evidence after those landmarks leave its current field of view.
Landmark graph. GeoNav (Xu et al., 2026) uses dynamic cognitive maps and hierarchical scene graphs, and LookasideVLN (Ning et al., 2026) models directional relationships between landmarks. RCPNav weights messages by the distance between landmarks and uses an instruction-conditioned readout to combine spatial cues from multiple landmarks when predicting the destination.
W2. Justification of Design Choices
We expanded Section 4.3 to compare simpler alternatives for all three components on refined CityNav val-unseen. Table 2 reports the controller and memory controls, and Table 3 reports the graph controls with and without auxiliary supervision.
(1) Controller and Historical Memory. Cruise only disables Precision; No return to Cruise retains both modes but prohibits the return transition; No history removes stored keyframes; and FIFO-2 (First-In, First-Out) replaces the oldest stored frame in a full two-frame cache rather than selecting frames by score.
Compared with No return to Cruise, reversible control improves SR by 1.1 points and SPL by 0.9 points. Compared with FIFO-2, selective memory improves SR by 1.5 points, OSR by 2.2 points, and SPL by 0.7 points, while reducing NE by 3.9 m.
These results support both reversible mode switching and selective keyframe retention over simpler alternatives.
(2) Landmark Graph. Self-only replaces the adjacency matrix with A=I, disabling cross-node message passing while retaining landmark inputs and instruction-conditioned readout. We compare it with the full graph under two auxiliary-loss settings.
With auxiliary supervision, the full graph improves SR by 1.0 point and SPL by 2.2 points over Self-only. Without auxiliary supervision, it still improves SR by 2.2 points and SPL by 1.0 point.
The gains in SR and SPL hold under both settings. The effect on NE depends on the loss setting, as discussed in Section 4.3.