- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes HPD, a gradient-free test-time adaptation framework for UAV vision-language navigation. HPD combines MACPA, which uses an online semantic memory and adaptive tokens to improve perception under distribution shift, and EHDC, which calibrates uncertain action predictions using retrieved historical decisions. Experiments on OpenFly and OpenUAV report improved navigation performance over baseline and competing TTA methods.
Critical strengths
-
This paper proposes an effective hierarchical test-time adaptation framework for UAV-VLN. HPD jointly adapts perception and decision making under distribution shift, leading to consistent improvements on OpenFly and OpenUAV.
-
HPD keeps the backbone frozen and avoids test-time backpropagation. On the 1B model, it adds only 68 MB of GPU memory and 21 ms per step. This modest overhead makes its navigation gains practically appealing.
Critical weaknesses
-
The novelty of MACPA needs to be better clarified. IDEA [1] has already explored storing historical adaptation knowledge in an external memory for online VLN adaptation and reusing such knowledge based on the relevance between the current and historical environments. The core paradigm of MACPA appears highly similar to that of IDEA. The authors should therefore clarify the methodological novelty of MACPA over IDEA and provide a performance comparison.
-
The effectiveness of EHDC requires further justification. EHDC retrieves similar states from the historical cache using visual features. However, in VLN, actions depend not only on the current visual observation but also on the instruction and navigation context. Thus visual similarity does not necessarily imply decision similarity, and visually similar states may require entirely different optimal actions.
-
The effectiveness of entropy gating also requires justification. When the current prediction approaches maximum entropy, the fusion increasingly favors the historical prediction. However, high uncertainty in the current model does not guarantee that the retrieved historical information is reliable.
[1] Turning Adaptation into Assets: Cross-Domain Bridging for Online Vision-Language Navigation, ICML 2026
Questions for authors
-
How does MACPA differ from IDEA, and how does it compare under the same evaluation protocol?
-
Why does EHDC use visual features alone for historical retrieval?
-
How does entropy gating avoid over-relying on unreliable historical predictions when the current model is highly uncertain?
W1&Q1. We thank the reviewer for the valuable suggestion. We acknowledge that IDEA has explored the use of external memory to store and reuse historical adaptation knowledge. The main differences between the two methods lie in the memory contents and their utilization mechanisms. IDEA employs source-domain feature statistics as distribution alignment constraints, optimizes Soft Visual Prompts through gradient-based updates, and combines Fisher guidance with convex hull projection to facilitate the cross-domain transfer of historical adaptation parameters. In contrast, MACPA keeps model parameters frozen and does not perform gradient-based parameter optimization. Instead, it uses historical visual states as Keys and instruction-conditioned semantics as Values, enabling the online reuse of historical semantic information and enhancement of current perceptual representations through similarity-based retrieval and EMA updates. Thus, IDEA primarily focuses on parameter-level test-time optimization and cross-domain transfer, whereas MACPA emphasizes feature-level historical semantic retrieval and online enhancement. It is worth noting that IDEA incorporates both source-domain feature statistics for additional distribution alignment and gradient-based parameter optimization, whereas MACPA does not involve model parameter updates during testing. Accordingly, the two methods explore different ways of leveraging historical information under distinct adaptation settings. We sincerely thank the reviewer again for the insightful comments and constructive suggestions.
W2&Q2. We thank the reviewer for this valuable suggestion. EHDC uses visual features for historical retrieval primarily because visual observations directly reflect the current environmental layout, the relative positions of landmarks, and local motion states. During continuous navigation, these visual cues exhibit a degree of temporal continuity. For example, when a UAV continues moving forward, consecutive observations typically share similar visual scenes and environmental structures. Therefore, historical forward actions associated with similar visual states can provide useful references for current decision-making. In contrast, when the UAV performs a turning action, changes in the viewing direction and the relative positions of objects in the scene generally lead to corresponding changes in visual features, providing cues for distinguishing different local motion states. Accordingly, visual state similarity is used to retrieve historical actions primarily to exploit environmental continuity and provide historical experience for local action selection, rather than to directly infer the overall navigation intent. Meanwhile, MACPA complements task-relevant information through instruction-conditioned historical semantic retrieval, allowing the two modules to provide complementary support at the perception and decision levels. We also acknowledge that visual similarity alone cannot fully guarantee action compatibility across different navigation instructions, which remains a limitation of the current design. Future work will further explore instruction- and navigation-progress-conditioned memory retrieval mechanisms that incorporate task-semantic compatibility constraints while preserving visual state matching, thereby improving the reliability of cross-instruction historical action reuse. We sincerely thank the reviewer again for the insightful comments and constructive suggestions.
W3&Q3. We thank the reviewer for raising this important concern. We agree that high uncertainty in the current prediction does not necessarily imply that historical decision priors are reliable. Within the HPD framework, we address this issue from two aspects. First, EHDC does not indiscriminately store all historical predictions; instead, it applies confidence-based filtering to retain only high-confidence action priors, thereby improving the reliability of historical decision information. Second, MACPA provides complementary support for the semantic consistency of historical decisions at the perception level. Specifically, the action distributions stored in the EHDC cache are generated by the policy network based on cross-modal navigation-state representations. By enhancing current perceptual representations through instruction-conditioned historical semantic retrieval, MACPA helps improve the task-semantic consistency of these cross-modal representations, thereby indirectly increasing the relevance of the historical action information accumulated and reused by EHDC to the current navigation task. Therefore, the utilization of historical decisions is influenced not only by entropy gating but also by confidence-based action filtering and upstream semantic representations. We sincerely thank the reviewer again for the insightful comments and constructive suggestions.