- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
EviNav is a training-free framework for aerial object navigation that combines evidence-grounded search, persistent candidate hypotheses, and active verification. It maintains candidate evidence across observations and uses unresolved requirements to guide further inspection and inform stopping decisions. On the UAV-ON benchmark, it reports 27.00% SR, 36.60% OSR, and 22.98% SPL. Its main contribution is a system design that connects search, candidate verification, and termination through persistent evidence.
Critical strengths
-
The distinction between discovering a plausible candidate and establishing its identity is well motivated by the viewpoint-dependent nature of aerial observations. Keeping unresolved evidence separate from explicit contradictions is a sensible design choice.
-
The reported full-benchmark improvements are substantial, and the primary evaluation retains all 14 scenes despite the identified environment issues. EviNav’s aggregate results are consistent with its reported breakdowns across target scales and seen/unseen environments.
Critical weaknesses
-
The experiments do not directly validate the failure modes motivating the method. Section 4.4 and Table 5 analyze only successful episodes, without measuring incorrect acceptance, rejection of correct candidates, or repeated visits. The SR/OSR ratio also does not measure verification accuracy. Thus, evidence for improved target-acceptance reliability remains limited.
-
The ablations do not isolate the evidence mechanism. Removing active verification also removes candidate approach and additional viewpoints, while removing persistent evidence also removes interaction history. A generic-inspection baseline with a comparable budget is needed. The exact acceptance and STOP rules, especially for conflicting or incomplete evidence, also require clarification.
-
Candidate association is not validated. The matching rules may combine evidence from nearby or visually similar objects, potentially leading to incorrect acceptance. Tests with nearby same-category distractors should evaluate association accuracy and its effect on final decisions.
-
Figure 2 needs larger text, clearer notation, and connections that match the implementation. The authors should distinguish illustrative elements from recorded observations and clarify any generative AI assistance in figure preparation. These presentation issues alone do not establish undisclosed AI use.
Questions for authors
-
Can you provide evidence that evidence-gap-driven inspection outperforms a generic inspection policy with the same capabilities and a comparable budget? This would help distinguish the proposed reasoning mechanism from the benefits of additional observations.
-
Across all evaluated episodes, does the proposed method reduce incorrect acceptances, rejections of correct candidates, and repeated visits compared with the relevant ablated variants? Please distinguish per-decision statistics from final candidate outcomes.
-
The association procedure in Appendix B.2 uses spatial proximity and appearance similarity. What evidence shows that nearby, visually similar instances are reliably kept separate? How often do association errors affect accumulated evidence or final acceptance decisions?
6 comments
Q2. Incorrect acceptance, rejection, and repeated verification
Q2. Incorrect acceptance, rejection, and repeated verification
We extend the original success-only analysis to the complete 1,000-episode evaluation and examine target-acceptance outcomes across the Table 3 ablation variants.
Across all 1,000 episodes, EviNav achieves 270 successful STOPs, while the remaining 730 episodes terminate through 87 unsuccessful STOPs, 255 collisions, and 388 budget-exhaustion events. This provides a complete accounting of navigation outcomes beyond the successful trajectories analyzed in the original Table 5.
Target-acceptance outcomes across ablations. We further examine terminal STOP decisions on the same fixed 200 episodes used in Table 3, distinguishing successful acceptance, premature stopping at the correct target, and acceptance of an incorrect target instance.
Table Y. Target-acceptance outcomes across Table 3 ablation variants.
| Variant | Successful STOPs | Premature STOPs on Correct Targets | Wrong-Instance Acceptances | Total Unsuccessful STOPs |
|---|---|---|---|---|
| Full EviNav | 55/70 (78.57%) | 9/70 (12.86%) | 6/70 (8.57%) | 15/70 (21.43%) |
| w/o Evidence-Grounded Search | 40/54 (74.07%) | 8/54 (14.81%) | 6/54 (11.11%) | 14/54 (25.93%) |
| w/o Persistent Evidence | 49/65 (75.38%) | 10/65 (15.38%) | 6/65 (9.23%) | 16/65 (24.62%) |
| w/o Active Verification | 22/33 (66.67%) | 6/33 (18.18%) | 5/33 (15.15%) | 11/33 (33.33%) |
All percentages use the total number of STOP-terminated episodes in each variant as the denominator. Premature STOPs denote correct-target acceptances outside the benchmark's 20 m success radius. Wrong-instance acceptances were identified through candidate-identity checks of unsuccessful STOPs.
Full EviNav achieves the highest successful-STOP fraction and the lowest wrong-instance acceptance and premature-STOP fractions among all four variants. Compared with the active-verification ablation, successful STOPs increase from 22 to 55, while wrong-instance acceptance decreases from 15.15% to 8.57% (−6.58 percentage points) and premature STOP decreases from 18.18% to 12.86% (−5.32 percentage points). The overall unsuccessful-STOP fraction decreases from 33.33% to 21.43% (−11.90 percentage points).
These results provide direct quantitative evidence for the improved target-acceptance outcomes of EviNav's integrated active-verification process. The framework combines continued candidate inspection, persistent evidence, and explicit acceptance checks to support reliable terminal decisions.
Decision-level and candidate-history analysis. We additionally examine intermediate verification behavior across the complete evaluation. The archived logs contain 1,631 rejection events associated with 1,600 hypothesis IDs, allowing individual controller decisions to be distinguished from persistent hypothesis histories.
We further analyze 85 unsuccessful episodes that reached the target neighborhood without collision but did not issue STOP. Among these episodes, 48 contain subsequent rejection records, 67 contain deferral records, and 27 include deferred hypotheses without subsequent same-ID verification. In total, 56/85 episodes (65.88%) exhibit rejection and/or deferred-candidate follow-up patterns.
These complementary analyses characterize three levels of EviNav's verification behavior: individual inspection decisions, persistent candidate histories, and final terminal-acceptance outcomes. They illustrate how candidate rejection, deferral, and continued exploration interact with the final navigation result.
Q3. Ablation Study on the Stopping Mechanism. and Q4. Candidate association and instance-level evidence consistency
Q3. Ablation Study on the Stopping Mechanism.
To isolate the contribution of evidence-based stopping, we conducted an additional ablation on the same 200 UAV-ON episodes used in Table 3. Specifically, we replaced the evidence-based STOP authorization with a simplified stopping rule, while retaining the original search policy, candidate approach, and viewpoint acquisition mechanisms. The results are summarized below.
| Metric | Full EviNav | w/o Evidence-based STOP |
|---|---|---|
| SR ↑ | 27.50% | 23.50% |
| OSR ↑ | 43.00% | 29.50% |
| SPL ↑ | 0.2470 | 0.2161 |
| Successful STOPs ↑ | 55 | 47 |
| Failed STOPs ↓ | 15 | 81 |
| Failed-STOP Rate ↓ | 21.43% | 63.28% |
The results show that the full EviNav achieves a higher success rate (27.50% vs. 23.50%), while OSR increases from 29.50% to 43.00% and SPL improves from 0.2161 to 0.2470. More importantly, removing the evidence-based stopping mechanism leads to 81 unsuccessful stops out of 128 STOP decisions, corresponding to a failed-STOP rate of 63.28%. In contrast, the full EviNav produces only 15 unsuccessful stops out of 70 STOP decisions, reducing the failed-STOP rate to 21.43%, a decrease of 41.85 percentage points.
Furthermore, removing the evidence-based stopping mechanism leads to substantially more frequent STOP decisions (128 vs. 70), accompanied by a sharp increase in unsuccessful stops (81 vs. 15). Premature termination at incorrect candidates prevents the UAV from continuing its exploration, potentially leaving unexplored regions containing the true target. This explains the substantial decline in OSR from 43.00% to 29.50%, indicating that unreliable stopping decisions not only compromise final target confirmation but also limit the agent's ability to reach the correct target. These findings highlight a key advantage of EviNav: evidence-driven exploration and stopping are tightly integrated rather than treated as independent processes. By maintaining and updating candidate evidence throughout navigation, EviNav can defer uncertain stopping decisions, continue exploration when evidence is insufficient, and terminate only when sufficient evidence has been accumulated. This unified mechanism improves both exploration coverage and final stopping reliability.
This controlled ablation further distinguishes the contribution of STOP authorization from candidate approach and viewpoint acquisition, demonstrating that reliable stopping decisions independently contribute to navigation success and exploration effectiveness.
Q4. Candidate association and instance-level evidence consistency
EviNav maintains candidate-specific hypotheses across observations, allowing nearby objects to be represented and verified independently. Its association mechanism combines spatial proximity, category compatibility, and appearance information to maintain persistent candidate histories. Target-specific semantic and structural evidence is subsequently used to determine whether each candidate satisfies the requested description.
To illustrate this capability, we provide a new qualitative example in Figure 5(b) using original RGB observations and corresponding controller logs from an archived diagnostic navigation task.
Discriminating visually related playground objects (CityStreet, task 39). The scene contains a nearby arm-and-seat apparatus and the requested circular platform. Both exhibit blue visual elements and share the same playground context. At step 10, EviNav rejects the arm-and-seat apparatus because its structure lacks the required circular platform. At step 11, it accepts the separately maintained target candidate, whose blue circular platform and yellow handrails/supports match the requested description.
This case demonstrates that shared visual appearance and spatial context do not override instance-specific structural evidence during target verification.
Persistent candidate evidence is extensively incorporated into final target verification. In the Table 3 Full EviNav evaluation, 64 of 69 terminal STOP records with available history fields (92.75%) include multi-view candidate observations. This complements the qualitative example in Figure 5(b), where EviNav maintains separate hypotheses for neighboring candidates, preserves their observation histories across viewpoints, and uses target-specific evidence to reject distractors and accept the requested target.
Together, these results highlight the strength of EviNav's instance-aware verification framework: the system maintains separate hypotheses for neighboring candidates, accumulates evidence across viewpoints, rejects visually plausible distractors, and uses target-specific evidence to support reliable final acceptance. By linking persistent candidate association with evidence-based verification, EviNav enables consistent and discriminative target reasoning throughout navigation.
Q1. Comparison with Geometry-Driven Exploration
Response to Reviewer oam8
We thank the reviewer for recognizing EviNav's motivation, its distinction between unresolved and contradictory evidence, and the substantial improvements on the complete UAV-ON benchmark. We provide additional controlled comparisons, comprehensive termination analysis, and qualitative and quantitative evidence on persistent candidate verification.
Q1. Comparison with Geometry-Driven Exploration
To further examine the role of evidence-guided observation, we conducted an additional comparison with a geometry-driven exploration (GE) baseline on the same 200 UAV-ON episodes used in Table 3.
In GE, candidate approach and additional viewpoint acquisition are guided primarily by geometric considerations, such as target distance and viewpoint configuration, rather than by unresolved semantic evidence requirements. The remaining candidate verification and stopping mechanisms are retained.
Both methods use the same perception and navigation components, with identical action and observation budgets. Their difference lies in how additional observations are selected.
The average number of sub-actions per high-level step is computed over episodes successfully completed by both methods.
Both methods achieve comparable target reachability, with OSR values of 43.00% and 44.50%, respectively. Full EviNav achieves a modestly higher SR (27.50% vs. 25.00%) and better SPL (0.2470 vs. 0.2207), while reducing the collision rate by 6.50 percentage points. EviNav also acquires more complementary geometric views (3.205 vs. 1.825) and uses fewer sub-actions per high-level step on jointly successful episodes (2.54 vs. 3.00).
These results suggest that incorporating unresolved evidence requirements into viewpoint selection can provide additional benefits beyond geometry-driven observation alone. More broadly, EviNav is designed as an integrated navigation framework in which evidence-guided search, persistent hypothesis maintenance, active verification, and stopping decisions work together. This complementary comparison further illustrates the role of evidence-guided observation within the overall system.