- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The authors present Trajectory-Aware Environment Perturbation (TAEP), a framework for improving trajectory diversity in aerial vision-and-language navigation. The core idea is to mitigate the success path collapse, where a navigation policy repeatedly generates similar successful routes, by modifying the environment. In experiments on two scenes, AirSim16 and AirSim23, TAEP achieves the best overall trajectory diversity.
Critical strengths
Environment perturbation is a practically meaningful idea for navigation data generation. TAEP changes traversal conditions so that alternative routes emerge under the original navigation objective, which is well aligned with applications in the real world.
Critical weaknesses
-
The experimental scale is limited. The evaluation is restricted to only two AirSim scenes, and many of the main conclusions rely on AirSim16. In particular, downstream VLA evaluation is conducted only on AirSim16, while AirSim23 is evaluated only for long-distance trajectory diversity. Since the proposed method directly depends on scene topology, broader evaluation across diverse environments is needed.
-
The improvement in trajectory diversity over Random and other baselines is not always clear. In Table 1, TAEP does not consistently outperform the baselines on individual metrics, and some differences are quite small. The main conclusion is largely driven by Mean Rank, while variance, confidence intervals, and statistical significance are not reported.
Questions for authors
Please address the weaknesses. 1) Why were only AirSim16 and AirSim23 evaluated? 2) Are the improvements in Table 1 statistically significant?