- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
GS-Nav addresses language-conditioned destination localization on aerial maps. A Qwen2.5-VL policy predicts a landmark box and destination coordinate, which is executed by a fixed controller. GRPO training combines a destination-centered Gaussian reward with landmark-dependent bandwidths, Gaussian landmark coverage, and format supervision. The paper also studies 4k training with 2k inference. On CityNav, it reports 20.56% validation-unseen SR and 23.82% test-unseen SR. Under matched inference conditions, the complete reward improves validation-unseen SR from 19.64% to 20.56%.
Critical strengths
-
The paper addresses a practically relevant problem. Reliable language-guided aerial navigation requires connecting linguistic descriptions with spatial structure. Studying geometric supervision for destination localization is a meaningful direction toward improving this capability.
-
The approach offers a simple and potentially practical way to improve an existing navigation pipeline. It combines changes to training supervision and inference resolution while retaining the underlying policy–controller interface, making the ideas relatively straightforward to incorporate into comparable systems.
Critical weaknesses
-
Limited methodological novelty. GUI-G² already combines size-adaptive Gaussian point rewards, Bhattacharyya coverage, and GRPO. The main changes are relocating the reward center and introducing candidate-wise maxima.
-
Unjustified destination tolerance. CityNav evaluates success within a fixed 20 m radius, but the reward scales tolerance using a reference landmark’s dimensions—even when the destination lies outside that landmark. This can assign higher rewards to unsuccessful predictions than to successful ones.
-
Candidate aggregation undermines landmark-specific calibration. In Eq. (3), a candidate with greater width and height dominates a smaller candidate everywhere. Independent point and coverage maxima also allow destination tolerance to come from a different landmark than the one predicted by the policy.
-
Weak incremental benefit from 4k training. At identical 2k inference, Table 3 shows only 20.28%→20.56% SR and 18.82→18.95 SPL, although mean NE improves by 3.99 m. The large accuracy and latency gains primarily reflect replacing 4k inference with 2k inference.
-
Evaluation restricted to an outdated model family. All experiments use Qwen2.5-VL.
-
Incomplete performance comparison. SA-GCS reports higher test-unseen SR/SPL—24.55/22.86 versus 23.82/21.78—but is omitted. Protocol differences require clarification before direct comparison, leaving the empirical advance inadequately contextualized.
-
No reported physical-flight validation. The supplied main paper reports CityNav trajectories and H20 query latency. Neither establishes physical UAV operation or end-to-end deployment performance.
Questions for authors
-
What bandwidth and reward components are used for the fixed-Gaussian baseline in Table 2? Which reported comparison establishes the benefit of landmark-dependent calibration separately from landmark supervision?
-
Do all Table 3 rows use the same evaluation episodes? Please clarify SR aggregation and treatment of invalid outputs, particularly how 10.53% is obtained if using a single run over 2,826 episodes.
-
What annotation, input, training-budget, or evaluation-protocol differences prevent comparison with SA-GCS, which reports higher test-unseen SR and SPL?
-
Does the submitted supplementary material contain physical UAV evaluation? If so, where are the platform, protocol, and results reported?
Thank you for your response.
Regarding Q1, although the differences from existing methods have been explained, the technical novelty beyond engineering efforts is still unclear to me.
Regarding Q2, the additional experiments appropriately address my concern.
On the other hand, regarding Q3, I do not think the experimental results sufficiently support the effectiveness of the proposed method.
Overall, my main concerns, particularly regarding the technical novelty of the method, remain unresolved. Thus, I will keep my rating unchanged.