- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Confused Relation-Aware Distillation (CRAD) for efficient cross-view geo-localization (CVGL), aiming to transfer knowledge from a large teacher model to compact students. Instead of directly matching feature representations, CRAD argues that retrieval performance depends on preserving candidate-level similarity relations and proposes two components: Cross-View Multi-Positive Contrastive Learning (CR-InfoNCE) to align teacher–student correspondence across views, and Relational Structure Distillation (RSD) to transfer teacher-induced candidate ranking distributions. The paper further introduces Teacher-Guided confused Sampling (TGS), which combines teacher- and student-mined hard negatives to provide more informative supervision. Extensive experiments on CVUSA, CVACT, and VIGOR demonstrate that CRAD improves compact student models over several distillation baselines.
Critical strengths
Efficient Distillation Framework for Ground-View CVGL: The paper addresses an important practical challenge in cross-view geo-localization: deploying high-performing retrieval models under limited computational budgets. CRAD integrates relational supervision and teacher-guided hard-negative mining into a compact student training framework, providing a practical approach for reducing model size while maintaining competitive retrieval performance.
Critical weaknesses
1. Limited Technical Novelty: The core idea of Relational Knowledge Distillation has been extensively explored in prior similar work [1] has already explored self-agent and cross-agent relational knowledge transfer specifically for visual place recognition. Although CRAD adapts these principles to cross-view geo-localization through cross-view contrastive supervision and teacher-guided sampling, its methodological novelty appears limited. The paper does not sufficiently establish how its relational distillation formulation advances beyond these existing approaches.
2. Insufficient Component Designs: Although Table 2 provides component-level ablations, the proposed objectives do not consistently exhibit complementary improvements. For example, CR-InfoNCE alone achieves 70.03% R@1 on CVACT-Test, outperforming the combined CRAD objective without TGS (69.28%). Similarly, RSD alone slightly outperforms their combination on VIGOR-Cross (57.60% vs. 57.35%). While the full framework benefits from TGS, these results leave the additional contribution and interaction of CR-InfoNCE and RSD insufficiently explained. More detailed analysis would strengthen the justification for combining these objectives.
Reference:
[1] Wang, S., She, R., Kang, Q., Jian, X., Zhao, K., Song, Y. and Tay, W.P., 2024, March. Distilvpr: Cross-modal knowledge distillation for visual place recognition. In Proceedings of the AAAI conference on artificial intelligence (Vol. 38, No. 9, pp. 10377-10385).
Questions for authors
Q1. Clarifying the Novelty of Distillation Methods
Distillation methods have been widely used in metric learning tasks. What are the key methodological advances of CRAD beyond adapting these established ideas to CVGL?
Q2. Effectiveness of CRAD
Table 2 shows that CR-InfoNCE alone outperforms their combined objective without TGS on CVACT-Test (70.03% vs. 69.28% R@1). Could the authors explain this result and clarify under which conditions RSD provides complementary benefits beyond CR-InfoNCE?
Q3. Comparison with Recent CVGL Methods
The main comparisons primarily cover methods published through 2025, while the teacher is based on Sample4Geo (2023). Could the authors include relevant 2026 CVGL methods from recent CV/ML top conferences (e.g., NeurIPS, CVPR, ICML) under comparable evaluation protocols? Such comparisons would provide a more comprehensive assessment of CRAD's competitiveness relative to recent methods, particularly regarding its trade-off between retrieval accuracy and computational efficiency.