- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes CoVisFormer, a cross-view geo-localization framework for estimating 3-DoF camera pose from ground and aerial images. The method addresses two main issues in existing correspondence-based approaches: false matches in non-overlapping regions and the limited adaptability of fixed-rule inlier selection. To this end, the authors introduce a co-visibility-aware cross-view contextual feature learning (C3FL) module, which uses learnable prompts to facilitate cross-view feature interaction, and a dynamic inlier detection-based pose regression (DIDP) module, which derives adaptive inlier detectors from the current correspondence set for pose estimation. The framework is evaluated on the VIGOR and KITTI benchmarks and achieves strong improvements over existing methods, particularly under challenging unknown-orientation settings. Ablation studies further show that both C3FL and DIDP contribute to the overall performance, and additional experiments support the effectiveness of the prompt-based attention design.
Critical strengths
1.The paper addresses two practically important limitations in correspondence-based cross-view geo-localization, namely false matches in non-overlapping regions and the limited adaptability of fixed-rule inlier selection. The proposed C3FL and DIDP modules are clearly motivated by these issues and form a coherent overall framework. 2. The experimental results are strong and reasonably comprehensive. CoVisFormer achieves substantial improvements over existing methods on both VIGOR and KITTI, particularly under challenging unknown-orientation settings, while the ablation studies provide clear evidence that both C3FL and DIDP contribute to the final performance.
Critical weaknesses
- The methodological novelty is somewhat limited. Both C3FL and DIDP are largely built upon familiar prompt/query-based attention and prototype-based set processing mechanisms. Although these components are reasonably adapted to cross-view geo-localization, the paper does not clearly establish how they differ fundamentally from existing latent-token, learnable-query, or learned correspondence filtering approaches. This makes the contribution appear stronger at the task-specific integration level than at the level of a genuinely new learning mechanism.
- The central claims of co-visibility awareness and dynamic inlier detection are not supported by sufficiently direct analysis. C3FL is mainly validated through final localization performance and qualitative attention maps, while DIDP is primarily compared against fixed-rule RANSAC-based selection. More direct correspondence-level evidence, such as false-match rates in non-overlapping regions, inlier precision/recall, or comparisons with representative learned outlier rejection methods, would be important to substantiate the claimed mechanisms.
Questions for authors
- How does the proposed C3FL differ fundamentally from existing learnable-query, latent-token, or prompt-based cross-attention mechanisms? Clarifying this distinction would help assess the methodological novelty of the paper.
- Can the authors provide more direct quantitative evidence that C3FL specifically improves co-visibility modeling, for example by reducing false correspondences in non-overlapping regions or improving correspondence precision/inlier ratio?
- How does DIDP differ from existing learning-based correspondence filtering or outlier-rejection approaches? A clearer conceptual comparison, and if available, experimental evidence against representative learned filtering methods, would materially affect the assessment of its novelty and necessity.
Clarification of the Methodological Novelty and Mechanistic Effectiveness of C3FL and DIDP
We sincerely thank the reviewer for the insightful and constructive suggestions, which have helped us better clarify the methodological contributions of C3FL and DIDP and strengthen the validation of their underlying mechanisms.
Q1: Clarification of the Methodological Novelty of C3FL and DIDP
A1: In existing latent-token and learnable-query approaches, learnable tokens typically interact with feature maps to aggregate contextual information or form compact task-specific representations, with their interactions primarily serving feature extraction or prediction. In contrast, C3FL is specifically designed to establish cross-view interactions under partial co-visibility. It first employs two separate sets of learnable prompts to interact with ground and aerial features independently, and then jointly updates them through cross-view self-attention. The updated prompts are further mapped back to both spatial feature maps via similarity-based aggregation. This design enables prompts to capture complementary patterns across views and propagate cross-view context to spatial features, guiding feature interaction toward co-visible regions and reducing interference from non-overlapping areas. Therefore, C3FL differs from existing prompt-based approaches in its explicit cross-view interaction and spatial feature refinement tailored to co-visibility.
Q2: Insufficient Direct Validation of Co-visibility Awareness and Dynamic Inlier Detection
A2: To address this concern, we have added a quantitative analysis of false correspondences in non-co-visible regions. Specifically, compared with directly using the DINOv2 backbone features without C3FL, our method reduces the false-match rate in non-co-visible regions from 99.94% to 27.96% (same view) and from 99.94% to 87.80% (cross view). Besides, to investigate whether the benefit of DIDP merely comes from replacing hand-crafted RANSAC with a learning-based outlier rejection method, we have conducted an additional comparison using a state-of-the-art learning-based outlier rejection method (PointCN:Learning to Find Good Correspondences). Specifically, we replace the original RANSAC-based outlier rejection in the SOTA baseline with PointCN, and also use PointCN in place of DIDP while retaining our framework. As reported in Table 4 in the manuscript(pp.10), although learning-based outlier rejection already improves upon conventional RANSAC, our framework further benefits from more effective correspondence learning. More importantly, DIDP consistently outperforms PointCN when applied within our framework, demonstrating that its gains do not simply come from adopting a learning-based filtering strategy. Instead, the proposed input-conditioned inlier detection mechanism provides additional benefits by adapting to the correspondence patterns of the current input.
Q3: Methodological Novelty of C3FL over Existing Attention Mechanisms
A3: Please refer to A1.
Q4: Direct Quantitative Validation of C3FL's Co-visibility Modeling
A4: Please refer to A2.
Q5: Methodological Novelty of DIDP over Existing Learned Correspondence Filtering Methods
A5: Please refer to A2.To further isolate the contribution of inlier detection from pose regression, we have added three controlled variants using the same input correspondences: 1.Model(1) : We use the product of the predicted inlier probability and matching confidence, pkckβ, to score each correspondence. A fixed threshold is applied to select inliers, followed by a conventional geometric pose solver. 2.Model(2): All input correspondences are treated equally. Their feature representations are directly average-pooled and fed into the same MLP pose regression heads. 3,Model(3): RANSAC is applied to select inliers, whose feature representations are then average-pooled and fed into the same MLP pose regression heads. As shown in Table 5 in the manuscript(pp.10), all three variants perform substantially worse than the full DIDP. In particular, comparing variants (2) and (3) with our full model demonstrates that neither direct feature aggregation nor fixed-rule RANSAC selection can achieve the same performance as our learned inlier detection mechanism, even with the same MLP regression structure. These results highlight the importance of adaptively identifying reliable correspondences for accurate pose regression. We added a visualization in Fig. 7 (pp. 15) to show that dynamically generated detectors respond selectively to different correspondence patterns, demonstrating their ability to capture diverse inlier patterns and reject outliers.