- Rating
- 2
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies ambiguity in BEV-based satellite-ground localization and proposes GeoSem-BEV, which introduces radial-depth and vertical-height supervision for BEV feature construction, together with explicit semantic supervision and same-class hard-negative mining for descriptor learning. The method is applied to FG², DenseFlow, and ViewBridge, with strong gains on VIGOR and mixed improvements on DReSS-D and KITTI-CVL.
I find the problem relevant and the radial-versus-vertical ambiguity formulation interesting. However, I have concerns about novelty attribution, the reliance on strong external teachers, and the consistency of the claimed gains.
Critical strengths
The distinction between radial assignment along a viewing ray and vertical feature aggregation is well motivated. FG² already constructs a 3D point cloud and learns feature selection along the height dimension, but it does not explicitly supervise which radial location corresponds to the actual scene surface.
The ablation showing that semantic supervision alone hurts performance, while geometry followed by semantic supervision improves it, is interesting and supports the argument that semantic descriptor learning benefits from better geometric placement.
Applying the method to FG², DenseFlow, and ViewBridge is useful and suggests that the proposed supervision is not tied to a single architecture.
Critical weaknesses
1. The geometric novelty appears somewhat incremental.
The progression from FG² to GeoSem-BEV is conceptually similar to the progression from implicit BEV lifting to BEVDepth-style explicit depth supervision. BEVDepth already established that explicitly supervising depth can substantially improve BEV construction. The main novelty here therefore seems to be the identification of radial ambiguity specifically in satellite-ground localization, rather than explicit depth supervision itself.
2. The contribution of the proposed formulation is confounded by strong external teachers.
GeoSem-BEV uses DA²/SphereViT for radial-depth supervision, Depth Anything V2 for satellite-side height targets, and SAM3 for semantic pseudo-labels. DA² itself reports strong zero-shot panoramic depth performance, and SAM3 is a powerful concept segmentation model. It is therefore unclear how much of the gain comes from the proposed learning mechanism versus the quality of these external priors.
3. A matched-teacher or direct-use baseline is missing.
Loc² already lifts image-plane correspondences using monocular depth at inference. A natural control would be Loc² using the same DA² depth, optionally together with SAM3-based correspondence filtering or reweighting. Without such a comparison, the current experiments do not isolate the benefit of training-time distillation from simply having access to stronger depth and semantic information.
4. The claimed framework-agnostic improvement is not fully consistent on stronger baselines.
On DReSS-D, GS-ViewBridge improves mean orientation error substantially but degrades same-area localization from 2.940/1.490 m to 3.186/1.707 m in mean/median error. Similar translation-orientation trade-offs appear on KITTI-CVL. This weakens the claim that the proposed geometry consistently improves BEV feature placement.
5. The ablation does not sufficiently isolate the central radial-depth contribution.
Since the paper argues that radial ambiguity is distinct from vertical-height ambiguity, a direct radial-only versus height-only comparison is important. The current geometry ablation combines several supervision terms, making it difficult to determine whether radial supervision is truly the key source of improvement.
Questions for authors
Please refer to the Weaknesses section.
9 comments
Response to W2: Teacher quality and the learning mechanism
Thank you for your comment. GGBC learns the spatial assignment of ground-image features in BEV through radial-distance prediction and height aggregation.
To examine the influence of external teachers, Table 7 in Appendix A.5 keeps the student architecture and other supervision fixed and replaces only the radial-depth teacher. Together with the control without radial-depth supervision in Table 2, the results show that radial targets from both DA²/SphereViT and UniK3D lower all four localization errors on VIGOR cross-area with unknown orientation. This indicates that the construction and learning mechanism can use depth labels from different teachers. Table 9 in Appendix A.7 further replaces Depth Anything V2 Metric radial targets with LiDAR distances. Both groups compute radial losses only at their commonly valid sparse locations, retaining the same architecture and other training conditions. The two supervision sources yield similar localization performance, supporting the feasibility of using teacher predictions as training targets under this common-coverage condition.
The contribution of GGBC itself is examined through experiments with the added supervision disabled. Table 6 in Appendix A.5 shows that GGBC trained using only the base matching and pose objectives has lower errors on all four metrics than uniform aggregation and our reproduced FG²†. Table 12 in Appendix A.10 also shows that GS-ViewBridge without added supervision still lowers mean translation and orientation errors relative to the original ViewBridge. Table 8 in Appendix A.6 further shows that, on KITTI same-area, the base-objective configuration achieves the lowest radial MAE and translation errors, indicating that GGBC can learn effective geometric predictions and spatial assignments from the localization task itself.
For SAM3, our core design uses its strong concept-segmentation capability to automatically add pixel-level masks for categories such as buildings, vegetation, and paved surfaces to existing datasets, reducing manual annotation costs. We convert these masks with explicit category information into semantic supervision signals. Table 2 keeps the teacher sources, student architecture, and geometric supervision fixed while independently switching CE, JS, and same-class HN. Adding CE or JS alone improves all four errors. Adding CE+JS lowers mean translation and orientation errors, while adding same-class HN alone also improves all four errors. With the same category-label source, CE guides descriptors to learn category information, JS constrains cross-view semantic consistency, and same-class HN trains the model to distinguish candidates of the same class at different locations. These independent switches demonstrate the incremental effects of the learning objectives. Our method does not require running the additional SAM3 or depth-teacher models at inference.
Response to W3: Direct use of depth and SAM3 in Loc²
Thank you for your suggestion. Table 10 in Appendix A.8 adds a comparison of Loc² directly using depth and SAM3. In this KITTI experiment, both Loc² and GS-FG² use depth models from the Depth Anything V2 Metric VKITTI family. Both Loc² variants retain the same official weights, depth model, sampling of 1,024 correspondence pairs, and original pose-solving pipeline. The only addition is SAM3 class-conflict filtering. A candidate's matching score is set to zero when both endpoint classes are valid, both confidences are at least 0.5, and the classes differ.
On KITTI-CVL same-area/test1 with ±10° orientation noise and no RANSAC, all four errors increase after adding the filtering. We have not observed a localization improvement from introducing SAM3 in this experimental setting. GS-FG² has lower errors on all four metrics than both Loc² variants. We will continue exploring ways to use semantic information in Loc² and conduct further comparisons.
Response to W1: Specific contribution of geometric modeling
Thank you for your comment. The original manuscript did not clearly explain the novelty of GeoSem-BEV or sufficiently describe its technical distinctions from existing depth-supervised BEV methods. In the revised Abstract, Introduction, Related Work (Sections 2.2 and 2.3), and Method (Sections 3.2 and 3.3), we have added detailed comparisons and explanations of the mechanisms. We also independently ablate the architecture and supervision to verify their respective contributions.
First, regarding geometric modeling, autonomous-driving multi-view perception methods such as BEVDepth use LiDAR-projected ground truth for 3D object detection under known and relatively stable vehicle-camera geometry. Satellite-ground localization faces extreme viewpoint differences between street-level panoramas and overhead satellite imagery. Existing cross-view BEV methods either rely on a 2D ground-plane assumption or impose height constraints only along the vertical direction, leaving the same ground-view feature assignable to ambiguous 3D locations along its viewing ray. We introduce Geometry-Guided BEV Construction (GGBC), which expands geometric constraints to 3D space by simultaneously constraining radial distance and vertical height on a shared metric 3D query grid. During training, it learns the 3D spatial assignment of ground-image features in BEV and their aggregation weights at different heights. The accompanying radial-depth and height supervision guide distance assignment and height aggregation over the same 3D candidate locations and can further improve matching performance in some settings.
Second, regarding semantic representation learning, existing BEV matching methods mainly rely on appearance and pose supervision. Their descriptors implicitly mix semantic cues from different categories with appearance and high-level structural information, lacking an explicit semantic learning mechanism to control matching ambiguity caused by similar appearances. We use SAM3-generated targets for buildings, vegetation, and paved surfaces as supervision signals. A shared semantic head extracts explicit category-level semantic predictions from BEV descriptors, with direct category supervision (CE) and cross-view semantic consistency constraints (JS). These are complemented by same-class hard-negative learning to align semantics across views while distinguishing highly confusing candidates that belong to the same class but occupy different locations.
Additional experiments verify these designs separately. Table 6 in Appendix A.5 shows that, on VIGOR cross-area with unknown orientation, GGBC trained using only the base matching and pose objectives outperforms uniform aggregation and our reproduced FG²†, demonstrating the effectiveness of the 3D geometric construction itself. The fixed-architecture radial-depth/height ablations on VIGOR cross-area with unknown orientation in Table 2 verify the incremental and complementary effects of the two accompanying supervision terms. The fixed-architecture controls on KITTI-CVL same-area/test1 in the same table and Table 11 in Appendix A.9 separately verify the localization improvements from combined CE/JS supervision and same-class HN.