- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates the sensitivity of scene coordinate regression (SCR) to scale and rotation changes in aerial visual localization. The authors observe that local descriptors may retain strong correspondence discrimination while failing to support stable 3D scene-coordinate decoding. To address this issue, AeroSCR combines scale augmentation, descriptor-space rotation canonicalization, residual yaw training, direct coordinate supervision, and GeoCell-based routing. Experiments show that AeroSCR achieves localization success rates comparable to HLoc at the 5 m/5° threshold, while reducing scene-specific storage and inference latency.
Critical strengths
- Through controlled experiments, the paper reveals a distinction between local descriptor correspondence discrimination and stable scene-coordinate decoding, providing a valuable perspective on understanding SCR robustness under scale and rotation changes.
Critical weaknesses
-
Lack of qualitative evaluation. The paper does not present any qualitative localization results on actual image pairs. Real-image visualizations are limited to dataset examples and method illustrations. Visualizations of predicted scene coordinates, localization results, success and failure cases, and qualitative comparisons with baseline methods on the same images are entirely absent.
-
Insufficient comparisons with recent methods. The experiments mainly compare against methods from 2025 or earlier, lacking comparisons with representative methods from 2026. The limited baseline coverage makes it difficult to establish the method's competitiveness against recent state-of-the-art approaches, leaving the experimental evaluation insufficient.
-
Limited methodological novelty. The paper lacks clear independent algorithmic novelty and mainly combines existing techniques for aerial visual localization. Scale augmentation relies on conventional cropping and resizing, rotation canonicalization uses pretrained and frozen SO(2) Steerers, and both direct coordinate supervision and GeoCell routing build upon existing research.
Questions for authors
- Performance gap under stricter localization thresholds.
AeroSCR achieves performance comparable to HLoc on AnyVisLoc at the 5 m/5° threshold (90.8% vs. 90.2%), but falls substantially behind at 1 m/1° (60.4% vs. 80.3%). A similarly large gap appears on Oslo-Large at 2 m/2° (43.2% vs. 76.3%).
What are the main reasons for these performance gaps? Do these results indicate that AeroSCR primarily improves localization robustness under relatively loose thresholds, while its high-precision localization capability remains limited?
4 comments
To CW3 (Clarifying contributions beyond combining existing techniques):
Rather than an ad-hoc combination of existing primitives, our contribution lies in the empirical insight, the resulting decoder-side supervision paradigm, and the system design that makes compact SCR viable under large aerial observation shifts:
- Decoder-side cross-view consistency. Our controlled probes show that scene-coordinate decoding deteriorates sharply under scale and rotation shifts even when local descriptors retain strong correspondence discrimination (Fig. 1, Sec. 3, and Appendix C). Unlike methods promoting cross-view consistency via feature-level invariance (which risks discarding orientation-sensitive cues and reducing fine discriminability), we preserve informative, transformation-sensitive descriptors and establish coordinate consistency through decoder supervision (Sec. 1, Sec. 2.2).
- Asymmetric bounded-residual supervision. Requiring a compact decoder to absorb full-360° rotations from limited mapping views strains model capacity (Fig. 1b; Appendix C), whereas unaligned mapping headings weaken multi-view consistency. We align observations to a canonical heading via steerable descriptors and restrict coordinate supervision strictly to a narrow residual neighborhood , deliberately leaving larger rotations unsupervised (Sec. 4.3). While discrete steering or residual training alone is insufficient due to quantization gaps or limited rotation coverage (Table 5b), our asymmetric supervision provides local rotation tolerance while giving misaligned yaw hypotheses weaker geometric support during RANSAC verification. This enables 98.1% prior-free full-circle localization using standard P3P without any yaw or gravity prior (Appendix D.1, Table 7a).
- Making near-nadir aerial SCR viable at scale and benchmark contribution. Existing SCR methods designed for upright ground-level scenes struggle under aerial viewpoint shifts and weak projective depth geometry. We address these domain bottlenecks through coverage-balanced scale sampling across altitude extremes (Fig. 3), direct metric supervision for weak near-nadir depth conditioning (Table 5a), and GeoCell routing to avoid the convergence failure of shared global-conditioned decoders on kilometer-scale maps (Appendix D.4). Together with our tailored evaluation protocols on public UAV datasets and the controlled Oslo-Center and Oslo-Large (~10 km²) benchmarks for public release, these designs establish a practical framework for aerial SCR.
To Q1 (Strict-threshold precision and high-precision capability):
1. Reasons for the gap to HLoc at the strictest thresholds:
- Implicit neural compression vs. explicit triangulated point clouds: HLoc stores explicit 3D SfM points and descriptors, estimating poses from exact triangulated feature tracks. In contrast, AeroSCR compresses scene geometry into compact MLP heads that regress continuous 3D coordinates. At high flight altitudes (300–1000 m on Oslo-Center and Oslo-Large), continuous neural regression introduces ~1–2 m smoothing errors that have minor impact at @5m/5° (86.2% vs. HLoc's 90.5% on Oslo-Large) but cross the strict @1m or @2m cutoffs, reflecting the trade-off for 4.0–6.0× smaller storage and 3.1–8.2× lower latency.
- Approximate view-shift modeling and local invariance trade-off: To enable fast single-pass feature extraction at inference, AeroSCR approximates 3D altitude changes via 2D crop-resize augmentation and handles large heading shifts via approximate SO(2) descriptor steering with residual tolerance. As shown in our residual-radius sensitivity analysis (Appendix D.3, Table 9), broader local rotational tolerance slightly softens peak coordinate precision at @1m/1°.
2. High-precision capability of AeroSCR: These trade-offs do not restrict AeroSCR to coarse localization. At lower flight altitudes (AGL/AMSL, Table 2), AeroSCR achieves 99.5% at @1m/1° (0.15 m / 0.15° median error), nearly matching HLoc (100.0%). Across the six AnyVisLoc scenes at @1m/1° (Table 3), AeroSCR (60.4%) outperforms R-SCoRe (36.3%) and Robust SCR (29.4%) by 24.1 and 31.0 percentage points, substantially advancing fine-grained SCR accuracy while retaining compact storage and fast online inference.
Invitation to Review and Discuss the Rebuttal
Dear Reviewer,
Thank you for your valuable feedback on this submission. Since we are now in the discussion phase, I would be grateful if you could engage with the authors’ responses and continue the conversation if there are outstanding issues that would benefit from clarification. Your participation will help ensure a constructive and thorough evaluation.
Many thanks again for your time and consideration.
Best regards,
Area Chair
Thank you for the rebuttal and clarifications. I have reviewed the authors' responses and will maintain my original rating.
Thank you for your constructive feedback and for recognizing the value of our controlled analysis distinguishing correspondence discrimination from coordinate decoding. We address each of your points below.
To CW1 (Qualitative evaluation):
We have added qualitative visualizations across real-world (AnyVisLoc, AGL/AMSL) and controlled (Oslo-Center, Oslo-Large) scenes, covering baseline comparisons on identical query views, single-component ablations, and representative failure cases (see Sec. 5.7, Figs. 4–5 in the revised main text and Appendix G.2, Fig. 9). By projecting the full sparse 3D point clouds predicted by SCR methods into the ground-truth query view and coloring points by scene elevation (Z), these visualizations show that AeroSCR preserves coherent building and terrain structure under large scale and heading shifts where native R-SCoRe scatters, while illustrating the complementary roles of scale augmentation and residual-yaw training.
To CW2 (Comparisons with recent 2026 methods):
We added experimental comparisons with Robust SCR (Nguyen et al., WACV 2026), a recent R-SCoRe extension that learns geometrically consistent global descriptors, evaluated across AGL/AMSL, all six AnyVisLoc scenes, and Oslo-Center using the same mapping-only mesh targets (updated Tables 2–4 and Appendix D.5, Table 11). While Robust SCR performs well under fixed heading on Oslo-Center (91.1% at @5m/5° and 66.2% at @2m/2°), its upright representation remains vulnerable to large aerial yaw shifts, dropping to 13.6% on AGL/AMSL (vs. AeroSCR's 100.0%). Across the six AnyVisLoc scenes, AeroSCR outperforms Robust SCR at all thresholds, reaching 90.8% vs. 56.3% at @5m/5° and 60.4% vs. 29.4% at @1m/1°, while requiring 4.1× less storage (10.6 MB vs. 43.4 MB) and 5.2× lower latency (111 ms vs. 576 ms).
Regarding other 2026 works cited in Sec. 2, complete official code and pretrained retrieval-descriptor weights for CoLoR (CVPR 2026) are not yet publicly available, while Triplet-based map compression (CVPR 2026) and AsymLoc (CVPR 2026) focus on explicit SfM map compression or detector-descriptor distillation rather than implicit scene-coordinate decoding.