- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents ReCoLoc, a 3DGS-based visual localization framework that separates Gaussian region retrieval from query-conditioned 3D coordinate prediction. Each Gaussian is associated with an identity descriptor for retrieval and an affine coordinate decoder that predicts a 3D point based on the query feature. The framework constructs these representations from mapping-view observations and introduces a correspondence-aware landmark selection strategy that considers both retrieval and coordinate prediction quality. A shared-subspace compression scheme is further proposed to reduce map storage. At inference time, the predicted 2D–3D correspondences are used for camera pose estimation via RANSAC-PnP, with optional pose refinement.
Critical strengths
-
Insightful problem formulation and intuitive method design. The paper identifies an interesting limitation of 3DGS-based visual localization, i.e., assigning a single fixed 3D coordinate to each Gaussian may introduce ambiguity because different image keypoints can correspond to different locations within the same Gaussian region. The proposed region-to-coordinate formulation addresses this issue by separating Gaussian identity retrieval from query-conditioned coordinate prediction. The perspective is well motivated, intuitive, and potentially useful for improving 2D–3D correspondences in Gaussian-based localization.
-
Strong empirical results and well-designed ablation studies. The method achieves competitive localization performance across three established benchmarks. More importantly, the experiments provide targeted evidence for the central contribution. In particular, the comparisons against Gaussian centers and weighted mean coordinates under identical retrieval results help isolate the benefit of query-conditioned prediction. Additional analyses of shared Gaussian identities and alternative coordinate representations further strengthen the empirical support for the proposed approach.
Critical weaknesses
-
Insufficient justification for the proposed dimensionality reduction strategy. While the paper provides ablations on compression dimensions and the joint basis construction, it remains unclear why this post-hoc compression strategy is preferable to directly fitting the landmark representations in a low-dimensional feature space. A comparison with such a straightforward alternative would help establish the necessity and benefits of the proposed design, beyond demonstrating that compression can preserve localization performance.
-
Limited analysis of the coordinate learning mechanism and its generalization. The query-conditioned coordinate decoder is a central component of the proposed method, yet its fitting quality and generalization across views are not directly evaluated. Although the paper reports improvements in correspondence accuracy and downstream localization, it does not provide a comparison of coordinate prediction errors between fitting and held-out scoring views, nor does it analyze how prediction quality varies with the number of observations per Gaussian. Given that the decoders are independently fitted using pseudo-coordinate targets that may be inconsistent across views, these analyses would be valuable for understanding the reliability of the learned mappings and whether the improvements primarily reflect accurate coordinate prediction or the effectiveness of subsequent landmark selection and robust pose estimation.
Questions for authors
-
Could the authors clarify the motivation for the specific scoring formulations in Eqs. (7) and (8), and whether alternative scoring functions were considered?
-
Why is SplitGS-Loc omitted from the 12-Scenes benchmark and recall comparisons in Tables 1–4? Are the pose refinement protocols comparable across methods?
-
Given the relatively low Top-1 Gaussian association accuracy (21.26%) in Table 6, could the authors explain how incorrect Gaussian retrieval affects coordinate prediction and final localization performance?
Thank you for the detailed response and the additional experiments. Most of my questions have been adequately addressed, in particular the analysis of 3D error and cross-view consistency, and the controlled comparison between Gaussian regions and generic partitions. I maintain my positive rating.