- Rating
- 4(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces RAFMa, a retrieval-augmented model for global visual geolocation. It extends spherical flow matching by conditioning the generation process on a set of visually similar geotagged images retrieved from an external database. A context module combines visual information from the retrieved images with their geographic coordinates, while a time-dependent geodesic bias adjusts their influence according to the current location hypothesis during generation. The method is evaluated on OSV-5M, YFCC4k, and Im2GPS3k using several frozen image encoders. RAFMa consistently improves over matched context-free flow-matching baselines and achieves particularly strong results on OSV-5M. Additional experiments study the contributions of the geographic tokens and distance bias, the effects of training-set and database size, context quality, and performance under shared retrieval candidates with GeoRanker.
Critical strengths
- The proposed integration of retrieval and generative geolocation is technically well motivated. RAFMa does more than select or rerank a retrieved location. Its prediction can lie outside the retrieved candidates, and the relevance of each context image changes with the evolving geographic hypothesis. The geodesic attention bias is a natural inductive bias for this setting and distinguishes the method from simpler retrieval aggregation.
- The empirical validation is unusually thorough and generally convincing. The paper includes matched context-free baselines across multiple encoders, component ablations, controlled variation of training and database size, analysis of context quality, and a shared-retrieval comparison with GeoRanker. The experiment excluding all database images within 1 km of the query is also useful because it shows that the gains at broader geographic scales are not explained entirely by retrieving a nearby image.
Critical weaknesses
The main limitation is that the interpretation of the finest-scale results is complicated by the additional snapping post-processing. On the Flickr benchmarks, this step substantially improves 1 km accuracy while having almost no effect at broader scales. In contrast, it reduces 1 km accuracy on OSV-5M. Since the snapping radius is selected on training queries, it is unclear how robust this heuristic is across datasets with different retrieval coverage. This does not undermine the improvements of the underlying RAFMa model, but makes it difficult to attribute the reported fine-scale gains entirely to the proposed generative approach.
Questions for authors
Could the authors explain why the snapping radius is selected on training queries and why post-processing is retained on OSV-5M despite reducing its 1 km accuracy? How sensitive are the finest-scale results to this radius?
2 comments
Thank you for the detailed clarification and additional sensitivity analysis. The explanation of the snapping radius selection and its behavior on OSV-5M addresses my main concern.
After examining the results without post-processing in Tables 7 and 8, I find that RAFMa's core retrieval-conditioned generation mechanism provides meaningful improvements independently of coordinate snapping, particularly at broader geographic scales. While coordinate snapping contributes substantially to the finest-scale results on the Flickr benchmarks, the results without post-processing also demonstrate the effectiveness of RAFMa's core approach.
Overall, I find the proposed method technically well motivated and the experimental evaluation convincing. I have therefore decided to raise my rating.
Coordinate snapping
We thank the reviewer for the careful reading and address the concern about the post-processing below.
We select the snapping radius of the post-processing on training queries so that no setting depends on the test images. The tuning rule was: take the radius with the largest gain at 1 km among those that lose at most 0.1 points at 25 km, which gives 2 km on OSV-5M and 10 km on MP-16. This rule is described in Appendix A (paragraph "Prediction post-processing"), where we have now added Figure 6, showing the effect of the radius on the training queries and on the test sets.
On the Flickr benchmarks, the training and test curves have the same shape. The gain at 1 km grows up to snapping radius of about 10 km and then saturates, so the results are not sensitive to the radius. At 1 km, the selected radius gives performance within 1.2 points of the best radius per test set.
On OSV-5M, the selection on training queries does not transfer well to the test set; see Table A1 in our answer to Reviewer Xogd. The benchmark keeps every test image at least 1 km away from the database images, so a prediction snapped to one of them is never within 1 km of the true location. The effect is small since the chosen radius is 2 km. Accuracy at 1 km drops from 0.55% to 0.16%, while accuracy at 25 km and GeoScore remain practically unchanged. We kept the post-processing on both datasets to be fair and not to tune the design choices based on test set performance.