- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This work differentiates geographic memory and spatial generalization in LLMs, and frames geographic knowledge as a latent spatial field. The authors integrate continuous location embeddings as spatial tokens into LLMs, comparing with textual, grid and geohash representations on Airbnb-derived Los Angeles and London benchmarks. Evaluated via geospatial captioning and extrinsic geospatial grounding, continuous representations outperform alternatives for spatial generalization, even though textual coordinates excel at memorization.
Critical strengths
The paper clearly distinguishes geospatial memory from spatial generalization through observed and spatially held-out locations.
Critical weaknesses
- The experiments are limited to Airbnb descriptions from Los Angeles and London, which may introduce domain-specific biases. It remains unclear whether the findings generalize to other cities, geographic attributes, or data sources.
- The proposed method mainly integrates an existing Geo2Vec encoder into LLMs through a learned projection, with limited architectural innovations.
- The paper defines spatial reasoning primarily as predicting descriptions in unobserved regions, but this may reflect spatial interpolation rather than genuine geographic reasoning. The tasks requiring explicit spatial relationships or multi-step inference would better support the 'reasoning' claim.
- The improvements from continuous spatial representations are relatively modest, particularly in downstream grounding.
- The probing and clustering results do not conclusively demonstrate that LLMs learn a latent spatial field, as the observed spatial structure may largely originate from the pretrained continuous location encoder rather than newly acquired geographic knowledge.
Questions for authors
- Could the authors conduct an additional experiment comparing the spatial structure of Geo2Vec embeddings with LLM hidden representations before and after fine-tuning?
- Could the authors provide statistical significance tests for the improvements of LATENT over TEXT and HYBRID, particularly in downstream grounding?
I would be willing to raise my score if the authors can address my concerns.
2 comments
W2 (limited architectural innovation)
Why the architecture is simple. The current multimodal LLM pipeline, an encoder followed by a learned projection, has been verified to be effective, so we see no reason to make it more complex.
Where the contribution lies. Our contribution is not a complex architecture. It lies in the framing of how an LLM can build geospatial awareness through memory and generalization, and how the representation of location affects this ability, which to our knowledge has not been proposed before. The open datasets, which support training as well as benchmarking, are also contributions to the community. A simpler and robust representation module is also more likely to be adopted in future LLM systems.
W3 (reasoning vs. interpolation)
On the term. We agree with the reviewer that “generalization” is the more conservative term, and we use it in our title and abstract. In the paper we also state that the reasoning we refer to is this generalization capacity. We keep “geospatial reasoning” as a defined term because we believe reasoning over geographic space differs from deductive reasoning, which requires explicit relationship inference. The revision will state this definition explicitly at first use. Following the reasons:
Why geospatial reasoning should be different. Deductive reasoning derives a conclusion from relations stated in the input. Geographic data does not have this form, since the geospatial space is continuous, while relationships saved in natural language are discrete. Also, most geographic dependencies are implicit, and it is impossible to state all the relevant world knowledge in the input. We therefore study geospatial reasoning in a latent, implicit form, where the LLM infers from its internal knowledge. We see this setting as complementary to relational reasoning: those settings assume the relations are given, while ours addresses the case where they are not.
Why this is not interpolation. Geographic knowledge expressed in natural language differs from numeric values. Spatial interpolation averages the numeric values of nearby observations, while a text description has no direct analog of this operation. The closest counterpart for text data is to copy descriptions from the nearest observed locations, which is our k-NN baseline. In the experiments, the tuned LLMs with every representation outperform k-NN in held-out regions (Table 2), and more importantly, this gap grows as test locations lie farther from the training data (Fig. 7). The model is therefore doing more than reusing nearby text, which is why we describe it as reasoning.
Additional evidence. Appendix A.9 asks each model for the distance from a location to LAX. The seven locations were manually selected from regions that contain no training observations. For example, points 0, 4 and 6 are at a canal, on a mountain and in a lake, where the closest POI is kilometers away. LATENT’s estimates rise with the true distance, from 2.4 miles to 25 miles. This qualitative case study provides evidence that LLM can generalize to distant and no data regions and support our claim.
We thank the reviewer for the detailed comments. We respond to each point below.
Q1 and W5 (does the spatial structure come from the encoder?)
The encoder is not pretrained. The location encoder and projection are trained from scratch together with the LoRA adapters. Before training, the encoder carries only the geometry of the coordinates and no geographic knowledge.
Additional experiment. As requested, we compared the spatial structure of the location encoding with the LLM hidden representations; the result is in Figure 13 of the updated manuscript. The encoding alone preserves only spatial proximity. After the LLM learns from the data, the clusters reflect the data. For example, the coastal areas around Santa Monica and Long Beach are grouped together, following the coastline. Geometry alone cannot produce this grouping.
Q2 and W4 (modest improvements, significance tests)
Captioning. Figure 7 shows the comparison as the distance growth, with 95% bootstrap confidence intervals. The gap between LATENT and TEXT is significant in 20 out of 30 distance ranges.
Additional statistical test. We added a per-metric significance test that combines the three LLM families and both cities (two-sided stratified t-test with Holm correction; full results can be found in the updated version of submission at Table 7 in the appendix). To sum up, LATENT is significantly better than TEXT on Hit Rate@1% (+0.43 points, p<0.001), Hit Rate@5% (+0.37 points, p=0.006) and JSD (−0.007, p<0.001). Moreover, LATENT is also the only augmentation that significantly improves on the grounding model trained without augmentation. TEXT shows no significant change.
How we read this. Each single gain is modest, but it reaches significance on three of five metrics against TEXT, and the direction is consistent across model families and cities. Grounding is also an indirect test, so the room for improvement is small. We will revise the wording in Section 6.5 to match these tests.
On the size of the improvement. We agree that the gains are modest. Our contribution is to formulate and evaluate a concrete approach for incorporating continuous spatial representations into LLM geospatial reasoning, an initial step toward a difficult, broader goal. The grounding results suggest that better spatial representations alone are insufficient, helping identify where further methodological advances are needed. Beyond the immediate performance gains, the work provides an explicit formulation, an evaluated method, and an empirical reference point that subsequent research can build on to improve spatial reasoning and grounding. We will add the discussion into the paper.
W1 (data limited to Airbnb, Los Angeles and London)
Why this data. To help an LLM form geospatial awareness, we need a large number of human-written descriptions of locations that are coupled with coordinates. To the best of our knowledge, Airbnb listings are one of the few openly available, high-quality sources that provide this in detail at city scale, and no prior work has used them in this way. Other geo-tagged text, such as reviews or photo captions, mostly describes the business or the photo and not the location itself. We therefore see the new use of this data, together with the released training data and benchmarks, as one of the contributions of the paper. Together the two metropolitan areas provide about 446,000 location–description pairs, which we believe is the best coverage currently available for this purpose.
Evidence of generality within the study. The two cities are in different countries and have different urban layouts, and we train on each independently with three LLM families. The consistency experiment performance suggests that our finding is not specific to one city or one model.