- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes a self-supervised framework for learning boundary-aware location embeddings. Unlike existing location encoders, such as GeoCLIP, which typically learn geographic representations through visual supervision, the proposed approach leverages reverse-geocoded text to incorporate administrative and geographic information. Experimental results suggest that the learned embeddings capture information complementary to existing geographic representations, and combining them can improve performance on several downstream tasks. However, the method has limited technical novelty, and the paper lacks an in-depth analysis of the potential biases introduced by administrative boundary-aware supervision.
Critical strengths
-
The proposed self-supervised framework derives supervision signals from reverse-geocoded text, incorporating administrative boundaries and geographic place names into location representations. This provides a complementary source of information to the visual or environmental supervision commonly used in existing location encoders.
-
The experiments demonstrate that combining the proposed embeddings with existing geographic representations can improve performance on several downstream tasks. The evaluation covers multiple tasks and integrates the proposed approach with several existing location encoders, providing evidence of its potential applicability and complementarity.
Critical weaknesses
-
The proposed framework primarily integrates existing techniques, including reverse geocoding, pretrained text embeddings, and RQ-VAE. The reverse-geocoded text consists of only five administrative attributes (city, admin1, admin2, country, and continent), which are essentially categorical geographic identifiers rather than rich natural-language descriptions. It remains unclear whether encoding these simple attributes using a pretrained Qwen3-Embedding model offers meaningful advantages over conventional categorical embeddings or simpler alignment methods.
-
Administrative supervision may bias the learned representations toward boundary-aware geographic characteristics while weakening their ability to capture other important spatial properties, such as environmental similarities. This could introduce undesirable biases and reduce representation diversity and generalizability. The authors should provide a more in-depth analysis of these trade-offs rather than relying primarily on aggregate performance improvements.
-
The proposed approach relies exclusively on simple administrative attributes without exploring richer semantic information, such as climatic or socioeconomic characteristics. This potentially limits the diversity and expressiveness of the learned representations. The paper does not sufficiently justify why such a restricted set of geographic attributes is appropriate for general-purpose location representation learning.
-
Reverse-geocoded information is central to the proposed framework, yet the paper lacks ablation studies examining the contributions of different administrative attributes (e.g., city, region, country, and continent). It remains unclear whether coarse-grained information, such as country labels alone, could achieve comparable performance. Such experiments are important for establishing the effectiveness and necessity of the proposed supervision strategy.
Questions for authors
-
What motivates the choice of RQ-VAE and Qwen3-Embedding? Have the authors considered other alternatives, such as learnable categorical embeddings or direct embedding alignment? How do these alternatives compare in terms of effectiveness and computational efficiency?
-
How accurately do the learned embeddings capture actual administrative boundaries? Which types of downstream tasks or geographic scenarios benefit most from boundary-aware supervision, and in which cases might it introduce undesirable biases or degrade performance?
-
Why does the proposed framework rely exclusively on a relatively simple reverse-geocoding strategy? Have the authors considered extracting richer geographic semantics to improve representation diversity and generalizability?
-
How does the performance change when different levels of administrative information are used for supervision (e.g., country only, country plus region, or the full administrative hierarchy)? Can the authors demonstrate that fine-grained administrative information provides meaningful improvements over coarse-grained labels?
4 comments
Rebuttal response to Reviewer meqg (2/n)
- W3: "relies exclusively on simple administrative attributes without exploring richer semantic information, such as climatic or socioeconomic characteristics. This potentially limits the diversity and expressiveness of the learned representations."
- Encoding place names using LLMs helps us capture richer characteristics that go beyond simple place names and admin boundaries. Examples:
- The learned semantic IDs capture cultural-regional distinctions like South Asia, the Arabian Gulf, and so on (Line 405 Sec. 6.1). None of these terms are included in explicit place names data. These are emergent region-cultural subgroups that are learned emergent properties.
- To show the kinds of rich semantic information contained in LLM embeddings of place names (which are our reconstruction target), we have included some now experiments (provided in newly uploaded supplementary material) with the following examples:
- Language names align with the cities where the language is widely spoken.
- We embedded six diverse language names (Hindi, English, Arabic, Spanish, Swahili, Mandarin). For each language, we picked ten well-known cities where that language is the most widely spoken. The 10-nearest neighbors for each language embedding (using cosine similarity) are almost always the cities where this language is the most widely spoken. Precision@10 for language to city retrieval was found to be 0.97.
- An additional experiment was performed where “distractor” keywords were added by introducing 6 additional language embeddings and 12 city embeddings with two cities per distractor language. Additionally, 8 city embeddings were introduced that don’t match to any language in the main 6 cities or the distractor 6 cities. Language-to-city P@10 drops only marginally from 0.97 to 0.95. (chance: 0.17 without distractors, 0.13 with them).
- City names cluster by country by default, and can cluster by other attributes when prompted.
- 5 countries and 9 cities per country were chosen. Of the 9 cities, 3 are large cities, 3 medium-sized, and 3 small towns.
- Default clustering by country: Performing t-SNE on these shows that the cities form five tight groups, one for each country. For every city, its 5 nearest neighbors (by cosine similarity) are all from the same country.
- Prompted clustering by city size: Qwen3-Embedding accepts an optional instruction that tells the model what the embedding will be used for. The instruction is put in front of the text as Instruct: <instruction>\nQuery: <text>. We re-embedded the same 45 place names with the instruction "Given a place name, classify whether it is a big city, a mid-sized city, or a small town." With this instruction, the t-SNE plot reorganizes by size instead of country. All 15 big cities, from all five countries, merge into one cluster. The mid-sized cities and small towns share a second region, with a relatively coarser sub-grouping of medium-sized cities in one cluster, and another cluster of small towns.
- Place names align with descriptions of their physical setting.
- We embedded four short descriptions of physical settings: "warm coast", "cold mountain", "hot desert" and "tropical rainforest". For each description, we picked 15 well-known cities that fit it, 60 cities in total. Each city was then assigned to the description it is most similar to. This gave the correct description for 56 of the 60 cities (93%; chance is 25%).
- On a world map, the assignments fall where one would expect. Desert cities cover the Sahara, Arabia, the US Southwest and central Australia. Rainforest cities cover the Amazon, the Congo basin and Borneo. Mountain cities cover the Alps, the Rockies, the Andes and the Himalayas. Coastal cities line the Mediterranean, Florida, California and Queensland.
- Complete details and figures explaining the above can be found in the newly submitted supplementary PDF file.
- Language names align with the cities where the language is widely spoken.
- Encoding place names using LLMs helps us capture richer characteristics that go beyond simple place names and admin boundaries. Examples:
(contd. below)
Rebuttal response to Reviewer meqg (3/n)
- W4: "...the paper lacks ablation studies examining the contributions of different administrative attributes (e.g., city, region, country, and continent). It remains unclear whether coarse-grained information, such as country labels alone, could achieve comparable performance."
- We thank the reviewer for this suggestion. While we did not run a full per-attribute ablation, the levels of the hierarchy play complementary roles, and removing any of them weakens the supervision in a predictable way:
- Coarse levels alone cannot separate nearby locations. Dropping finer levels (city, region) merges all locations within a unit into a single target, removing the signal for within-unit variation in climate, elevation or population density that our downstream tasks measure. For example, our full reverse-geocoded strings yield approx. 21K unique targets on S2-100K, versus approx. 250 with country names alone.
- Fine levels alone lack context. Dropping coarser levels (region, country) leaves names that are ambiguous or poorly represented. Well-known places (e.g., "New York") are well encoded by the Qwen3 embeddings, but less-known places improve noticeably when their admin1 and country names are appended. The hierarchy also disambiguates shared names: "Paris" alone embeds close to Paris, France, whereas "Paris, Texas, United States of America" correctly represents the Texas city.
- The full hierarchy therefore combines the specificity of fine-grained names with the context of coarse ones. We agree that a systematic per-attribute ablation would strengthen this argument and will include it as future work.
- We thank the reviewer for this suggestion. While we did not run a full per-attribute ablation, the levels of the hierarchy play complementary roles, and removing any of them weakens the supervision in a predictable way:
- Q1: "What motivates the choice of RQ-VAE and Qwen3-Embedding? Have the authors considered other alternatives, such as learnable categorical embeddings or direct embedding alignment?"
- We thank the reviewer. We considered both alternatives:
- Learnable categorical embeddings. As shown in our response to [W1] above, RQ-VAE + Qwen3 outperforms categorical embeddings trained on the same reverse-geocoded labels. Categorical IDs treat each administrative unit as an independent symbol and carry no information beyond the label itself.
- Why RQ-VAE. Its residual codebooks yield coarse-to-fine Semantic IDs (Sec. 6.1), including groupings such as "South Asia" that never appear in the reverse-geocoded strings.
- Why Qwen3-Embedding. New experiments (submitted via new a new supplementary file, and explained above in [W3]) shows that its place-name embeddings encode knowledge beyond the label itself: language names retrieve the cities where they are most widely spoken (P@10 = 0.97, or 0.95 with distractors), city names cluster by country by default and by city size when instructed, and cities match descriptions of their physical setting (93% vs. 25% chance).
- We thank the reviewer. We considered both alternatives:
- Q2-a: "How accurately do the learned embeddings capture actual administrative boundaries?"
- Please see Sec. 6.1 (lines 411–423), where we measure how well the learned Semantic IDs predict administrative attributes at unseen locations. Accuracy rises monotonically with prefix depth for every attribute (Fig. 2, right): continent is largely fixed by the first code (83%) and country by the first two (70%), while admin1 and city keep improving up to the full Semantic ID (61% and 33%). The lower admin1 and city accuracies reflect resolution rather than missing information (explored further in Appedix E).
- Please also see Table 1 and Sec. 6.2: the continuous embeddings, which feed the downstream tasks, capture boundaries more precisely than this discrete view. On country classification, an MLP probe reaches 94.6% accuracy with SatCLIP-TextRQ and 94.9% with RevGeoRQ, versus 90.7% for native SatCLIP (Table 1). Qualitatively, the similarity fields in Fig. 3 (Sec. 6.2) align with country borders and taper across the subcontinent and continent, whereas native SatCLIP fragments within countries.
(contd. below)
Rebuttal response to Reviewer meqg (4/n)
- Q2-b: "Which types of downstream tasks or geographic scenarios benefit most from boundary-aware supervision, and in which cases might it introduce undesirable biases or degrade performance?"
- Please see Sec. 4.2.1, Sec. 6.2, Sec. 7 and App. F.
- Benefits: Tasks aligned with administrative units benefit most. TextRQ improves population prediction for every backbone and country classification for three of four (App. F), and improves top-1 iNaturalist geo-prior accuracy for all backbones (Table 2).
- Degradation: Tasks that vary within an administrative unit can degrade, such as California Housing and, for some backbones, air temperature and elevation (App. F).
- Biases: Coverage is coarser in sparsely populated regions, and boundary-aware embeddings miss long-range physical similarities, such as between the Himalayas and the Andes, that image-trained encoders capture (Sec. 6.2, Sec. 7).
- Mitigation: Concatenating with native embeddings recovers much of this, outperforming Native in 24 of 28 comparisons (Sec. 4.2.1).
- Please see Sec. 4.2.1, Sec. 6.2, Sec. 7 and App. F.
- Q3: "Why does the proposed framework rely exclusively on a relatively simple reverse-geocoding strategy? Have the authors considered extracting richer geographic semantics to improve representation diversity and generalizability?"
- We thank the reviewer for this suggestion. We chose reverse geocoding because it is a simple, cheap and scalable signal, needed only offline during pretraining; at inference, the encoder takes raw coordinates directly. Enriching the strings with additional context as suggested, e.g., the nearby places used in GeoLLM (Manvi et al.), would add substantial cost at our pretraining scale. Moreover, richer semantics are already partly captured implicitly: the pretrained LLM encoder brings in knowledge beyond the place names themselves, such as associated languages, city size and physical setting (see our response to W3 and App. G). Since our framework accepts any text target, richer descriptions can be swapped in without changing the method, which we see as promising future work.
- Q4: "How does the performance change when different levels of administrative information are used for supervision"
- Addressed via response to W4 above.
Rebuttal response to Reviewer meqg (1/n)
We would like to thank Reviewer meqg for their review. Please find our responses and improvements below:
Result: the new hierarchical-ID baseline takes a lat-long input, reverse geocodes it, and produces a tree-like hierarchical ID. This proves to be a strong baseline with an average .669R2 on regression tasks and .676 acc. on classification tasks. However, it significantly trails all the variants trained with our method. For illustration, our Custom RevGeoRQ model achieves an average .835R2 on regression tasks and .841 acc. on classification tasks. Full results:
(contd. below)