- Rating
- 3
- Confidence
- 3(+1)
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces GeoVec-VLM, which integrates geospatial vector geometry with raster images and language for spatial reasoning. Polygon boundaries are encoded into reference-point and path tokens, while object, role, and relation states organize their interaction with visual information and language queries. Auxiliary spatial objectives supervise these representations. Experiments evaluate several geometric reasoning tasks on geographically disjoint regions in China and transfer sets in the United States and Singapore, reporting improvements in accuracy and geometric consistency.
Critical strengths
- The empirical evaluation includes useful ablations and geographic transfer tests. Comparisons between pooled and element-level representations, together with ablations of spatial states and auxiliary supervision, help assess the proposed components. Evaluation on held-out regions and additional geographies also provides evidence beyond performance on the training distribution.
- The geometric consistency analysis is valuable. Evaluating reciprocal relations and agreement between categorical direction predictions and displacement estimates reveals limitations that individual-answer accuracy can overlook. This adds useful information about the models’ spatial behavior.
Critical weaknesses
- The empirical positioning against the closest geometry–language approaches remains incomplete. The paper discusses SLM, but Table 2 evaluates adaptations of geometry encoders rather than directly establishing the advantage over the full SLM approach. Although these comparisons are informative, they leave uncertainty about the incremental contribution relative to the closest prior work and the effect of differences in supervision and adaptation.
- The contribution of vision to the main reasoning tasks is insufficiently isolated. Several evaluated relations can be determined from the supplied vector geometry. The cross-modal grounding experiment supports the ability to associate visual and geometric information, but the additional benefit of imagery across the main tasks remains less clear. This limits how broadly the results support multimodal spatial reasoning.
Questions for authors
- How does the Geo2Vec-based variant in Table 2 relate to SLM’s integration and training procedure? Could you clarify which aspects are retained or changed and how this affects the comparison with the closest prior approach?
- Are auxiliary spatial supervision and adaptation budgets comparable across the interfaces in Table 2? Given their different geometry-pretraining procedures, how much of the observed advantage can be attributed specifically to retaining element-level structure?
- Could you provide geometry-only ablations for tasks whose necessary inputs are available in vector form, and quantify the additional benefit of imagery? This would help distinguish geometric reasoning improvements from improvements requiring visual–vector interaction.
I am not an absolute expert in this field. Answering the questions above would increase my confidence in accepting the paper.
3 comments
Response to Reviewer Jnk6 (2/2)
W2/Q3. Contribution of Visual Information to Spatial Reasoning
As reviewer's suggestion, we further anaylzed whether and to what extent the trained GeoVec-VLM relies on visual information for spatial reasoning. we replaced the raster image with a blank image at inference time, keeping the trained model, vector geometry, and language instructions unchanged. This intervention evaluates the model's dependence on visual input without retraining (revised Appendix E, Table 14, lines 1584–1603).
Table R3. Accuracy under visual removal on the China test set (%).
| Task | Original image | Blank image | Δ (pp) |
|---|---|---|---|
| Direction | 80.4 | 69.5 | −10.9 |
| Proximity | 80.7 | 71.7 | −9.0 |
| Parcel–parcel topology | 79.56 | 71.17 | −8.39 |
| Point–parcel topology | 82.67 | 47.28 | −35.39 |
| Area | 77.8 | 58.1 | −19.7 |
| Boundary distance | 65.9 | 38.5 | −27.4 |
Replacing the image reduces accuracy across all six tasks. Direction, Proximity, Parcel Topology, and Area decline by 8.4–19.7 pp, despite the relevant geometric information remaining available through vectors. Larger drops occur in Point Topology (35.4 pp) and Boundary Distance (27.4 pp), where blanking the image also removes the query-point crosshair.
Visual and Geometric Attribution. We are also happy to share with the reviewer our additional attribution analysis (revised Appendix E.1, Figs. 14–16). GeoVec-VLM shows visual responses over relevant parcel regions and boundaries, accompanied by element-level geometric attribution, particularly near the minimum-distance boundaries in Proximity. Together with the cross-modal grounding results in Fig. 4, these observations provide further qualitative evidence that visual information contributes to spatial grounding and reasoning.
Finally, we sincerely thank the reviewer for helping us clarify our research positioning and strengthen our experimental evaluation. We hope the additional experiments and explanations address your concerns and give you greater confidence in our work. We also wish you a good day.
Thank you to the authors for their thorough response and additional experiments. Most of my concerns have been addressed. I encourage the authors to incorporate these results into the final version of the paper. I maintain my positive score and have increased my confidence in my assessment.
Response to Reviewer Jnk6 (1/2)
We thank the reviewer for recognizing the value of our geometric-consistency analysis beyond answer accuracy, as well as our ablations and geographic transfer results.
Technical Relationship and Comparison Scope. Our original Geo2Vec baseline was a component-level comparison using frozen object-level Geo2Vec embeddings, a learned projector, and rank-16 LoRA on Qwen3-VL-8B. It did not reproduce SLM's complete spatial adapter and spatial instruction training pipeline.
SLM integrates Geo2Vec's object-level geometry embeddings into a language model for geometric operations and spatial reasoning, while GeoVec-VLM researchs how vector geometry connects visual regions, geographic objects, and language queries to support multimodal spatial perception and reasoning. Since the original SLM does not incorporate visual observations and its official implementation was unavailable at submission, we initially compared its geometry encoder as a representative component. We have clarified these technical connections and the comparison scope in the revised Introduction (lines 51–54, 77–78) and Related Work (Section 2.2, lines 135–149).
Full SLM Comparison. Following the reviewer's suggestion, we adapted the subsequently released SLM implementation to our multimodal benchmark. We retained its three-layer geometry encoder, two-layer projector, spatial supervision, and alignment/joint training procedure, while replacing Qwen3-8B with Qwen3-VL-8B and adapting its spatial instructions to our task setting (Appendix E.2, lines 1802–1811).
Table R1. Comparison on the China benchmark (%; mean over five categories).
Under the shared evaluation protocol, GeoVec-VLM performs better overall than VLM-adapted SLM. This comparison suggests the importance of effective alignment and interaction between visual and geometric information in multimodal spatial reasoning, where visual inputs can also influence spatial predictions. The contribution of element-level geometry is examined separately in W2/Q2.
To enable a more controlled comparison, we equipped Geo2Vec and Poly2Vec with the O/A/Z spatial states, structured decoder, and auxiliary supervision following the design of Pool GeoVec-VLM, yielding Geo2Vec + spatial pathway and Poly2Vec + spatial pathway, and extended baseline training to up to 1,500 updates with validation-based checkpoint selection.
Table R2. Controlled comparison of geometry representations on the China test set (%).
The spatial pathway improves Geo2Vec and Poly2Vec by 12.5 and 12.9 pp, showing that part of the original performance gap was attributable to differences in spatial modeling and supervision. Nevertheless, both remain below GeoVec-VLM (77.2%). The original Pool–Full comparison provides more direct evidence for the benefit of retaining element-level geometry: preserving these tokens throughout multimodal interaction improves performance by 9.6 pp.
These additional comparisons have been incorporated into revised Table 2 (lines 408–420), with implementation details in Appendix B.4 (lines 1337–1344).