- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper introduces GeoWeaver, a token-adaptive geometric grounding framework for spatio-temporal reasoning. It uses a frozen geometry encoder to construct a multi-level feature bank, from which a token-level router selects and combines two spatially aligned geometric features for each visual token. The selected features are integrated into visual representations before language decoding, enabling different regions to leverage different levels of geometric information. GeoWeaver outperforms SpatialStack on VSI-Bench and under a matched 32-frame ReVSI setting. Ablation studies further show that token-adaptive selection provides modest improvements over uniform averaging and global layer weighting.
Critical strengths
-
A clear and well-motivated mechanism. The paper investigates whether different visual tokens benefit from features extracted at different layers of the geometry encoder, with controlled comparisons against uniform averaging and global layer weighting. Ablations help isolate the contribution of token-adaptive selection.
-
Strong results against a closely related baseline. GeoWeaver outperforms SpatialStack on VSI-Bench and all seven ReVSI subtasks under a matched 32-frame setting. The shared backbone and geometry encoder, along with closely aligned training recipes, make the comparison particularly meaningful for evaluating the overall methods.
Critical weaknesses
-
The contribution of token-adaptive routing remains unclear. GeoWeaver's improvements over SpatialStack involve changes in both the fusion stage and layer selection, while the direct evidence for routing is mainly a 1.4-point gain over global weighting on VSI-Bench. Thus, although the overall framework is effective, the specific contribution of token-adaptive selection remains difficult to isolate.
-
Limited evidence of generalizability and advantages over prior methods. Routing ablations are restricted to VSI-Bench, while the six-benchmark evaluation covers only the full framework. The paper could better clarify its contributions relative to SpatioLM [1], which leverages intermediate visual features, and GeoThinker [2], which selectively integrates geometric information. Given differences in backbones and evaluation settings, the comparison should emphasize methodological distinctions rather than raw performance differences.
[1] Wu et al., "SpatioLM: Towards General Physical Spatial Intelligence in Vision-Language Models"
[2] Li et al., "Thinking with Geometry: Active Geometry Integration for Spatial Reasoning"
Questions for authors
-
While GeoWeaver is evaluated on ReVSI and SPAR-Bench, the benefit of token-adaptive selection over global layer weighting is demonstrated only on VSI-Bench. Does token-adaptive routing yield similar improvements on ReVSI and SPAR-Bench?
-
Minor presentation issues. On page 2, “The main contributions of this work are:” appears twice consecutively. In Table 5, the Avg. column uses inconsistent decimal precision (e.g., 69.725 versus mostly one or two decimal places).
3 comments
Reply
Thank you for the additional experiments and clarifications. My concerns have been addressed. I recommend including these additions in the final version, and I maintain my positive score.
Comment by authors
Dear Reviewer Q7bX,
We are pleased to hear that our response has adequately addressed your concerns. We will add all the experiments to the final version of the manuscript. We sincerely appreciate your dedicated time and effort in offering invaluable feedback. Please let us know if there are any aspects you would like us to clarify or improve further. We would be happy to provide additional explanations.
Best,
The authors
Rebuttal by Authors
Dear Reviewer Q7bX,
We thank you for the thoughtful review and for recognizing token-adaptive selection.
W1. “contribution of token-adaptive routing”
We address this through the motivation for regional geometry selection and experiments that isolate its contribution. VGGT depths respond differently to the same scene (Fig. 1(b)), while native 2D visual tokens describe different image regions. This motivates learning a separate 2D–3D coupling for each region, which GeoWeaver implements by using the native visual token to select and combine two aligned features from twelve frozen VGGT layers through a weighted residual update. The joint scene representation then gives LLM attention visual semantics and geometry to use together with the language question.
Token-wise and shared Top-2 use the same fusion stage and two-layer budget, directly testing whether each region benefits from its own choice. Shared Top-2 averages twelve-way probabilities over the input's visual tokens and frames, selects the two largest entries and renormalizes their weights for all locations.
All eight VSI categories improve, led by route planning (+3.14) and relative distance (+2.41).
The complete grounding operation also raises native-token pooled R@1 from 20.75% to 24.34% on the cross-view retrieval probe over 30 ScanNet scenes. Together, the controlled allocation gains and improved geometric correspondence support adaptive geometry as a way to strengthen the joint 2D–3D representation used by the LLM for spatial understanding.
W2/Q1. “similar improvements on ReVSI and SPAR-Bench”
To test whether the routing benefit extends beyond VSI-Bench, we compare token-wise selection with shared dense and uniform aggregation on ReVSI and SPAR-Bench. Shared dense uses input-averaged router probabilities as twelve weights shared by all visual positions, while uniform averaging gives all twelve layers equal weight.
The gains against shared Top-2 and all-layer aggregation show that region-specific allocation is useful under both sparse and dense alternatives. This extends the benefit of adaptive geometric coupling beyond VSI-Bench.
W2. “methodological distinctions rather than raw performance differences”
The key differences are the geometry source, selection granularity, and fusion stage. SpatioLM constructs geometry-aware representations from intermediate native-vision features through its Spatio-Vision Module and injects them into LLM blocks. GeoThinker uses frame-constrained cross-attention and importance gating inside selected decoder blocks. GeoWeaver instead uses each native visual token to choose aligned features across the depths of an external frozen VGGT bank before language decoding, so its selection determines which geometric evidence each region receives and incorporates into its visual representation.
Q2. “Minor presentation issues”
We removed the duplicated contribution lead-in on page 2. The decoder-side fusion Avg. in the revised PDF is 69.73, the eight-category mean (69.725) rounded to two decimal places.
If you have any other concerns, please let us know. Thanks for your time again.