- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2(+1)
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
To address the limited spatial perception of vision-language models in complex spatial question answering, particularly in multi-hop reasoning and viewpoint changes, this paper proposes TTSR, a training-free test-time spatial reasoning framework. It decomposes each question into entities and spatial constraints, uses a VLM to localize objects, and obtains geometric information through depth estimation. Coordinate transformations and explicit spatial calculations then produce evidence to support answer selection. Experiments show improvements on three spatial reasoning benchmarks, with MultiHop Spatial accuracy rising from 36.4% to 60.3%.
Critical strengths
- TTSR organizes and processes geometric information, converting it into numerical evidence that can directly evaluate candidate answers.
- The framework improves performance on MultiHop Spatial, ViewSpatial, and SPHERE, which emphasize different aspects of spatial reasoning.
Critical weaknesses
- TTSR shares substantial conceptual similarities with existing frameworks, such as Geometrically-Constrained Agent (GCA) [1]. Prior work has also explored training-free approaches that enhance VLM spatial reasoning through external geometry tools and explicit geometric computation.
- Figures such as Figure 2 do not clearly communicate the method’s technical details, making it difficult to identify TTSR’s key innovations and distinguish it from prior approaches.
[1] Chen, Z., Lu, X., Zheng, Z., Li, P., He, L., Zhou, Y., Shao, J., Zhuang, B., & Sheng, L. (2025). Geometrically-Constrained Agent for Spatial Reasoning. arXiv preprint arXiv:2511.22659.
Questions for authors
- How does TTSR differ from existing spatial reasoning frameworks, particularly Geometrically-Constrained Agent (GCA; Chen et al., 2025) [1]?
- For object localization, why does TTSR use bounding boxes predicted directly by a VLM rather than established segmentation or detection models, such as those in the SAM and DINO families? Also, given the use of Depth Anything V2 for depth estimation, why was Depth Anything V3 not considered?
[1] Chen, Z., Lu, X., Zheng, Z., Li, P., He, L., Zhou, Y., Shao, J., Zhuang, B., & Sheng, L. (2025). Geometrically-Constrained Agent for Spatial Reasoning. arXiv preprint arXiv:2511.22659.
3 comments
I thank the authors for their thoughtful response. I found it constructive and believe it has substantially addressed several of my concerns. Although the modifications relative to GCA are relatively simple, they target its weaknesses effectively and yield notable improvements. The authors have also demonstrated that a more powerful model is not necessarily needed, which helps validate some of my own intuitions. I will therefore raise my score.However, I sincerely hope that the promised revisions will be incorporated into the paper promptly and clearly highlighted, as this may affect my final decision.
Dear Reviewer 4qFw,
We sincerely thank you for your engagement in the discussion. We are currently revising the paper based on the reviewers' constructive feedback and will post the revised version before the end of the response phase. Thank you once again for your valuable feedback!
Best regards, Authors
We sincerely thank you for your constructive review and for your questions about our comparison with GCA and our choice of perception modules. We address your concerns below.
W1 + Q1 (difference from GCA). Please see the General Response.
W2 (Figure 2). The authors thank you for your constructive suggestions and we will revise the figure to the technical details.
Q2 (VLM boxes vs. SAM/DINO). We first discuss the localization. In Section 3, we discuss the capability boundary of the QWen 3 8b VL, and we observe that the VLM's grounding is already on par with a dedicated detector: On COCO 2017, Qwen3-VL-8B reaches 79.9 F1@IoU>0.5, compared with 79.2 for Faster R-CNN.
Open-vocabulary detectors such as Grounding DINO are tuned mainly for category phrases, whereas the VLM already parses these expressions. Using the VLM's own localization and grounding keeps the streamlined design pipeline to one VLM, align our goal of adding tools only where the VLM strongly lacks a capability, such as depth estimation from 2D image.
SAM is a complementary model to perform fine-grained segmentation. Our Limitations (Appendix I) note that a box center and median box depth can be wrong under occlusion or for irregular shapes. SAM masks from the VLM's boxes could help address exactly this, and we will add this as a direction.
To further validate our claim, we independently integrate SAM and Depth Anything 3 into the TTSR pipeline to investigate whether incorporating additional specialized tools can further improve spatial reasoning performance. Given the limited time available during the rebuttal period, we conduct these experiments on MultiHop-Spatial benchmark.
(Depth Anything V2 vs. V3). TTSR uses depth only to obtain ordering and approximate metric depth at object locations, and the depth module can be applied off the shelf models without any constraint. In our ablation study, we test this directly: replacing Depth Anything V2 with MoGe-2 changes MultiHop accuracy by only +0.5 points. Depth Anything V2 also already reaches 98.0% relative-depth accuracy under our diagnostic protocol. The choice of estimator therefore has limited benefits, and the main error sources lie in planning and viewpoint construction (Table 6). Per our reviewer's suggestion, we conduct experiment that replace Depth anything V2 with V3 to test the performance change on the Multihop spatial
Table: Ablation study of integrating different external tools into the TTSR reasoning pipeline.
As shown in the table above, we can clearly observe that incorporating more advanced tools yields only marginal improvements in final prediction accuracy. Specifically, upgrading from Depth Anything V2 to V3 improves performance by only 0.5 percentage, while incorporating SAM provides a 0.24 percentage gain. These findings are consistent with our motivation that simply adding more powerful tools does not necessarily lead to substantial performance improvements. Instead, the effectiveness of tool integration depends on whether the tools provide the specific evidence required by the reasoning task, highlighting the importance of question-driven tool selection in TTSR.