- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper focuses on enhancing the spatial understanding ability of MLLM. First, the paper explores the effects of four location representations on enhancing the spatial understanding ability of MLLM, and finds that using spherical coordinates is the most effective. In order to train MLLMs using spherical coordinate annotation, an automated process was developed to generate grounding samples from annotated 3D scans and construct 300K training data. In addition, by using a spherical coordinate tokenizer for per-axis classification instead of the original text generation method, spherical coordinates can be predicted. Based on constructed training data and vocabulary expansion, SCOPE achieves effective improvement in spatial position understanding dataset.
Critical strengths
- The paper explores an important issue in spatial understanding, which location representation is most suitable for enhancing the spatial understanding ability of MLLM. The effects of four location representations were compared through controlled experiments to determine the gain brought by spherical coordinates.
- The paper developed an automated pipeline for constructing spherical coordinate grounding data and generated 300K validated training samples. The experiments showed that these data can enhance the spatial understanding ability of MLLM.
- The paper proposes a spherical coordinate tokenizer that effectively predicts spherical coordinates using MLLM by dividing each axis into half-open bins and assigning one token per bin.
- SCOPE trained on the constructed training data and with vocabulary expansion achieves better performance on multiple spatial understanding datasets.
Critical weaknesses
- The spherical tokenizer’s quantization error and bin design are underexplored. Azimuth and elevation are binned every 5◦, and distance uses growing bin widths. Direct localization yields a mean error of 0.51 m and a median error of 0.36 m for SCOPE-8B, which may be sufficient for these benchmarks but limiting for high-precision spatial applications.
- How SCOPE uses spherical coordinate tokens at inference time is not clearly explained. During training, SCOPE performs per-axis classification over spherical tokens. However, most benchmark questions in Table 1 are multiple-choice or numerical questions that do not require explicit output.
- SCOPE is trained on the constructed dataset SPHEREQA and an auxiliary mixture of public spatial QA and general VQA. Figure 6a also analyses the impact of different parts of the data on model performance, but the paper lacks an explanation of how these different data are scheduled during training.
Questions for authors
- Can spherical coordinate grounding training bring performance improvement on other 3D scene understanding and spatial question answering benchmarks (such as VSI Bench)?
- How does the bin granularity of each spherical-coordinate axis, namely azimuth, elevation, and radial distance (for example, 5◦ angular bins and growing-width distance bins), affect 3D localization error and final performance on the four spatial benchmarks, and can the authors provide an ablation over different bin granularities and justify the chosen granularity?
3 comments
Responses to rebuttal
Rebuttal has solved my problem, and I will maintain my positive score.
Follow-up Response to Reviewer KeAw
Thank you for following up. We're glad that our response has addressed your concerns, and we appreciate your positive assessment of our work.
Responses to Reviewer KeAw
Thank you for your helpful review and for recognizing the importance of studying spatial representations and the value of our automated grounding data pipeline. We address each of your concerns below, and changes in the revised paper are marked in orange.
[W1, Q2] Angular bin granularity and localization precision
We agree that bin granularity matters for localization precision. We halved the angular bin width from 5° to 2.5°, keeping all other settings unchanged. As shown below, finer bins slightly improve localization but yield a lower average spatial QA score (45.8 vs. 46.5). Halving the bin width doubles the angular vocabulary, reducing the average number of training examples per token. Learning these finer distinctions may therefore require more training data. Since each configuration requires retraining on the full 600K-sample corpus, time and compute constraints during the rebuttal period limited us to this additional setting. We will explore more angular and radial settings in future work.
[W2] Coordinate tokens at inference
SCOPE does not generate coordinate tokens on the Table 1 benchmarks. We use each benchmark’s default prompts in lmms-eval without the <SPHERE_MODE> prefix, so SCOPE directly outputs an option letter or a number. We have clarified this in the Inference Setup paragraph (Sec. 5.1). Coordinate tokens benefit spatial reasoning through training, even though they are not generated at inference. Since grounding and spatial QA share model parameters, learning to locate objects in 3D helps the model reason about their spatial relationships. Two ablations support this:
Grounding-only training. Training on SphereQA alone, without spatial QA data, improves the average score by 4.3 points (Fig. 6(a)), demonstrating that object-localization supervision transfers to spatial QA.
Tokenized supervision. With the same training data and spherical coordinate targets, tokenized supervision outperforms raw-text supervision by 2.0 points (Table 3). This shows that coordinate tokens make grounding supervision more effective for downstream spatial reasoning.
[W3] Joint training schedule
Sorry for the confusion. We mix SphereQA with the auxiliary data and train them jointly for one epoch in a single stage. We have revised the Model Training paragraph in Sec. 5.1 to clarify this schedule.
[Q1] Evaluation on additional spatial benchmarks
Thank you for the suggestion. Our main evaluation includes ReVSI [1], a rebuilt version of VSI-Bench with corrected 3D annotations and human-verified questions. Following your suggestion, we have additionally evaluated SCOPE and its base models on VSI-Bench, SPAR-Bench-Tiny, and CV-Bench using the same evaluation settings as Table 1. SCOPE improves both backbones on all three benchmarks, further supporting the effectiveness of our method across spatial reasoning benchmarks.
[1] ReVSI: Rebuilding Visual Spatial Intelligence Evaluation for Accurate Assessment of VLM 3D Reasoning. ICML 2026.