- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes SpatialASM, a framework that leverages generative image models to teach VLMs to select hypothetical viewpoints and imagine corresponding observations, aiming to improve their intrinsic spatial reasoning capabilities. The method consists of two components: view planning and view imagination. It synthesizes reasoning trajectories using a novel-view generator and employs SFT followed by GRPO to internalize these capabilities into VLMs. Experiments across seven spatial reasoning benchmarks and four VLM backbones show modest but consistent improvements in spatial reasoning performance.
Critical strengths
-
Clear problem formulation and framework design. The paper clearly identifies the limitations of existing VLMs in active viewpoint planning and imagination. The proposed framework is logically organized, with a clear and reasonable methodology.
-
Useful analysis of existing model limitations. The paper provides empirical observations on the limitations of existing VLMs in spatial mentalization, particularly their difficulty in spontaneously performing viewpoint planning and imagination. This provides some motivation for the proposed approach.
Critical weaknesses
-
Limited novelty. The central research question has already been extensively explored in prior work on spatial imagination, viewpoint planning, and world-model distillation [1–4]. Although some of these works are cited, the paper does not sufficiently justify its novelty over them. I find the methodological differences largely incremental, without a fundamentally new research insight.
-
Insufficient evidence for the core claim. The paper claims to internalize Active Spatial Mentalization, yet the performance improvements are relatively modest (+1.2 to +3.5% on average). More importantly, it lacks controlled comparisons demonstrating that these gains arise specifically from learned viewpoint planning and imagination, rather than additional spatial reasoning supervision. This weakens the central claim of the paper.
[1] Zhang et al., World2VLM: Distilling World Model Imagination into VLMs for Dynamic Spatial Reasoning, 2026.
[2] Cao et al., SpatialDreamer: Incentivizing Spatial Reasoning via Active Mental Imagery, CVPR 2026.
[3] Bigverdi et al., Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models, ECCV 2026.
[4] Li et al., OmniView-Space: Reinforcing Spatial Reasoning via Multi-Perspective Spatial Mapping, 2026.
Questions for authors
Beyond incremental differences in implementation or framework design, what fundamentally distinguishes SpatialASM from existing approaches [1–4]? Could the authors provide concrete examples demonstrating what new insight or capability SpatialASM introduces that previous methods have not already explored or established?
[1] Zhang et al., World2VLM: Distilling World Model Imagination into VLMs for Dynamic Spatial Reasoning, 2026.
[2] Cao et al., SpatialDreamer: Incentivizing Spatial Reasoning via Active Mental Imagery, CVPR 2026.
[3] Bigverdi et al., Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models, ECCV 2026.
[4] Li et al., OmniView-Space: Reinforcing Spatial Reasoning via Multi-Perspective Spatial Mapping, 2026.
5 comments
Part 2/3: Related Work
[3] IPT (Imaginative Perception Tokens). The distinction is between imagining a task-prescribed spatial configuration and supervising viewpoint selection conditioned on the spatial question.
IPT constructs three spatial tasks whose imaginative representation is defined by the task instance: (1) Perspective Taking marks the target position and specifies the viewpoint transformation; (2) Path Tracing fixes the path midpoint and queried viewing side; and (3) Multiview Counting uses a top-down bird's-eye-view representation. Our trajectories instead supervise selecting task-relevant viewpoints and using their imagined observations for reasoning.
Most IPT evaluations focus on its three training tasks, with broader transfer evaluated on subsets of 200 MindCube and 170 All-Angles questions. SpatialASM evaluates the resulting LVLMs across seven spatial benchmarks while also checking general visual capabilities. This provides evidence for the usefulness of our supervision across different spatial tasks, without requiring the LVLM to generate intermediate images.
[4] OmniView-Space. OmniView-Space is a closely related concurrent work. Both approaches internalize question-conditioned spatial reasoning, but differ in the intermediate reasoning process they supervise. OmniView-Space teaches VLMs to select a query-aligned reference frame and construct a BEV cognitive map or textual spatial graph. SpatialASM instead teaches the model to select task-relevant allocentric viewpoints, imagine what they would see, and use these imagined observations to answer the question. Our distinction is therefore in viewpoint-based intermediate supervision, rather than question-conditioned reasoning itself.
Part 3/3: Controlled Experiments
W2: Insufficient evidence for the core claim. The paper claims to internalize Active Spatial Mentalization, yet the performance improvements are relatively modest (+1.2 to +3.5% on average). More importantly, it lacks controlled comparisons demonstrating that these gains arise specifically from learned viewpoint planning and imagination, rather than additional spatial reasoning supervision.
We appreciate this useful comment. We added controlled experiments on Qwen3-VL-4B by training it with the same QA instances in SpatialASM-66k but without ASM trajectories under different training strategies: answer-only SFT, standard-CoT SFT, and conventional-QA GRPO. Standard-CoT SFT uses the same teacher model used to synthesize ASM trajectories to generate CoT for SFT training. We additionally report our ASM-trajectory SFT model (the "SFT with filter" setting in the original Table 4) and the complete SpatialASM-4B model. The additional SFT and GRPO training follows the configurations described in Sec. 4.
| Methods | MindCube | MMSI | Spa457-6d | EmbSpa | AVG |
|---|---|---|---|---|---|
| Qwen3-VL-4B | 33.9 | 28.0 | 37.2 | 72.3 | 42.9 |
| + Answer-only SFT | 39.0 | 28.1 | 26.8 | 69.5 | 40.9 |
| + Standard-CoT SFT | 31.5 | 28.7 | 33.1 | 76.0 | 42.3 |
| + Conventional-QA GRPO | 33.9 | 26.9 | 39.6 | 76.2 | 44.2 |
| + ASM-trajectory SFT | 38.7 | 29.4 | 42.6 | 74.6 | 46.3 |
| SpatialASM-4B | 39.1 | 29.2 | 42.8 | 76.5 | 46.9 |
Simply adding the same 66k QA instances, whether through answer-only/standard-CoT SFT or conventional-QA GRPO, does not reproduce the average gains obtained with ASM-trajectory supervision. Some baselines regress considerably on individual benchmarks, whereas ASM-trajectory SFT improves over the base model on all four and achieves the strongest overall single-stage performance. Since these comparisons use the same spatial QA instances, the improvement cannot be explained by the additional QA instances alone. These results support the benefit of our proposed ASM supervision for spatial reasoning.
Benchmark details. The three leftmost benchmarks require integrating incomplete spatial evidence and reasoning through viewpoint exploration or transformation, while EmbSpa targets more general spatial understanding that can often be resolved from the observed input views.
Answer-only SFT. This strategy shows uneven transfer: it improves MindCube but degrades on Spatial457-6d and EmbSpa. Thus, it does not reliably improve performance across the evaluated spatial tasks.
Standard-CoT SFT and conventional-QA GRPO. Both rely on LVLM-generated reasoning, produced either by the teacher or by the model's own rollouts. Their limited overall gains are consistent with the importance of grounding intermediate reasoning in spatial observations. We treat this as an interpretation of the results rather than a direct measurement of reasoning-trace quality.
We also provide targeted viewpoint evaluations in Table 6. When changing only the planner and keeping the NVG and final Qwen3-VL-8B reasoner fixed, SpatialASM-8B improves downstream accuracy from 42.0 to 45.5 on Among and from 45.5 to 48.5 on Around. On tasks with a specified target perspective, scores increase from 43.3 to 44.3 on ViewSpatialBench-PersRel and from 25.9 to 30.4 on 3DSRBench-MultiViewTo. These results support improved planning utility and viewpoint-conditioned reasoning; adaptive invocation and internal imagination fidelity are not separately verified by these evaluations.
Part 1/3: Related Work
Thank you for your careful review and constructive suggestions. We appreciate your recognition of the clear problem formulation, logically organized framework, and useful empirical analysis of existing LVLM limitations. We have revised the manuscript PDF to clarify the training-time role of the novel-view generator and added controlled comparisons using the same spatial QA instances (Table 5). All newly added section titles in the PDF are highlighted in blue. We will further update the PDF within the next two days to incorporate the related work you mentioned. We address your concerns about novelty and the source of the gains below.
Thanks for pointing out this concern. Our contribution lies in internalizing question-conditioned spatial exploration and reasoning through explicit trajectory supervision. While viewpoint planning and imagination have been studied previously, SpatialASM supervises both through the LVLM's own textual reasoning, without an external simulator at inference time. The trajectories start from a spatial question, plan relevant alternative viewpoints, describe the corresponding imagined observations, and use them to derive an answer. We clarify the major differences with the four related works below.
[1] World2VLM. We discuss the distinction from World2VLM in the final paragraph of Appendix A.2, and an example is provided in Figure 4. World2VLM uses a world model to synthesize spatial-QA tasks that teach the relationship between egocentric actions and changes in visual observations. Its supervision provides final answers rather than reasoning trajectories showing how to select useful viewpoints for solving a spatial question.
As shown in Sec. 4.1 and Figure 14, useful viewpoint exploration is not reliably elicited during ordinary reasoning in the evaluated baseline settings. We trained Qwen3-VL-8B on World2VLM's data and observed no accuracy gain over the baseline on MMSI, whereas SpatialASM improved performance by 3.3 points. This comparison is consistent with the value of question-conditioned reasoning supervision, although it does not by itself isolate all differences between the two data pipelines.
Our central contribution is a scalable method for constructing spatial reasoning supervision from existing QA datasets. Rather than only teaching what happens under a given camera motion, our trajectories teach the model to start from a spatial problem, identify alternative viewpoints that could help resolve it, imagine the corresponding observations, and reason toward an answer. Figures 4 and 6 illustrate the difference in supervision format.
[2] SpatialDreamer. SpatialDreamer belongs to world-model-assisted spatial reasoning and resembles our external-ASM setting. We discuss the distinction from such approaches in Sec. 2, Table 2, and Appendix A.3.
SpatialDreamer investigates how an external world model can augment an LVLM with additional visual observations at inference time, whereas SpatialASM uses the world model as a training-time engine to construct supervision for the LVLM's own reasoning. This leads to three practical differences.
First, inference cost. In our reproduction on 160 questions from MindCube, ViewSpatial, and 3DSR, each question required an average of 48 seconds of SVC execution. And tool instructions, generated observations, and multi-round interaction produced an average prompt context of 11.75k tokens. SpatialASM performs textual reasoning without this world-model execution and interaction at inference time.
Second, such a pipeline is not consistently helpful across spatial tasks. The failure case in Figure 8 illustrates a question with a relatively straightforward solution from the input images, where additional generated views are not more informative and can obscure critical evidence. SpatialASM does not mandate an external call and improves over the base model on both perception-oriented and viewpoint-transformation benchmarks.
Finally, SpatialASM is complementary to SpatialDreamer-style tool use. Table 2 shows that combining internalization and external ASM yields higher accuracy than either setting alone on the evaluated subtasks. Improving intrinsic reasoning and supplying external observations can therefore be pursued together.