- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This work presents a spatial intelligence benchmark named MindTraverse. MindTraverse focuses on addressing the limitation of existing benchmarks that overlook the problem of cross-scale spatial composition. MindTraverse consists of approximately 6K questions spanning 35 composition templates and 210 simulator scenes. Experiments with both proprietary models and open-source models on the MindTraverse benchmark show the limitation of existing models for solving the problem of cross-scale spatial composition. In addition, the authors present in-depth analyses of counterintuitive experimental observations.
Critical strengths
- This paper is well-written and well-organized.
- Table 2 reports comprehensive experiments with both proprietary models and open-source models.
Critical weaknesses
-
The contribution of the proposed benchmark is limited. The formalized task of cross-scale spatial composition essentially involves alternating between local spatial reasoning and global transit reasoning, which has been implicitly covered by existing benchmarks. In addition, combining multiple spatial subtasks into a comprehensive spatial task has been studied in existing benchmarks.
-
The proposed benchmark has only approximately 6K questions, which is relatively small-scale compared with some latest spatial intelligence benchmarks.
-
The key differences between the proposed benchmark and other recent benchmarks, such as [1,2,3], are not clearly discussed.
[1] ESI-BENCH: Towards Embodied Spatial Intelligence that Closes the Perception-Action Loop. Hong et al. 2026.
[2] How Far are VLMs from Visual Spatial Intelligence? A Benchmark-Driven Perspective. Yu et al. 2025.
[3] Spatial4D-Bench: A Versatile 4D Spatial Intelligence Benchmark. Wang et al. 2026.
Questions for authors
- For cross-scale spatial composition, the proposed benchmark primarily covers W, T, W-T, T-W, W-T-W, and T-W-T. Why are longer and more complex sequences not included in the proposed benchmark?
- Does the proposed benchmark only focus on static scenarios? Why is cross-scale 4D spatial reasoning not considered in the proposed benchmark?
11 comments
W1
Thank you for pointing out that existing compositional tasks need to be compared more explicitly. We have already addressed this comparison in Related Work: MMSI-Bench [5] includes Multi-Step Reasoning tasks that chain spatial judgments, and SpaCE-10 combines ten atomic capabilities into eight QA types.
MindTraverse differs by explicitly binding typed intermediate results as conditions for the next-scale operation. For example, a direction from the source workspace determines the subsequent entrance, and the transit destination then determines the terminal workspace. The generation program records these dependencies, and supplied-state and paired interventions examine whether models use them.
MindTraverse also supports recursive composition and can generate questions with sequences of arbitrary length, a capability not provided by the above benchmarks.
W2
Thank you for your concern about data scale and coverage. MindTraverse contains 6,167 evaluation questions covering 210 scene instances, 35 templates, and six scale sequences. Among fixed multi-view spatial evaluations, MMSI-Bench contains 1,000 questions and SpaCE-10 [6] contains 5k+. Our question count is therefore comparable to these related benchmarks, and we believe the current scale is sufficient to diagnose cross-scale spatial composition.
The current scale also leaves room for expansion. The 210 scene instances come from 185 distinct source houses within the 10,000-house ProcTHOR-10K training set. Through additional compatible scenes, entity combinations, and initial states, recursive composition and scene grounding can automatically generate further questions that satisfy the validation requirements. Our generation method is therefore scalable and, if necessary, can produce far more than 6,167 questions.
W3
Thank you for recommending these three related works. We have cited them in Related Work and explained their evaluation focus and relationship to this work. We have also added comparisons with these papers to the main text:
| Work | Input format | Main evaluation focus |
|---|---|---|
| ESI-Bench [1] | Interactive RGB observations | Evaluating the perception–action loop through active observation and environmental interaction |
| SI-Bench [2] | Single images, multiple images, and videos | General spatial capabilities, including perception, understanding, and planning |
| Spatial4D-Bench [3] | Video | Spatial understanding and reasoning involving temporal changes |
| MindTraverse (Ours) | Multiple images | Explicit cross-scale result dependencies in multi-view inputs |
MindTraverse focuses on explicit cross-scale result dependencies in fixed multi-view inputs and uses controlled interventions to examine whether models use those dependencies.
[1] ESI-BENCH: Towards Embodied Spatial Intelligence that Closes the Perception-Action Loop. Hong et al. 2026.
[2] How Far are VLMs from Visual Spatial Intelligence? A Benchmark-Driven Perspective. Yu et al. 2025.
[3] Spatial4D-Bench: A Versatile 4D Spatial Intelligence Benchmark. Wang et al. 2026.
[4] Spatial Mental Modeling from Limited Views. Wang et al. 2026
[5] Mmsi-bench: A benchmark for multi-image spatial intelligence. Yang et al. 2026
[6] SpaCE-10: A Comprehensive Benchmark for Multimodal Large Language Models in Compositional Spatial Intelligence. Gong et al. 2025
Thanks for the responses.
First, using intermediate results as the conditions for subsequent reasoning is not a NEW idea. It remains unclear how the proposed composition FUNDAMENTALLY differs from existing works.
Second, given that MindTraverse is comparable in scale to existing benchmarks and similar tasks could potentially be constructed using existing benchmarks or simulators, what justifies introducing MindTraverse as a new benchmark? What unique value and impact would it bring to the community?
Q1
Thank you for suggesting that we explain the choice of sequence lengths. We agree that we should clarify the reasons for the current sequence setting. The six sequences include two atomic tasks, the two cross-scale transition directions (WT and TW), and three-stage tasks that return to the original scale (WTW and TWT). They allow us to examine cross-scale handoffs and subsequent state use separately and associate errors with specific stages. We do not use longer sequences for the following reasons:
(1) Questions with longer sequences can be viewed as compositions of the current six sequences. The current six sequences already cover all possible input conditions and evaluation forms for W and T atomic questions; longer sequences further compose these existing questions.
(2) Longer sequences do not introduce additional diagnostic evidence. In finite indoor layouts, simply extending a chain can introduce repeated entry into and exit from the same room without additional information. We prioritize explicit information dependencies at every transition, facilitating diagnosis of cross-scale spatial reasoning.
(3) The current benchmark already fully exposes models’ bottlenecks in cross-scale spatial reasoning. Many models perform near chance on three-stage questions. Further increasing difficulty by extending the reasoning sequence would not better reveal their current bottlenecks in cross-scale spatial composition.
(4) The choice of current sequence formats is not a technical limitation. Our benchmark can generate questions of arbitrary length. Through recursive composition and scene grounding, we can generate sequences and questions of arbitrary length; the current formats therefore do not reflect a technical limitation.
Q2
Thank you for suggesting that we clarify the relationship to 4D spatial reasoning. We agree that your concern about possible 4D spatial reasoning is reasonable. Accordingly, we have added a comparison with 4D spatial reasoning to Related Work in the main text.
Our benchmark belongs to the research direction of multi-view spatial intelligence, represented by works such as MindCube [4] and MMSI-Bench [5]. This direction primarily examines whether models can connect viewpoints through shared entities and spatial cues. 4D spatial intelligence instead uses RGB video as input and examines spatial intelligence under temporal evolution.
We choose static multi-view images for the following main reasons:
We want to focus on spatial relations and reference-frame linkage.
Cross-scale spatial reasoning examines whether models can link small-scale and large-scale reference frames and flexibly switch between them. Multi-view spatial intelligence closely matches this central question and offers a setting with fewer additional factors. If cross-scale evaluation were built on 4D spatial intelligence, models would also need to handle temporal order, object changes, and related factors, which would interfere with diagnosing cross-scale spatial modeling.
In our concrete task rules, all long-chain tasks require room transitions. We do not provide complete observation sequences for every room; instead, we examine whether models can build an overall spatial model from sparse views through shared entities. Video provides more complete observations of entities, reducing the demand on this ability while potentially introducing additional factors.
Multi-view inputs make reference-frame specification explicit.
Our benchmark defines the reference frame either by facing a specified anchor object or by using an explicitly numbered input image. Providing selected views directly allows us to control the available observations and include the exact image referenced by a question, avoiding the risk of losing that view during video-frame sampling.
Nevertheless, 4D spatial intelligence remains an important direction, as you pointed out. We have therefore added a comparison with 4D spatial reasoning to Related Work.