- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper investigates how to improve global spatial reasoning by dynamically constructing and refining cognitive maps during reasoning. To address this problem, the authors propose RiCM, a closed-loop framework that enables reasoning-guided state expansion and verification. The authors further introduce PSST, a reinforcement learning method that encourages the model to construct sufficient spatial states with fewer interactions. Experiments on ReVSI and MMSI-Video-Bench demonstrate the effectiveness of the proposed method.
Critical strengths
- This paper focuses on an important research problem: how to construct and refine spatial memory during reasoning, rather than relying on pre-constructed static memories.
- The proposed framework is relatively complete. It integrates reasoning-guided state construction, IGGT prior, and reinforcement learning into a closed-loop spatial reasoning framework.
- The experiments are relatively comprehensive. The authors evaluate the proposed method on 2 benchmarks and conduct ablation studies to investigate the contributions of different components.
Critical weaknesses
- The written needs to be improved. Figure 1 cannot straightforwardly highlight the gap between local spatial awareness and global spatial reasoning. Figure 2 and 5 are also not clear and full of texts. Section 2 hindered the fluency of reading. The paper introduces too many technical terms and concepts, making it difficult to follow, such as reasoning-to-state feedback, state support, etc.
- The training process is not fully described. How to perform reject sampling? Does this paper performs cold-start training? If yes, how to construct the cold-start data?
- In Table 1 and 2, RiCM-8B performs sub-optimal in some subsets among non-proprietary methods. However, this paper does not fully analyze the reasons.
- The paper could add some related reference [1][2]. These papers also propose to actively perceiving environments and refine memory. The authors could discuss the difference with them.
- The related work section is placed in the appendix rather than the main text, hence the main text lacks a key section. The authors should also provide a more comprehensive discussion of the core difference in related work to better highlight the novelty of the proposed method.
[1] Thinking in 360: Humanoid visual search in the wild, CVPR 2026. [2] Active Exploring like a Pigeon: Reinforcing Spatial Reasoning via Agentic Vision-Language Models, ICML 2026.
Questions for authors
Please see weakness.
2 comments
Response to Reviewer oPNP (2/2)
Q3. Why does RiCM-8B trail other models on some subtasks?
We address two aspects of this question:
- Which capabilities is RiCM designed to improve?
- How does that scope relate to the results in Tables 1 and 2?
1. Design objective — Global spatial reasoning
current models can exhibit local spatial awareness yet struggle to form coherent global spatial representations.
Section 1 observes that current models “can exhibit local spatial awareness yet struggle to form coherent global spatial representations.” We therefore set an explicit objective: “We therefore focus on improving the global spatial reasoning capabilities of MLLMs.” RiCM uses a cognitive map to associate objects across views and verify spatial relations. It introduces no component or training objective specifically for local perception, so we would not expect it to consistently surpass leading open or proprietary models on local estimation tasks.
2. Subtask results — Where cognitive mapping helps
Table 1 shows the clearest gains over our 8B backbone on relative direction (39.5 to 73.5) and route planning (40.5 to 64.2), both of which require integrating spatial relations across views. Absolute distance (52.3 to 49.3) and object size (69.0 to 64.1) decline, underscoring the limits of the approach on metric estimation. Table 2 also shows variation within relational reasoning: RiCM improves instance–instance reasoning from 25.0 to 37.1, while GeoThinker-8B reaches 40.2. Our claim is thus specific to improved cross-view reasoning, with the largest gains on direction and planning.
Q4. Why the two methods cannot be evaluated directly on VSI-Bench or ReVSI?
Both methods study active perception for spatial reasoning, and we have added them to Related Work. Neither can be evaluated directly on VSI-Bench or ReVSI in its published form.
1. Thinking in 360° — Interactive panoramic search
The method selects head rotations, observes the resulting views in a 360° panorama, and returns a direction pointing toward an object or a path. [1] VSI-Bench and ReVSI provide prerecorded videos and score answers to spatial questions. Running this method would therefore require adapting both how it obtains observations and how it produces answers.
2. Active Exploring like a Pigeon — View retrieval with supplied spatial relations
The method uses textual descriptions of the transformations between viewpoints to select which view to retrieve. Neither VSI-Bench nor ReVSI supplies these descriptions. [2] Applying the method would therefore require estimating the transformations from the video or modifying the retrieval policy to operate without them.
Q5. Placement of Related Work and clarification of novelty.
The nine-page limit on the initial submission led us to place Related Work in Appendix A. With the additional page available during rebuttal, we will move Related Work into the main text and explicitly distinguish RiCM from the closest prior methods, including the two studies highlighted by the reviewer.
Section 2 (Motivation) already develops the rationale for RiCM through two controlled studies. The first examines how much task-relevant information a predefined object inventory supplies. The second compares independent map construction with reasoning-guided revision of uncertain estimates. Together, these studies motivate RiCM’s central contribution: during reasoning, the model determines both what is missing from the map and which existing estimates require verification.
References
[1] Heyang Yu et al. “Thinking in 360°: Humanoid Visual Search in the Wild.” CVPR, 2026, pp. 22445–22455. CVF Proceedings
[2] Wei Deng, Xianlin Zhang, and Mengshi Qi. “Active Exploring like a Pigeon: Reinforcing Spatial Reasoning via Agentic Vision-Language Models.” ICML, 2026, pp. 24407–24417. PMLR Proceedings
Final Acknowledgment
Thank you again for the time and care you put into reviewing our work. Your questions prompted us to revisit our results and explain our reasoning more clearly, and we appreciate how closely you read the paper. We hope our responses have addressed your concerns, and we wish you all the best in your research and future academic endeavors.
Response to Reviewer oPNP (1/2)
Initial Acknowledgment
We are grateful to the reviewer for the valuable and encouraging feedback. The insightful suggestions and comments helped us identify areas for clarification and further improvement. In the following, we address each of the reviewer's concerns point by point.
Q1. Clarity of the figures, motivation, and terminology.
We address three aspects of the reviewer’s comment:
1. Figure 1 — Making the human–model gap visible
Red and blue task labels distinguish global spatial reasoning from local spatial perception. The purple bars provide a common human reference across both groups, allowing readers to see where the gap widens. We will add a red outline to these bars to make the comparison easier to see.
2. Figures 2 and 5 — Explaining failures and component roles
The labels serve different purposes. Figure 2 identifies where each mapping failure arises. Figure 5 shows what each component contributes and how its output guides the next step. Appendices F and G connect these labels to specific prompt instructions and steps in worked examples.
3. Section 2 — Motivating the method before introducing it
We present the two controlled comparisons before the method to explain why RiCM needs both map expansion and targeted revision. Consistent terminology lets readers trace each problem to its corresponding mechanism in Section 3. We have added explicit pointers to Appendices B, F, and G, which ground these terms in object inventories, prompt instructions, and worked examples, respectively.
Q2. Rejection sampling and cold-start training
We address two questions:
1. Rejection sampling — Selecting questions with answer disagreement
For each candidate question, we sampled 16 reasoning trajectories from Qwen3-VL-8B-Instruct with the cognitive-map tool disabled. We discarded the question if all 16 final answers agreed and retained it otherwise. This yielded 80K training examples for PSST.
2. Cold-start training — Learning from state sufficiency
We applied PSST directly to Qwen3-VL-8B-Instruct without task-specific cold-start training. RiCM allows the policy to make an incorrect intermediate estimate, seek further evidence, and revise it. The ground-truth answer does not specify which error the policy will make or which observation will resolve it, so it cannot supply a ground-truth correction trajectory.
The absence of a ground-truth correction trajectory is precisely why we introduced PSST. Different policies may make and recover from different intermediate errors, yet their maps can be evaluated by the same criterion: does the map already contain enough information to answer the question? PSST turns this criterion into a training signal by asking a frozen reader to answer from the question and map alone at a sampled checkpoint and at the end of the trajectory. This lets the policy learn when to expand, verify, or stop without requiring a prescribed sequence of reasoning steps.