Spatial intelligence, the capacity to represent and reason about physical space, underlies embodied perception and real-world visual understanding. Existing benchmarks probe it through spatial relations, perspective-taking, and mental modeling. What remains underexamined is whether a model can maintain a coherent scene representation across views, since pairwise comparison alone cannot reveal which view departs from the truth. We thus introduce Same Space or Not (SSoN), a benchmark of cross-view contradiction resolution comprising 1,000 questions from seven indoor scene sources and six categories of controlled 3D edits. Each question presents three views of an unchanged scene and one view of an edited variant. Models must identify the inconsistent view and explain the contradiction without a designated trusted reference or a marked target. Our construction process iteratively translates human review into generation constraints. Automated checks and exhaustive human validation screen out both trivial visual shortcuts and questions lacking sufficient evidence for a unique answer. Humans achieve 83.3% accuracy, compared with 39.7% for the strongest vision-language models (VLMs), which further drops to 34.9% when requiring valid visual explanation for the correct selection. We investigate prompting, camera information, and 3D reconstruction as routes for improvement. On a 100-question intervention set with a 24% baseline, prompting and 3D reconstruction remain below 50% answer accuracy, except when ground-truth camera information is supplied, which reaches 61% answer accuracy but only 48% True solve accuracy. On a held-out 201-question test set, Qwen2.5-VL-7B achieves 21.89% accuracy, 33.33% after answer-only fine-tuning, and 41.79% after fine-tuning with both rationale and answer supervision. These results identify cross-view contradiction resolution as a substantial weakness of current VLMs that can be partly addressed by targeted supervision. The 1,000 questions and fine-tuned checkpoints will be made public.
We sincerely thank you for your careful reading of our paper and for your encouraging assessment. Both points you raise are fair and inspiring, and we fully agree with them. During the rebuttal period we followed up on both.
1. Outdoor scenes
Prompted by your question, we built ten outdoor pilot items from TDW and Poly Haven assets, each set in a bounded space, and evaluated them under the protocol and prompt of the main benchmark. On these items, human accuracy is 7 of 10. The best-performing model, GPT-6 Astra Pro, answers 2 of 10 correctly, with a valid explanation for both. This follows the same pattern as the 1,000-item results, where humans reach 83.3% and the same model 39.7%. Although at pilot scale, the result indicates that the task carries over to outdoor scenes.
The main challenge is preserving a unique answer. Indoors, the walls, corners and doorways of a room tie all four views to one enclosed space (the room-reference requirement, Section 3.1 and Appendix A.4). Outdoors this shared reference is no longer given. In an open or repetitive scene, a view that disagrees with the others may simply show another location, so the contradiction can no longer be attributed to a single view. The bounded spaces of our pilot restore this reference. Real outdoor scenes add one more consideration, because they are never static. Light and shadow shift naturally, and foliage or water may move between shots, all of which we define as acceptable noise (Appendix B.9). With that definition in place, the benchmark can extend to real outdoor scenes as well.
2. Other sensor data
You are right that sensor data beyond visual input could assist with the task. The one input of this kind in our experiments is the ground-truth camera intrinsics and extrinsics of the four views (the Cam condition, Section 4.3). These parameters tell the model how the cameras are positioned and oriented relative to one another, geometric information that it would otherwise have to infer from the pixels and that a physical device would obtain from its calibration and pose tracking. The outcome supports your view, as Cam brings the largest overall improvement among all the interventions in Table 4. For convenience, the table is reproduced below.
Each cell gives answer accuracy and True solve in percent (Acc / TS). Thank you so much for your suggestion, which led us to analyze these results further. Overall, Cam helps more than any other intervention we tested.
The ten outdoor items are available at https://huggingface.co/datasets/AnonymousAnonymousAccount/Anonymous as SSoN_Outdoor_Pilot_Data.zip. In the revised paper, we will add them to the appendix. We are deeply grateful for your time and for your meaningful contributions to SSoN.