- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes CAMCUE, a framework for perspective-taking spatial reasoning with MLLMs. CAMCUE injects camera-pose information from the contextual views into visual representations and trains the MLLM to jointly answer a given question and predict the camera pose corresponding to the language-specified target viewpoint. At inference time, the predicted target pose is used to synthesize an imagined target-view image, which is then provided to the MLLM as additional visual evidence for final answer prediction. Experimental results show that CAMCUE outperforms the corresponding MLLM backbones, a world-model-based test-time scaling method (MindJourney), and pose-free target-view generation baselines.
Critical strengths
The idea of explicitly grounding a language-specified target viewpoint into a camera pose and conditioning novel-view synthesis on that pose is intuitively well motivated. In Tables 2 and 4, CAMCUE outperforms direct MLLM inference, a search-based world-model approach, and methods that directly synthesize the target-view image from language and reference images without explicit target-pose grounding. These results support the effectiveness of explicit viewpoint grounding and pose-conditioned image synthesis for multi-image perspective-taking QA, and I consider this a meaningful contribution to this area.
Critical weaknesses
- Limited validation under unavailable or noisy camera parameters: The main CAMCUE inference pipeline assumes access to the camera intrinsics and extrinsics of the contextual images. This assumption is reasonable in robotic or scanning environments where camera calibration and localization are available, but may not hold for generic collections of images. Moreover, in practical settings, these camera parameters may need to be estimated and can therefore contain non-negligible errors. The paper neither evaluates CAMCUE using estimated camera parameters nor analyzes its robustness to perturbations in these parameters. As a result, the range of real-world settings in which the method can be reliably applied remains somewhat unclear.
- The necessity of joint multi-task training and the source of the performance gain are not fully disentangled: The central question suggested by the Introduction is whether multi-image perspective-taking QA can be improved by explicitly mapping a language-specified viewpoint to a camera pose and using a pose-conditioned novel view for reasoning. However, it is less clear why answer generation and target-pose prediction need to be jointly trained within the same MLLM. Figure 4 shows that the improvement without the imagined view is relatively modest, whereas a much larger gain appears once the synthesized target view is provided. This leaves open the possibility that a simpler pipeline, where training a target-pose predictor, synthesizing an image from the predicted pose, and providing that image to an otherwise unchanged MLLM, could achieve a similar benefit. At the same time, the current experiments are insufficient to conclude that such a simpler pipeline would be equally effective. I would therefore consider that the experimental evidence in the Experimental section or the strong motivation in the Introduction section, that support the necessity of multi-task training.
Questions for authors
Note that the following points are not primary factors in my rating, but I believe addressing them would improve the clarity and positioning of the paper.
-
[Clarification] Consistency between the Pose Fusion diagram in Fig. 2 and Eq. 3: Eq. 3 indicates that the image and camera features are concatenated, passed through an MLP/projection, and then added to the original image features through a residual connection. However, in the enlarged Pose Fusion diagram in Fig. 2, the output of the Fusion MLP appears to be routed back toward the input side, and the distinction between concatenation and addition is visually unclear. Is the intended computation exactly the one described in Eq. 3? I suggest clarifying the connections and operators in the figure.
-
[Suggestion] Positioning with respect to recent related work: I encourage the authors to expand the discussion in the Introduction and Related Work regarding recent (i.e., 2026) work on cross-view/multi-view spatial reasoning and spatial reasoning using intermediate generated images or test-time visual imagination. For example, relevant recent work includes, but is not limited to: [1,2,3]
[1] Yang et al., How and What to Imagine? Visual Thinking in Unified Multimodal Models for Cross-View Spatial Reasoning, EMNLP2026.
[2] Oi et al., From Correspondence to Actions: Human-Like Multi-Image Spatial Reasoning in Multi-modal Large Language Models, ICML2026.
[3] Yu et al., When and How Much to Imagine: Adaptive Test-Time Scaling with World Models for Visual Spatial Reasoning, arXiv2026.