- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper introduces Artemis-3D, a framework for latent spatial reasoning that enables MLLMs to construct internal geometric representations and reason directly in the latent space without explicit textual intermediate steps. It consists of two components: Mental Map Imaging (MMI), which uses geometric supervision to encode 3D scene structure into visual hidden states, forming an internal mental map, and Visual-Cue Latent Reasoning (VCLR), which autoregressively generates spatial latent tokens to retrieve question-relevant geometric evidence from this map. At each reasoning step, the predicted latent token retrieves the most similar geometric token, which is fed back to guide subsequent reasoning until a progress head signals completion and the model generates a textual answer. The framework requires no external geometry models at inference and is evaluated on VSI-Bench, MindCube-Tiny, and Real-3DQA under task-specific training settings.
Critical strengths
-
A compelling framework for latent spatial reasoning. The paper addresses the challenge of preserving scene geometry and leveraging it during intermediate reasoning. MMI incorporates geometric supervision into visual representations, while VCLR enables sequential reasoning over question-relevant spatial cues. Together, they provide a coherent framework without requiring external geometry models at inference.
-
Strong empirical results with supporting ablations. The 2B model achieves 72.5 on VSI-Bench. Same-backbone ablations show that MMI and VCLR each contribute to performance improvements, with their combination yielding a 4.5-point gain over the SFT baseline. The method also achieves competitive results on MindCube-Tiny and Real-3DQA under task-specific training settings.
Critical weaknesses
The paper tackles an important spatial reasoning challenge with a technically comprehensive framework and promising empirical results. However, several concerns remain:
-
The contribution of iterative cue retrieval remains unclear. Tables 3 and 4 show improvements from VCLR, but do not isolate whether the gains arise from iterative geometric cue retrieval and feedback rather than additional supervision or inference steps. A controlled comparison removing or perturbing retrieval while preserving latent reasoning steps would better validate the proposed mechanism.
-
Limited controlled comparisons with alternative approaches. Artemis-3D aims to internalize geometry without external 3D encoders, but existing comparisons differ in training data and input settings. Matched comparisons with encoder-based or textual reasoning baselines, including inference costs, would better establish the benefits and accuracy–efficiency trade-off of the proposed latent formulation.
Questions for authors
-
Visual-cue ordering and cross-frame consistency. How is the target visual-cue sequence ordered? When an object appears across multiple frames, are its tokens treated independently, and could cross-view feature variations affect retrieval stability?
-
Verification of reported results. The eight category scores in Table 3, row (0), average to approximately 64.6, rather than the reported 65.2. Figure 10’s caption also describes an object-counting failure, while the figure shows a viewpoint question. Some comparison settings could be further clarified to ensure fair evaluation. For example, in Table 1, GeoThinker’s 50.5 appears to correspond to the Qwen2.5-VL-7B, 8-frame setting in the cited paper.
2 comments
We are glad that our response has addressed your questions. We sincerely appreciate your thoughtful review and positive feedback.
Reply
Good work, and thanks for the response. I have no further questions.