- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper investigates whether geometry-supervised 3D latent tokens effectively contribute to spatial reasoning. Through inference-time interventions and representation analyses, it finds that 3DThinker[1] exhibits weak dependence on latent tokens, limited scene-specific latent diversity, and an image-dominant shortcut in geometric alignment. To address these issues, the authors propose CALD-3D, which combines contrastive geometric alignment using cross-scene latent negatives with intra-latent diversity regularization to encourage more informative and distinct geometric representations. CALD-3D improves over 3DThinker on MindCube-Tiny (62.7% to 66.9%) and VSI-Bench (42.8% to 44.4%), with a notable 14-point gain on Rotation. Further ablations and latent interventions suggest stronger reliance on the latent pathway and reduced representation collapse.
[1] Chen et al. “Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views.”
Critical strengths
-
A clear diagnosis of latent underutilization. Beyond showing that removing latent tokens has little effect on predictions, the paper separately perturbs image and latent inputs to the geometric projector, revealing an image-dominant shortcut in geometric alignment. This identifies a concrete limitation of 3DThinker [1] and provides a clear motivation for the proposed method.
-
A targeted method with substantial Rotation improvements. CALD-3D contrasts matched and mismatched latents while keeping image features fixed, directly addressing the identified shortcut. It improves Rotation accuracy on MindCube-Tiny from 44.0% to 58.0%, with ablations and latent interventions further supporting the effectiveness of the proposed objectives.
[1] Chen et al. “Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views.”
Critical weaknesses
-
The proposed mechanism is not fully verified. The paper shows that CALD-3D becomes more sensitive to latent interventions, but this does not establish that the latents encode scene geometry rather than other scene-specific cues. The image-versus-latent projector analysis is performed on 3DThinker, not repeated after CALD-3D training. Repeating that analysis, alongside a direct test of geometric content, would better support the central claim.
-
The robustness and scope of the gains need clearer evidence. The MindCube-Tiny improvement is driven largely by Rotation (+14.0 points), while the VSI-Bench gain is modest (+1.6 points). Results from repeated training runs and CALD-3D latent interventions on VSI-Bench would help establish how consistently the findings extend beyond Rotation.
Questions for authors
-
Does VGGT-based supervision encourage the latents to capture meaningful spatial structure, or primarily make them more distinguishable across scenes? A direct evaluation of their geometric content would help clarify this distinction.
-
Is the 61.9% result in Table 4, obtained without the proposed losses, a reimplementation of 3DThinker under the same training data and settings as CALD-3D? How does it relate to the 62.7% result from the released 3DThinker checkpoint in Table 2?
-
Are CALD-3D’s improvements consistent across training runs, and do latent interventions yield similar effects on VSI-Bench? Does the image-dominant shortcut identified in 3DThinker also occur in other geometry-supervised latent reasoning models?
Addressing these concerns would strengthen the paper and could raise my overall rating.