- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates 3D spatial reasoning for single-image VLMs and proposes GeoLatent. It uses CR-GEO to separate shared geometry from residual geometry, and applies routed optimization via joint–bottleneck–recovery to encourage the use of disentangled spatial latents. Experiments report an increased effective rank of GEO representations, strong latent dependency in the bottleneck stage, and 73.0% / 72.1% performance on SPAR-Bench and SPBench.
Critical strengths
-
The diagnosis of GEO collapse is solid. Proposition 1 in Section 3.2 clearly analyzes why the original coverage loss fails to penalize collapsed configurations. More importantly, under bit-identical initialization and identical batch order, Table 2 and Fig. 3 only swap the GEO objective and raise from 1.00 to 3.87. This structural difference is also reproducible on a second backbone, making CR-GEO more than an empirical tweak.
-
The mechanism validation goes far beyond benchmark accuracy alone. The authors conduct route intervention, blank/mismatched-image tests, no-GEO controls, training overlap audits and cross-backbone reproduction. Tables 15–16 clearly distinguish enforced bottleneck dependency from post-recovery behavior. This restrained discussion of mechanisms improves overall credibility.
Critical weaknesses
-
CR-GEO produces more diverse GEO features, but there is no proof these features genuinely help the final task. While the representation metrics change drastically, task accuracy gains are tiny, and most performance comes from POS/DIR. Current results only show GEO features become less redundant, and cannot confirm this diversity benefits spatial reasoning. The authors should run intervention experiments on existing checkpoints: keep images, POS/DIR and text fixed, only block or shuffle GEO readout and measure metric changes across sub-tasks. Run the same test for CR-GEO and the original L_cov baseline. If multiple random seeds are available, report mean and standard deviation for these small gains.
-
The routed optimization only proves latent features are forced to be used in the training bottleneck and this latent path remains usable after training. It does not prove the model actually uses this path during normal full-attention inference. This idea draws inspiration from CVPR 2026 LIVR, so routed optimization is more an extension for geometry-supervised latent variables rather than a brand-new paradigm. The authors should test under standard full-attention decoding, keep direct image access enabled, and only block or shuffle latent K/V to measure performance drops against the control group. If performance barely drops, the claims should be limited: latent usage is enforced in training and the path stays available afterward, instead of claiming continuous latent-mediated reasoning at inference time.
Questions for authors
1.Do you have task-grouped GEO-only block or shuffle results for the recovered GeoLatent checkpoint? Specifically on SPAR Dep/Dis/View and ViewSpatial Camera, does CR-GEO’s GEO states yield measurable causal contributions compared with the original ?
2.Beyond the 128 direction questions in Table 16, do you have results for blocking latent readout under normal full-attention inference across all three full benchmarks? Is the 0.78-point drop after recovery representative?
3.For the matched CR-GEO vs and bottleneck vs direct-recovery comparisons, do you have additional random seeds or training logs to verify whether these controlled gains of roughly 0.5–1.6 points are stable?
4.Given that this work explicitly builds upon LIVR’s visual bottlenecking (published at CVPR 2026), how do the authors define the substantive new additions of routed optimization relative to LIVR: the initial joint stage, typed/decomposed latent routing, ongoing geometry supervision, or a combination of all three?