- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
-
Combines VLM semantic features with MapAnything geometric features for multi-view spatial reasoning.
-
Introduces question-guided compressors between language-model layers to update compact scene-level and frame-level tokens.
-
Substantially reduces decoder KV-cache size while retaining much of the uncompressed model’s aggregate performance.
Critical strengths
-
Well-motivated architecture: Question-guided updates let compact tokens repeatedly access detailed visual evidence, supporting global and view-specific reasoning.
-
Informative evaluation: Multiple spatial benchmarks and compressed/uncompressed comparisons demonstrate the contribution of geometric features and expose practical trade-offs.
Critical weaknesses
-
Limited practical benefit: At 128 views, end-to-end time to first token improves by only 8%. Training peak memory increases from 31 to 70 GB, while important geometric tasks degrade substantially—for example, SPAR camera motion drops from 89.8 to 55.0.
-
Incomplete attribution of gains: A matched question-conditioned upfront compressor is missing, and the main ablations use an earlier architecture. Consequently, the benefits of interleaving and the final design remain insufficiently isolated.
Questions for authors
-
Is the upfront Perceiver baseline question-conditioned and matched in token budget and training settings?
-
Are final-model ablations available without language guidance and with token-budget-matched single-branch variants?
-
Are compressed 4B results available demonstrating accuracy, end-to-end latency, and peak memory?
-
Why does compression particularly hurt backward-facing questions when the uncompressed model uses the same training distribution?