- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes SpatialAnything for spatial reasoning, grounding, egocentric interaction, and navigation. First, it organizes coordinate prediction around complete visual grounding primitives rather than individual coordinate tokens. Primitive Bidirectional Attention (PBA) permits interaction among masked coordinate positions within each primitive, using attention-mask changes in full-attention layers and query rewriting with write compensation in gated linear-attention layers. Adaptive parallel decoding predicts the coordinates together and causally replays the selected values into the context before continuing generation. Second, a two-stage Spatial Multi-Teacher On-Policy Distillation procedure integrates task-specific teachers on student-generated responses.
Critical strengths
I think this paper showing the below strengths:
-
A technically motivated extension of structured prediction to hybrid attention. PBA addresses a concrete limitation of mask-only primitive decoding: gated linear-attention layers do not expose an attention matrix whose visibility can simply be modified. Table 4(a), where all variants share masked inputs and parallel decoding, reports the strongest localization performance when both attention types are modified. This makes the hybrid-attention treatment a substantive contribution beyond simply grouping coordinate tokens.
-
Broad evaluation with evidence that grounding warm-up helps multi-task distillation. The paper evaluates coordinate grounding, spatial question answering, egocentric interaction, and navigation at three model scales. Table 4(b) is particularly informative: ordinary MOPD improves CV-Bench and MindCube over SFT but reduces RefCOCOg from 81.3 to 76.6, whereas Spatial MOPD reaches 88.3, 96.2, and 91.6 on the three respective benchmarks. This suggests that maintaining shared grounding competence is consequential when integrating task-specific expertise.
Critical weaknesses
This paper show the below weaknesses:
-
Many benchmarks in Section 4 and training datasets in Appendix B are listed without direct citations to their original sources. This makes their provenance and evaluation protocols difficult to verify.
-
LocateAnything already predicts boxes and points in parallel. The paper should distinguish this existing idea from its new contributions, particularly the extension to gated linear attention. Plus, despite emphasizing box/point localization and decoding speed, the paper does not compare with this closely related model on overlapping tasks. The benefit over existing parallel grounding methods therefore remains unclear.
-
Appendix B describes the overall SFT corpus, but the datasets, splits, and sampling ratios for teacher training and the two distillation stages are not clearly reported. Several training and evaluation subsections are also incomplete.
-
SA-4B scores 42.8 on ScanRefer in Table 1, whereas Full PBA without posttraining scores 52.1 in Table 4(a). MindCube is 90.6 in Table 2 versus 91.6 in Table 4(b). The paper does not explain whether these results use different checkpoints or protocols.
Questions for authors
Please see the weakness.