- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes WaLKPruner, a training-free and question-independent visual token pruning method for spatial understanding. It first selects representative tokens using a feature-based coverage objective, then incorporates ordered camera motion estimated by the backbone’s VGGT geometry encoder. A constrained replacement procedure introduces trajectory-guided candidates while maintaining a fixed token budget and limiting changes to the initial scene representation. Experiments on VSI-Bench, ScanQA, and SQA3D use a Spatial-MLLM 3B backbone.
Critical strengths
- A practical and reasonably motivated design. Preserving complementary observations during spatial token pruning is a relevant problem. The method requires no additional training and reuses camera poses already available in the backbone. Its conservative replacement constraints provide a reasonable mechanism for incorporating trajectory information without substantially disrupting the initial selection.
- Promising results on the evaluated backbone. The VSI-Bench results show effective compression: retaining 25% of visual tokens achieves 50.25 compared with the reported unpruned score of 50.39. The improvements over Geo3DPruner increase under stronger compression. The ablations also provide initial evidence that scene and viewpoint information are complementary.
Critical weaknesses
- The incremental contribution over closely related work is insufficiently established. Representative coverage is already central to MMTok, while CoverPrune explicitly combines feature, spatial, and temporal information for 3D token compression. Motion-aware pruning has also been explored in EgoPrune. These methods do not make the proposed ordered-trajectory formulation redundant, but they substantially narrow its novelty. The paper needs clearer positioning and stronger evidence that its specific trajectory mechanism provides meaningful benefits beyond existing coverage strategies and simple view-balanced alternatives.
- The generality and reliability of the trajectory-guided gains remain unclear. All experiments use a single Spatial-MLLM 3B backbone and concentrate on indoor scanning benchmarks. This does not establish whether the benefits persist with stronger models or different geometric representations. Moreover, estimated camera motion directly influences token replacement, yet the paper provides no targeted evaluation of sensitivity to pose errors or failure cases. The scene-coverage constraint does not directly guarantee preservation of task-critical evidence. These omissions leave uncertainty about the method’s applicability beyond the evaluated setting.
[1] MMTok: Multimodal Coverage Maximization for Efficient Inference of VLMs
[2] CoverPrune: Coverage-Driven Token Pruning for 3D VLMs via Optimal Transport
[3] EgoPrune: Efficient Token Pruning for Egomotion Video Reasoning in Embodied Agent
Questions for authors
Can the authors clarify the distinction from CoverPrune, MMTok, and motion-aware pruning methods? In particular, how much does ordered camera motion improve over scene-only selection with equal per-view budgets or a simple temporal-coverage constraint?
Do the gains persist on a second, preferably larger, spatial-understanding backbone? Such evidence would help distinguish a generally useful selection principle from sensitivity specific to the current 3B model.
How sensitive is the selector to inaccurate camera poses? An informative test would keep the fused visual tokens fixed while perturbing only the poses supplied to the selector, comparing the resulting degradation with scene-only and view-balanced selection.
How were the baselines adapted to Spatial-MLLM?