- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes DepthPruner, a training-free and plug-and-play visual token pruning method designed to improve the inference efficiency of VLA models. The authors identify a key limitation of existing attention-based pruning methods: visual tokens with high attention scores are not necessarily task-relevant, and redundant background tokens may occupy the limited token budget, causing important visual information to be discarded.
To address this issue, DepthPruner incorporates depth-based geometric information into existing attention-based pruning frameworks. Specifically, the method first expands the candidate token set generated by a base pruner and then employs three complementary geometric cues—mean depth, residual variance, and neighborhood contrast—to refine token selection while maintaining the original token budget. This approach requires neither additional training nor modifications to the underlying VLA architecture.
The authors evaluate DepthPruner using OpenVLA-OFT across four LIBERO benchmark suites, integrating it with three existing pruning methods: FastV, SparseVLM, and ADP. Experimental results demonstrate consistent improvements in average task success rates across all three pruning methods and all evaluated token retention ratios (50%, 25%, and 12.5%). Notably, DepthPruner improves FastV's success rate on LIBERO-Object by 9.0 percentage points at 25% token retention, while introducing minimal additional inference latency.
Critical strengths
The paper leverages depth information to complement attention-based token pruning, helping identify redundant visual tokens through geometric cues. Since depth information is readily available in many robotic environments, this provides a practical approach to improving token selection in VLA models.
Critical weaknesses
-
The experiments are limited to simulated LIBERO benchmarks, with no real-world robotic evaluation. Moreover, the qualitative visualizations are insufficient to demonstrate how depth guidance improves token selection across different scenarios. This limits the evidence for the method's practical effectiveness and generalizability.
-
The introduction argues that attention-based pruning retains redundant background tokens at the expense of task-relevant information. However, the experiments do not sufficiently investigate or quantify this issue, nor do they convincingly demonstrate that DepthPruner resolves it. This disconnect between the motivation and experimental validation weakens the paper's central claim.
Questions for authors
- The experiments are limited to LIBERO simulations. Can the authors provide additional evidence demonstrating that DepthPruner remains effective in robotwin2.0 or other simulation benchmark and real-world robotic settings, particularly when depth observations contain noise or estimation errors?
- The paper argues that attention-based pruning over-retains redundant background tokens, but the current visualizations and quantitative analyses provide limited evidence supporting this claim. Can the authors provide more extensive visualizations and quantitative comparisons showing whether DepthPruner actually removes redundant background tokens and preserves more task-relevant information?