- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces a training-free visual token pruning method to speed up World Action Models (WAMs). It has three main ideas: (1) Future-Prediction Queries, which help identify visual tokens useful for predicting future states; (2) Future-Aware Attention Masking, which keeps the added queries from interfering with the original action generation; and (3) Action-Future Token Selection, which combines action-related and future-related importance scores to select the most useful visual tokens. The method is tested on UniVLA and RynnVLA-002 across LIBERO, SimplerEnv-WidowX, and three real-world robot tasks, achieving up to 1.63× speedup in simulation and 1.67× on real robots.
Critical strengths
-
The authors cleverly exploit the intrinsic characteristics of the WAM architecture, using the future-state prediction capability that the WAM has acquired during training to perform visual token pruning.
-
The authors design a structured attention mask that ensures the consistency of the action branch's forward propagation, thereby keeping the original action branch unaffected by the newly added queries. This allows the method to be integrated into existing WAMs as a training-free plugin.
Critical weaknesses
-
The reported gains over VLA-Pruner are 0.5–1.1 pp across all benchmarks, which is within run-to-run evaluation noise, and no seeds or variance are reported. Without significance evidence, the claimed advantage over the strongest baseline remains unconvincing.
-
As a training-free method, its deployment hinges on hyperparameters. The paper only studies sensitivity to the pruning layer (Table 7); sensitivity to the pruning ratio and other key settings is not reported, although the per-suite tuned ratios in A.3 suggest the results depend on them.
Questions for authors
- Could the authors report 3-seed LIBERO results on at least one backbone to show whether the 0.5–1.1 pp margins over VLA-Pruner are statistically meaningful?
- As only the pruning layer is currently studied, could the authors add sensitivity analysis on the pruning ratio, future queries, and trigger-free settings on at least one benchmark?
I will consider raising my score if my questions are answered satisfactorily.
Thank you for the additional experiments. The LIBERO comparison at comparable success rates and the OpenWAM-α results address my main concerns about inference efficiency and applicability beyond shared-backbone models. The gain on SimplerEnv remains modest. Based on the new evidence, I am raising my rating from 2 to 3.