- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies a simple training-free VLA pruning rule that keeps the visual patches most similar to the language instruction, and analyzes what this score actually measures. It finds that on most backbones the instruction contributes little: the score mainly reflects how atypical a patch is within the current frame, so the rule acts as a redundancy filter rather than instruction-guided selection. A language-free rule selects mostly the same patches, and swapping the instruction changes success by only about 3 points. At a 25% keep ratio, the method reaches 96.2% on OpenVLA-OFT (LIBERO) versus 97.2% unpruned with a 1.68× speedup (VLA-Pruner: 96.5%), reaches 79.1% on CogACT (vs. 79.7%) and 92.2% on π0.5 (vs. 96.8%) with about 2.5× speedup, but fails on LLaVA-VLA (CALVIN chain length 1.85 vs. 3.61).
Critical strengths
A clear mechanistic explanation of what a widely used pruning signal actually measures. "Language-guided" pruning in VLAs is mainly redundancy suppression. Several recent VLA pruning methods (VLA-IAP, TEAM-VLA, SemanticVLA) build on instruction-similarity signals, and this paper tells them what that signal is really doing.
A useful diagnostic insight. It gives practitioners a cheap diagnostic (measuring α and anisotropy) to predict whether similarity-based pruning will work on a new backbone.
Critical weaknesses
The core claim that the simple method surpasses SOTA is not supported. The abstract and Section 3.1 state that cosine-similarity pruning "outperforms more complex state-of-the-art pruning methods." However, in Table 3 (OpenVLA-OFT, 25% kept), VLA-Pruner has a higher average success rate (96.5) than the language criterion (96.2) and the hub rule (95.9), and VLA-Cache matches it on Object. The advantage lies only in latency (97.1 vs. 107.5 ms).
The experimental scope is too narrow for the generality claimed. All method comparisons (Tables 3–6) use a single 25% keep ratio; the substitution study (Table 2) uses 12.5% for OpenVLA-OFT and π0.5, but includes no baselines.
Questions for authors
Pruning-ratio sweep. Report success vs. keep ratio (e.g., 50%, 25%, 12.5%) for language, hub, DivPrune, VLA-Pruner and random selection on OpenVLA-OFT and π0.5.
2 comments
Dear Reviewer,
Thank you again for your feedback. As described in our response above, we have revised our wording regarding the unsupported claims, and we have added the pruning-ratio results at 50%, 25%, and 12.5%, as you suggested (Appendix C). As the discussion period closes soon, we would be grateful if you could let us know whether our revisions address your concerns or if there is anything further we can clarify.
Thank you.
We thank the reviewer for their insightful comments and suggestions. We have tried to cover all raised points, including in the weaknesses, and we are happy to modify based on the discussion.
Response to the weakness on the SOTA claim
We agree with the reviewer. The contribution of the paper is the analysis, and that was our intention while writing, but our wording did not present it that way. We thank the reviewer for pointing this out. The claim that the criterion outperforms state-of-the-art methods was not supported, and we have removed it. The abstract, the introduction and Section 3.1 now say that the criterion performs competitively with existing pruning methods on OpenVLA-OFT.
We have also clarified the paper's contribution. It explains what language–vision cosine similarity ranks in VLAs, and why such a simple score can be competitive at all. The comparison with existing methods places that behaviour in context, rather than ranking the methods.
For the second weakness, we agree that the submitted version overstated the generality of the results. The revision no longer claims that the criterion outperforms existing methods or that it applies to all VLAs. It describes what the criterion ranks on the four policies we study, and the conditions under which that holds. We also extended the evaluation. Appendix C now reports success at 50%, 25% and 12.5% of the visual tokens kept on LIBERO-Long. These results place the 12.5% substitution study of Table 2 against existing methods at the same budget.
Response to the question on success against keep ratio
We added these results to Appendix C (Table 9) in the revised version. Success rate (%) on LIBERO-Long, 500 episodes per cell:
Random selection and DivPrune on π0.5 score above both of our rules at 50% and 25%. This suggests the policy benefits more from spreading the budget across the frame than from concentrating it on the objects. VLA-Pruner's released code supports only OpenVLA and OpenVLA-OFT, so we report it on OpenVLA-OFT.
To test whether coverage is what the criterion lacks on π0.5, Appendix D combines the two. It keeps half of the budget by the language score and fills the other half with DivPrune's selection. With 25% of the tokens kept (LIBERO average, Table 10):