- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes ActPruner, which extracts action-related directions from deep FFN value vectors and uses them to guide visual-token pruning. Semantic adaptation brings the deep features to the pruning layer, and instruction modulation makes the selection task-conditioned. The method retains only 4% of visual tokens on LIBERO while reaching nearly the dense baseline, with additional results on Meta-World and a physical robot. Personally, I like this work : )
Critical strengths
- The attempt to use action information already encoded inside the VLA is interesting and more task-specific than attention-only pruning.
- The three-stage design is simple enough to be added to a frozen backbone, and the overhead analysis is clear.
- For experiments, the paper includes latest strong baselines like SpecPrune-VLA and LightVLA, and covers real-robot experiments rather than only simulator numbers. Ablations show that both semantic adaptation and instruction modulation matter, and the action-anchor analysis is useful. The comparison and analysis for other baselines are clear.
Critical weaknesses
- Will the code be open-sourced for reproducibility?
- The method depends on a single deep FFN layer and PCA-derived anchors. The reported layer and anchor count appear tuned on LIBERO-Long, so robustness to backbone, embodiment, and task changes is still uncertain. Other backbones like StarVLA can be also considered.
- Meta-World performance remains below the dense baseline (52.5% vs. 55.0%), which is important given the paper's broad claim of preserving control quality. This is not a big weakness but authors can revise related statements to make this paper more solid and rigorous.
- The real-world evaluation has four tasks and appears to use a small number of trials; stronger statistical reporting would help distinguish a real gain from task-specific variation.
- The analysis argues that FFN value vectors encode action priors, but the evidence is mostly correlational. A comparison with learned probes or multi-layer features would better support this interpretation. Related intepretion can be more extended in the revised version.
Questions for authors
See above.
Response to Authors of Submission 36652
Thank you for the detailed responses and additional experiments.
The clarification of the anchor configurations and the new action-Jacobian analysis strengthen the evidence supporting the FFN-PCA design. The additional efficiency measurements on π0.5 and the real-world comparison with LightVLA also directly address my previous concerns.
These additions make the paper's methodological justification and empirical evaluation more convincing. I appreciate the paper's clear motivation, coherent design, and systematic validation. Overall, I consider this a solid and well-executed study. Great work!