- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes AIA-VLA, a training-free framework for accelerating diffusion-based Vision-Language-Action inference. It combines adaptive visual token pruning, language-model layer skipping, and diffusion feature reuse, using intermediate attention and representation-drift signals to regulate computation. Evaluated on CogACT with SIMPLER, the default configuration reduces FLOPs by approximately 49.4% and achieves a 1.54× inference speedup, with an observed success-rate increase of 1.16 percentage points over the original model.
Critical strengths
- The paper addresses the practical problem of VLA inference latency without requiring additional training or changes to pretrained parameters.
- The three modules target distinct stages of the inference pipeline and can operate independently or jointly.
- The evaluation includes all eight module combinations, multiple acceleration settings, and paired task outcomes against the original CogACT, providing useful information about the performance–efficiency trade-off.
Critical weaknesses
W1. Missing comparison with the closely related EfficientVLA. The paper explicitly identifies EfficientVLA as a training-free framework combining visual token selection, language-model layer pruning, and diffusion feature caching, closely matching the three stages targeted by AIA-VLA. However, EfficientVLA is absent from the experimental comparisons. Without this baseline, the incremental benefits of the proposed adaptive mechanisms over an existing framework covering the same inference stages remain unclear. W2. The benefit of adaptive computation over static acceleration is not convincingly established. At approximately matched FLOPs, AIA-VLA has higher latency than the static baseline, increasing from 566.6 ms to 635.4 ms, while success rate increases from 78.13% to 79.17%. This represents approximately 12.1% higher latency for a 1.04-percentage-point difference in success rate. The paper does not provide paired statistical analysis against the static baseline or comparisons at matched latency. Consequently, the results do not yet establish that adaptive allocation offers a compelling practical advantage over simpler fixed schedules. W3. The supporting analyses do not sufficiently validate the predictive decision rules. The layer-skipping analysis shows that omitting different layers produces different action errors, but does not directly establish that low drift across recently executed layers predicts that the next two layers can be safely skipped. Similarly, the diffusion analysis does not clearly establish whether drift measured between preceding fully computed steps reliably predicts the action error caused by feature reuse at the next step. The analyses motivate adaptive decisions, but provide insufficient validation of the specific signals and thresholds used to make them. W4. Narrow evaluation limits conclusions about applicability and deployment. The evaluation is restricted to CogACT on four task categories in the SIMPLER simulation benchmark. There are no experiments on additional VLA architectures or physical robots. This limited scope leaves both cross-model applicability and practical deployment benefits unverified. In particular, the paper does not demonstrate whether its inference savings improve end-to-end responsiveness or task execution under real-world conditions.
Questions for authors
Q1, Could you compare AIA-VLA directly with EfficientVLA under the same hardware and evaluation protocol, including matched latency or FLOPs budgets, to isolate the benefits of adaptive computation? Q2, Is the success-rate difference between AIA-VLA and the static baseline statistically supported by paired outcomes? Does AIA-VLA retain an advantage when the static baseline is tuned to match its latency rather than its FLOPs? Q3, Can you directly evaluate whether each decision signal predicts the error of the subsequent intervention? For example, could you report action-error distributions and the frequency of high-error interventions when the layer-skipping or feature-reuse criterion is satisfied, together with threshold sensitivity on held-out observations? Q4 Do the proposed rules transfer to another VLA architecture without extensive threshold retuning? Can you provide real-robot evaluation measuring end-to-end control latency, task completion time, and responsiveness to environmental changes?
The authors did not provide any rebuttal during the response period. Thus, I have decided to keep my score.