- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
ActTune combines action-aware mixed-precision selection with GPU operating-point adaptation to reduce GPU energy per successful task for VLA models. A lightweight decision tree selects precision configurations, supported by a shared weight bank, integer kernels, and asynchronous frequency–power control. Experiments cover OpenVLA-OFT and π₀.₅ on four LIBERO suites, reporting up to 2.02× faster inference and 76.8% lower energy than the original BF16 implementations. GPU adaptation increases mean inference latency by less than 10% relative to the same quantized policy at the fixed operating point. Energy measurements include failed episodes, GPU simulation rendering, and intervals between policy calls.
Critical strengths
- The evaluation objective reflects task execution costs. Energy per successful task accounts for failed attempts, and experiments cover two models and four suites. At W4A4, the two models outperform the strongest compared baseline in their respective groups by 4.0 and 5.1 percentage points in success rate.
- The implementation addresses practical deployment costs. The shared weight bank, native integer kernels, and asynchronous GPU control support an executable system. The full controller achieves an additional 4.15 percentage points of energy savings over the best fixed operating point, suggesting value in context-aware control.
Critical weaknesses
-
The independent benefit of dynamic precision selection remains insufficiently established. Only two matrices switch between W2 and W4 online, while their activation precision and corresponding arithmetic type remain unchanged . The single-leaf comparison shows success-rate gains, but the paper does not report success–energy–latency comparisons across all four fixed configurations or uncertainty estimates. This makes it difficult to distinguish gains from dynamic selection from those attributable to static mixed precision and backend optimization.
-
Baseline differences and measurement scope limit attribution of efficiency gains. ActTune incorporates CUDA Graph and other runtime optimizations, whereas the BF16 reference does not receive equivalent optimization. Quantized-layer coverage may also differ across methods. Moreover, energy measurements include GPU rendering and intervals between calls. Comparisons with matched runtime optimizations and an energy breakdown are needed to establish the gains attributable to the inference method itself.
Questions for authors
- With identical kernels and a fixed GPU operating point, what are the success rates, energy costs, and latencies of each of the four fixed configurations versus the dynamic selector? Could you provide confidence intervals for paired differences?
- How much of ActTune’s speedup and energy savings remains after applying transferable optimizations, such as CUDA Graph, to BF16? Is quantized-layer coverage consistent across methods?
- Which model–precision setting does Figure 6a evaluate? Are the additional savings over the best fixed operating point stable, and do they primarily arise from inference, rendering, or intervals between calls?
- Are the numbers of successful episodes identical with and without DVFS in Table 1? Please report them separately to substantiate the claim of preserving task success.
Dear Reviewers,
The authors have submitted their rebuttal. Please review it and share your comments. If anything is unclear or requires clarification, please let the authors know as soon as possible. The author–reviewer discussion period ends on 18 November.
Best regards,
AC