- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper studies the robustness of the post-training quantization of vision-language-action (VLA) mode to environmental shifts, beyond in-distribution evaluation setting. The authors provide empirical study to show that quantized policies (GR00T-N1.5, π0.5, OpenVLA-OFT with QuantVLA, HoloQ-VLA, and QVLA) lose performance under environment disturbances. Besides that, they show that the performance drop can be partially recovered by selectively replacing student actions with teacher actions at high-discrepancy states, motivating targeted supervision during post-quantization recovery. Motivated by this they propose Policy-Induced Vulnerability-Oriented Tuning (PIVOT-Q), which selectively distills the quantized student from a frozen full-precision teacher on student-visited states that shows the highest vulnerability scores based on current and discounted future action discrepancies. Besides that they include a behavior anchor which regularizes the student toward the full-precision teacher’s actions on reference states to limit forgetting during recovery. The authors validate their proposed approach on LIBERO-Plus benchmark.
Critical strengths
The strengths of the paper are summarized below:
i. The paper is well-written and easy to follow. ii. The paper tackles a relevant problem, as VLA inference is computationally demanding making quantization attractive for deployment without losing the generalizability. iii. The approach requires neither reward definition nor task-success labels. iv. The inclusion of behavior anchor based regularization is sound and can prevent training instability. v. The empirical study covers multiple VLA backbones and quantization methods, providing evidence the method works beyond a single model or configuration.
Critical weaknesses
My primary concern is the novelty of the paper. It introduces a vulnerability score to guide the policy tuning or distillation. However, the score is fairly intuitive and straightforward raising question about the novelty of the paper. My decision is primarily motivated by this concern. The weaknesses aside from the novelty are summarized below:
i. Although VLAs have been designed for general purpose policy learning, their generalization to unseen environments remains limited. This poses a limitation on the proposed approach. ii. The motivating action-replacement study does not capture the broader behavioral changes caused by the intervention which necessitates introduction of behavioral anchor loss. This also makes one wonder if the behavior regularization alone accounts for a substantial fraction of the recovery. iii. It is not clear how the behavior anchor states have to be chosen. iv. Considering the simplicity of the approach the paper will benefit if the approach can be extended to broader model compression techniques such as pruning or distillation into smaller architectures. v. The necessity of the current-discrepancy term \tilde q_t is not established. Discrepancy can be established with \tilde r_t term alone.
Questions for authors
Please find my questions below:
i. How does the method perform when the full-precision teacher also fails under environmental shifts? Additional empirical analysis would help clarify whether distillation also reinforces teacher errors in the distillation/tuning process. ii. Could you provide a future-only ablation that removes the current-discrepancy term from the vulnerability score? iii. Could you provide an anchor-only ablation to determine how much recovery is attributable to behavioral regularization alone? iv. Could you comment on whether vulnerability-oriented supervision is applicable to other model compression approaches, such as pruning or distillation into smaller architectures? v. How are the reference states in the behavioral anchor bank selected? Does constructing this bank require expert demonstrations or additional annotations, and how sensitive is recovery performance to its composition?