- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents DyQ-VLA, a runtime-error-aware quantization framework for Vision-Language-Action models. Rather than optimizing only the conventional accuracy–latency trade-off, the paper studies how quantization affects closed-loop execution errors over time. The authors identify different behaviors for translational and rotational errors: quantization increases the dispersion and response sensitivity of translation errors, while rotation errors exhibit relatively concentrated distributions but progressive drift across execution steps. Based on these observations, DyQ-VLA dynamically selects activation precision during execution to control translation errors and uses accumulated quantization residuals to compensate for rotational drift. The method is evaluated on π0.5 and GR00T-N1.5 across LIBERO, RoboTwin 2.0, and real-world manipulation tasks, showing competitive success rates together with reduced execution steps and improved rollout efficiency.
Critical strengths
The main strength of this work is that it introduces a meaningful and relatively novel perspective for VLA quantization. Instead of treating each inference step independently, the paper explicitly considers the closed-loop interaction between execution errors, observations, and subsequent actions, and further discovers distinct evolution patterns for translational and rotational errors. This analysis directly motivates the two components of DyQ-VLA, making the method well connected to the empirical findings rather than being an ad hoc combination of techniques. The paper also provides reasonably comprehensive evaluations across multiple VLA backbones, simulation benchmarks, and real-world tasks, and the reduction in rollout steps is particularly relevant because it shows that per-step acceleration alone is insufficient for evaluating VLA deployment efficiency.
Critical weaknesses
My main concern is the definition of runtime error and, consequently, the interpretation of the paper’s central observations. The paper measures runtime error as the deviation between the executed end-effector trajectory and a matched demonstration/reference trajectory. However, many robotic manipulation tasks admit multiple valid trajectories, and a trajectory that deviates substantially from the demonstration may still be equally correct or even more efficient. Therefore, the measured translation and rotation errors are only proxies for undesirable execution behavior rather than direct measures of task error. Since the key motivation of DyQ-VLA relies on the observed distributional patterns of these errors, it would be important to better justify why deviation from a reference trajectory is an appropriate optimization target. In addition, the reported execution steps and errors are averaged only over successful episodes, which may introduce selection bias when different methods succeed on different subsets of rollouts. 44616_DyQ_VLA_Dynamic_Quantiza
Questions for authors
How sensitive are the proposed error patterns and the resulting dynamic quantization policy to the choice of reference trajectory? In particular, if a task has multiple valid execution trajectories, would DyQ-VLA still make the same precision-selection and compensation decisions when a different successful demonstration is used as the reference? It would be useful if the authors could clarify whether the observed translation-dispersion and rotation-drift phenomena persist under alternative valid references, or provide a reference-independent evaluation of execution quality.
Response to the authors
Thank you for the thorough response and additional clarifications. All of my concerns have been addressed, and I have no further questions.