- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
MARK-VLA presents a post-training quantization framework for VLA models that combines action-sensitive channel-wise precision allocation with specialized GPU kernels. Experiments cover six VLA configurations on LIBERO and three GPUs, reporting up to 3.62× smaller weight storage and 1.69× faster inference, with a maximum decrease of 0.82 percentage points in average success rate.
Critical strengths
- The paper addresses activation preprocessing, weight unpacking, mixed-precision computation, and kernel selection, demonstrating measured inference improvements.
- Evaluation across six VLA configurations and three GPUs supports the applicability of the approach beyond one particular architecture.
Critical weaknesses
- The algorithmic contribution is incremental and needs more precise positioning. Action-guided channel-wise quantization, adjacent precision reductions, and marginal sensitivity per saved bit are already present in QVLA.
- In Table 3, replacing the diagonal approximation with the full estimator improves success from 90.20% to 90.60% on GR00T and from 94.65% to 94.75% on Qwen2.5-OFT under per-module progressive allocation. These gains are small, and uncertainty estimates are absent. The W8A8 reference is also not separately ablated against a full-precision reference. The current evidence more strongly supports the allocation strategy than the claimed estimator improvement.
- The method relies on empirically selected storage budgets for the vision, language, and action modules. Their values, selection procedure, and tuning cost are important for reproducibility and for assessing comparisons against a baseline with a single global budget. Budget sweeps and comparable tuning opportunities for competing methods would strengthen the results.
- ActQuant is discussed but not evaluated. Preserving selected modules in floating point does not necessarily imply an inferior whole-policy trade-off. A uniform-W4A8 baseline using the same smoothing, rotation, and optimized execution would also help establish the necessity of channel-wise mixed precision. Comparisons should report success, complete-policy storage, and latency across multiple budgets.
Questions for authors
- How were module budgets selected, and what validation data and tuning cost were involved?
- Which gains remain when QVLA receives the same module budgets and strict precision-staging constraint?
- Do reported storage sizes include the actual hardware-specific packed representations?
- Can the authors provide repeated evaluations and comparisons against ActQuant and uniform W4A8?