- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper proposes VLA-SSD, a stochastic self-distillation method for flow-matching VLA models. Specifically, it employs the Itô mapping to distill multi-step flow-matching action heads into a single-step stochastic policy conditioned on Brownian paths. This method not only reduces the number of forward passes required for each action but also handle the issue where the stochasticity comes only from the initial noise of the existing sampler. The overall training can be divided into two stages: self-distillation and GRPO. Experiments show that VLA-SSD significantly reduces the time required for reasoning and achieves competitive success rates.
Critical strengths
-
The paper proposes VLA-SSD, a one-step generation method that substantially reduces the forward-pass time required for action generation in flow-matching VLAs. It only requires 7.6 ms compared with 24.5 ms for the SOTA method.
-
The authors fully considers the characteristics of flow-match VLA and build the two-stage training pipeline of self-distillation and GRPO on these characteristics.
Critical weaknesses
-
One of the major issues is the performance gap. Although VLA-SSD significantly reduces inference time, its success rate on LIBERO (single step, 93.0%) is still significantly lower than the current best result of 98.3% for four step PPO.
-
Further ablation experiments are needed to verify the effectiveness of the two-stage training. Please refer to Questions For Authors,
Questions for authors
VLA-SSD adopts two-stage training pipeline: starting from the $\pi$0.5 SFT checkpoint for self-distillation, and then performing GRPO. However, Table 1 shows that the success rate of the Itô student on LIBERO after self-distillation (68.6%) is significantly lower than the success rate of $\pi$0.5 SFT (77.1%). Could the author provide a reasonable explanation for this? This phenomenon also raises the question of whether two-stage training is necessary: if we skip self-distillation and use VLA-SSD's RL strategy directly on the $\pi$0.5 SFT checkpoint for training, can we achieve better results? I hope the author can provide the results of this experiment to demonstrate the necessity of self-distillation before RL training.
Response to Reviewer a8v2
We are grateful to the reviewer for the time and effort they devoted to the paper. We particularly appreciate their observation that the two-stage training design “fully considers the characteristics of flow-match VLA” by pairing self-distillation with GRPO. We also thank them for noting that VLA-SSD “substantially reduces the forward-pass time required for action generation” while maintaining competitive success rates. Given the character limit, we first address the trade-off between LIBERO success and inference latency (W1), then discuss the role of self-distillation before GRPO (W2, Q1).
(W1) Performance and Inference Efficiency
We thank the reviewer for highlighting the performance gap on LIBERO. We agree that four-step πRL + PPO achieves the highest success rate in Table 1 (98.3%, compared with 93.0% for VLA-SSD). The two policies differ in both sampling depth and RL algorithm, so the 5.3-point gap alone cannot tell us how much of the difference is due to one-step generation.
To keep the RL algorithm fixed, we also compare VLA-SSD with four-step πRL trained with GRPO (Section 4.2, Table 1). The πRL success rates are from the published baselines, and the action-head timings are per chunk on one A100.
VLA-SSD has the lowest action-head latency of the three methods, taking 7.6 ms per chunk on one A100 versus 24.5 ms for both four-step πRL baselines. This gives a 3.2× action-head speedup while achieving 93.0% success on LIBERO.
(W2, Q1) Effect of Self-Distillation
We agree that it is important to isolate the contribution of self-distillation to one-step policy performance. Following the reviewer’s suggestion, we ran a one-step LIBERO ablation from the same π0.5 SFT checkpoint. We applied self-distillation before GRPO in one run and skipped it in the other, keeping the GRPO settings fixed. Both policies used one-step sampling with exploration noise turned off at evaluation.
The self-distilled policy started GRPO with a higher one-step success rate and retained a 21.45-percentage-point lead on LIBERO at the evaluation checkpoint. We have added the self-distillation ablation to Appendix E and summarize its main result in Section 4.4.
Concluding remarks
We thank the reviewer for drawing attention to the trade-off between LIBERO success and action-generation time and for suggesting the self-distillation ablation. The one-step policy achieves 93.0% success with the lowest action-head latency in the comparison. The new ablation in Appendix E shows that self-distillation gives the policy a stronger starting point and an advantage early in GRPO training. We hope these results address the reviewer’s concerns and would be happy to discuss any remaining questions. If the reviewer finds the new evidence convincing, we would be grateful if they would consider raising their score.