- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes A2DB, an affordance-guided distillation framework for compressing vision-language-action models. It uses a teacher-side affordance probe to select features for student distillation, followed by training an affordance-conditioned action expert. On four LIBERO suites, the 0.29B-parameter student achieves 76.7% average success, outperforming standard knowledge distillation by 11.6 percentage points.
Critical strengths
- Relevant compression objective and promising matched-scale results. Selecting manipulation-relevant teacher information is a useful direction for VLA compression. At the same reported student parameter count and inference latency, A2DB improves average success over standard KD by 11.6 percentage points.
- Substantial component-level evaluation. The paper includes controls for random and PCA subspaces, leading versus trailing singular directions, singular-value scaling, action sampling, and inverse-model training. These comparisons provide evidence that the selected representation and action-training objectives contribute within the evaluated configuration.
Critical weaknesses
- Unexplained teacher performance gap. The teacher achieves 84.4% average success, compared with approximately 94.2% in published π0 results [1]. Its checkpoint and fine-tuning setup are not sufficiently specified to explain this gap.
- Unclear baseline training. The BC-only ablation uses an already distilled VLM, but its relationship to the main-table BC baseline is unclear. The training recipes for standard KD and SmolVLA also need clarification.
- Insufficient justification for the training complexity. The method combines multiple losses and separate representation and action training stages. The paper does not compare this procedure with joint training or simpler alternatives.
- Limited evaluation. Experiments are restricted to LIBERO, with no real-robot evaluation or additional simulation benchmarks. Such evaluations would provide stronger evidence that the method transfers across environments and robotic platforms.
[1] Driess et al., Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Better, Table 1.
Questions for authors
See Weaknesses.