- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
SnapVLA addresses the efficiency of action generation in VLA models and achieves both strong performance and higher efficiency. The method is very promising. Experiments on more benchmarks would further support the paper’s claimed contributions.
Critical strengths
-
Efficiency is a key issue for VLA models. The paper achieves strong performance while maintaining efficient action generation.
-
The ablation studies are fairly complete.
-
The writing and figures are easy to follow.
Critical weaknesses
-
The paper focuses on the advantages of one-step generation. A performance–latency curve comparing 1, 2, 4, and 12 generation steps, using the same binned representation, training budget, and smoother, would better support this claim. It could also show the method’s potential for multi-step generation.
-
NAVSIM v1 and v2 essentially evaluate different metrics on navtest. The method should also be tested on other datasets to assess its generalization, such as navhard, which emphasizes challenging scenarios, and the Waymo end-to-end dataset. Also, the NAVSIM benchmark is based on nuPlan, rather than nuScenes.
-
The paper only studies VLA action generation for autonomous driving. It does not explore manipulation or robot navigation, so the title should explicitly mention autonomous driving. The current title appears to claim a broader scope than the experiments support.
Questions for authors
Please refer to the weaknesses section.