- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes VEL. Keeping the VLA backbone frozen, VEL trains a small energy head using existing demonstration data, and corrects actions using a single gradient descent step. The authors evaluate VEL on LIBERO using OpenVLA-OFT and as backbones. They also report improved performance with VEL on a real-world screw grasping and insertion task.
Critical strengths
-
The method provides a lightweight approach to adapting existing VLA policies. VEL keeps the VLA backbone frozen and trains the energy head using existing demonstration data, without additional data collection.
-
The method is evaluated on two VLA backbones in simulation and is also tested on a real-world manipulation task.
Critical weaknesses
My main concern is the consistency of the method's performance gains across task suites. As shown in Table 1, VEL does not consistently improve on the corresponding base policies across all task suites. Specifically, on LIBERO-Object, both VLA backbones have slightly lower reported mean success rates with VEL than without it. It therefore remains unclear how to determine in advance whether applying VEL will improve performance in a given deployment setting. A clearer characterization of when VEL is likely to help or hurt would make it easier to decide whether to use it in deployment.
Questions for authors
-
Table 1 reports results over five energy-head training seeds for VEL, whereas the other rows are described as single-run results. How sensitive are the baseline success rates to evaluation randomness?
-
In Figure 5, why does the energy appear to vary mainly with the noise standard deviation and remain nearly constant along the noise-mean axis? Does the model still assign low energy to perturbed actions when the noise standard deviation is small but the absolute noise mean is large?
-
In Appendix E.5, the results suggest that fewer correction steps and smaller step sizes yield higher average success rates over the tested settings. What happens if is reduced below 0.1?