- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies how to adapt a pretrained VLA to a new robot with limited expert demonstrations without losing its instruction-following ability or previously learned skills. The method combines expert demonstrations collected from teleoperation with rollouts collected by running the frozen pretrained policy on the target robot. The authors evaluate the method on a physical ALOHA robot and in RoboTwin simulation. It improves performance on expert demonstrated tasks and reduces forgetting of other tasks. For example, real-world pick-and-place success increases from 0% (zero-shot) to 55% without expert placing demonstrations, and success on old simulation tasks increases from 16.6% to 70.6%. Experiments also examine novel objects, task compositions, and held-out skills, though the benefits vary across tasks and depend on the quality of the self-demonstrations.
Critical strengths
The paper tackles a practical problem in adapting pretrained VLAs. These models may understand instructions but struggle to execute them on a new robot. Fine-tuning on expert demonstrations can improve control but also cause the model to forget other skills. Preserving those skills without access to the original pretraining data is useful for researchers working with released models.
Critical weaknesses
The method still requires manual data selection. The authors choose task prompts and filter out rollouts that ignore the instruction or behave unsafely. They also find that poorly filtered self-demonstrations can hurt performance compared with expert-only fine-tuning. It is therefore unclear how much human effort the method needs and whether it would remain effective across a larger set of tasks.
Questions for authors
Clarification Question: How much time did you spend choosing prompts and filtering rollouts, and how many rollouts were discarded? Did you use the same filtering rules for all tasks, or did they need to be adjusted for each task?
Response to the Review
We thank the reviewer for highlighting the strengths of our practical problem setting, and for providing us valuable feedback.
Self-demo collection time, rejection rates, VLM automation. To quantify the time and effort in the self-demo collection process, we logged 45 self-demos, which took 70.2 minutes in total. Of that time, each self-demo took on average 1.25 min, and 13.0 minutes were spent on filtering which demos to keep. 33% of the self-demos were kept (27 follow the "pick" instruction; of those, 15 also follow "place"). This filtering could be automated. We tested that GPT-6.1 Sol (High) performs the filtering with 89% agreement to the manual filtering. We added these to the main paper Section 6, Appendices A.2 and A.4.
Yes, we used the same filtering rules. We filter self-demonstrations based on whether the robot safely attempts to follow the instructions. E.g., for pick and place, it must: (1) not wedge its gripper against the container or table or get it stuck; (2) attempt to pick up the specified object; and (3) carry out a motion as if moving towards the container for a place. Task success is not a criterion. We add the prompt used for VLM automated filtering with these three criteria to A.4.
Thanks to your feedback, we conducted additional analysis for our poorly filtered self-demo experiment in A.3. Our ablations suggest that self-demos with less place behavior can still help a different expert task, but that correct pick attempts alone are insufficient to improve pick-place tasks. For the pick-place ablation previously reported under limitations section, all 15 self-demos attempted to pick correct objects across both sets, but only 53.3% attempted place in the substitute (lower quality semantic filtering set) compared with 86.7% in Our original set and performance fell on pick-place.
In the gear insertion benchmark, the self-demos contained pick attempts in 100% and place attempts in 72.4% of episodes and improved expert gear-insertion success from 40 to 90, even as IF (post-grasp) on pick-and-place fell from 85% to 35%. Hence, a rollout can fail the task and still be useful, but it should contain an attempt at the behavior we want to distill.