- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes WorldZoo to improve robot policy generalization by expanding the diversity of existing demonstrations without additional robot data collection. It converts robot demonstrations, UMI data, and egocentric human videos into aligned robot video–action pairs, then composes embodiment, interaction, and scene edits while updating observations and action labels together. UniAug provides a fixed sampling recipe for combining these edits under a limited augmentation budget. Experiments on RoboDojo, DexJoco, and three real-robot tasks show improved generalization across visual conditions, objects, and embodiments. On the real robot, UniAug achieves slightly higher task-average success than single-axis editing using 100 rather than 600 augmented samples per task. The framework also enables policies trained on converted human videos alone to perform a real-robot manipulation task.
Critical strengths
-
This is a practical framework with consistent improvements across two policies. WorldZoo combines embodiment, interaction, and scene editing while updating observations and action labels together. On RoboDojo, it improves average success from 39.3% to 55.4% for pi 0.5 and from 28.4% to 36.5% for LingBot-VLA. These comparisons use matched policy-training settings, supporting the usefulness of the generated data.
-
It showed strong retargeting results supported by real-robot experiments. With the remaining pipeline held fixed, the proposed retargeting achieves 45.3% success compared with 9.7% for fingertip retargeting on Rizon4 with ShadowHand. The real-robot experiments further demonstrate practical value: converted human videos alone support 54% and 48% success on Toy into box, without teleoperated demonstrations.
Critical weaknesses
- The UniAug "allocation" contribution is weakly supported. The recipe is motivated by an allocation study on one task, while the real-robot comparison changes both edit composition and sample count with 100 UniAug samples versus 600 single-axis samples. Equal-budget comparisons and controls matching edit frequencies are missing. The task-average advantages are only 2-3% points, without reported training seed variation, so the generality of the sixfold sample reduction remains uncertain.
Questions for authors
-
UniAug reliability and composition prove could be explore deeper. Could you provide UniAug with single-axis editing at the same sample budget, and with a composition baseline using matched edit frequencies? Do the improvements remain consistent across training seeds?
-
How does performance change when WorldZoo’s object and trajectory edits retain the original action labels? This question could help better understanding how much of the improvement comes from maintaining observation–action consistency.