- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates how pre-training data composition affects cross-embodiment transfer in vision-language-action models. Using a fixed π₀ architecture, the authors examine source embodiments, scene/object/task diversity, dataset size, and pre-training duration. Evaluation includes RoboTwin 2.0 manipulation tasks and real-world pants folding on Piper.
The experiments show that ARX pre-training improves transfer to Piper, whereas FR3 pre-training produces negative transfer under the tested shared joint-action representation. Under a fixed trajectory budget, expanding the task set provides larger gains than the tested visual-diversity interventions. Additional data and longer training improve performance in some settings. The authors interpret these observations using a manipulability-based kinematic distance and visual and joint-trajectory diversity metrics.
Critical strengths
- The source-embodiment comparison reveals a practically relevant negative-transfer phenomenon. With the architecture, pre-training steps, and downstream adaptation protocol held fixed, Table 1 reports that ARX pre-training increases mean success across six downstream tasks from 0.28 to 0.38, whereas FR3 pre-training reduces it to 0.04. This substantial difference demonstrates that demonstrations from another embodiment do not necessarily improve target performance under the tested representation and training protocol. The observation is directly relevant to cross-embodiment data mixing.
- The task-diversity experiment evaluates a concrete data-allocation decision. Under a fixed budget of approximately 5,000 trajectories, expanding pre-training from 10 downstream-aligned tasks to 47 tasks improves downstream performance despite reducing demonstrations per task. This provides useful evidence for choosing between increasing demonstration density on aligned tasks and broadening task coverage.
Critical weaknesses
- The morphology analysis provides limited validation of kinematic similarity as a source-selection criterion. Table 1 evaluates transfer from two source embodiments, ARX and FR3, to one target, Piper. The kinematic-distance ordering in Table 2 agrees with these outcomes, but agreement on two source-to-target comparisons offers limited evidence of predictive value beyond this setting. Section 3.3 also uses embodiment-specific normalization, zero-padding, and a shared action head for joint-position prediction, whereas the distance compares local manipulability matrices at matched end-effector poses. Compatibility of the inherited joint-coordinate mapping is therefore a plausible alternative explanation that the current comparison does not isolate. Appendix D strengthens the numerical analysis of the metric, but does not establish its predictive relationship with additional transfer outcomes. The authors acknowledge the limited embodiment coverage in Section 5; nevertheless, this remains consequential because morphology-aware source selection is a central practical recommendation.
- The diversity and training-duration analyses support narrower conclusions than the broader pre-training guidance emphasized by the paper. Table 3 compares useful interventions under a fixed trajectory budget, but expanding from 10 to 47 tasks is not calibrated against a comparable magnitude of scene or object diversification. The results establish the advantage of this particular task expansion more directly than a general priority for task diversity over visual diversity. Likewise, the VDS–JSD analysis shows that trajectory diversity accompanies improved performance, but does not establish whether JSD predicts transfer beyond these six dataset configurations. Finally, Figure 4(a) reports mean sub-goal completion, and Section 4.1.2 supplements this with qualitative observations about complete-sequence execution. This is suggestive evidence, but the aggregate metric alone cannot distinguish improvements in individual components from improvements in completing the entire sequence. These distinctions matter for a paper whose main contribution is explanatory guidance about pre-training rather than a new policy architecture.
Questions for authors
- Predictive value of kinematic distance: Are additional source–target transfer results available to test whether the proposed distance predicts transfer gains? Appendix D includes UR5 in the distance analysis; are corresponding transfer results available? Such evidence would directly affect my assessment of the source-selection criterion.
- Effect of action representation: Were action-output reinitialization, embodiment-specific action projections, or related controls evaluated to diagnose how much of the ARX–FR3 difference depends on the shared joint-action representation? These controls would not isolate every embodiment-dependent factor, but could help establish the scope of the morphology conclusion. As Section 4.2.1 acknowledges, the mixed-source comparison also reduces ARX exposure and therefore does not independently isolate interference from FR3 data.
- Result stability and skill composition: How many independent training runs underpin the main comparisons, and what performance variation or uncertainty estimates are available? For the pre-training-duration experiment, can the authors provide full-task success and individual sub-goal completion at the evaluated checkpoints, or identify where these are reported? These results would help assess the reliability of smaller differences and distinguish component-level improvement from improved complete-sequence execution.
These questions concern evidence that could materially change my assessment of the current claims, rather than requests for unrelated future work.