- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates how manipulation skills learned from human action data can be transferred to a dual-arm robot equipped with parallel grippers. To address noise in human wrist-pose estimation and differences in human–robot contact patterns, the authors propose a Bridging Action based on relative 3D wrist translation as a shared action representation. They also introduce an Interleaved Action Sequence within a π₀-like VLA architecture to accommodate missing action components across data sources and enable human–robot co-training.
The method is evaluated on 15 real-robot manipulation tasks across four categories. Compared with directly using human 6DoF actions, the proposed approach increases the average task success rate from 12.50% to 22.50%, and further to 38.33% with large-scale human-only pre-training. Ablation studies indicate that jointly supervising Bridging Action on human and robot data is important for skill transfer.
Critical strengths
To address noise in human wrist-rotation estimates and differences in human–robot contact patterns, the authors propose shared 3D wrist translation as an action representation. The idea is simple and reasonably motivated, and the experiments provide preliminary evidence of its effectiveness.
Critical weaknesses
- Insufficient Experimental Validation:
- Missing core comparison. Table 2 compares 3D and 6DoF without human-only pre-training, whereas the full method includes large-scale human pre-training. The authors should add a 6DoF baseline with the same pre-training setup.
- Limited evaluation scale and lenient success criteria. Each task is tested only eight times across two scene layouts; some success criteria are permissive (e.g., opening a microwave door by 50% counts as success). The authors should increase the number and diversity of trials, apply stricter success criteria, and report statistical analyses.
- Inconsistent post-training gains. Figure 4 shows performance declines on some tasks after post-training. The authors should investigate the cause and assess training stability through repeated experiments.
- Limited Methodological Novelty:
- Prior work, such as MimicPlay[1] has already used 3D hand trajectories for human-to-robot manipulation skill transfer. The main distinction here is to use 3D wrist translation as shared human–robot action supervision within a VLA; however, its substantive novelty relative to prior approaches remains limited. Moreover, the Interleaved Action Sequence largely relies on existing Transformer token organization and masking mechanisms.
[1] Wang, C., et al. "MimicPlay: Long-Horizon Imitation Learning by Watching Human Play." Conference on Robot Learning (CoRL), 2023. https://arxiv.org/abs/2302.12422
Questions for authors
- Fairness of the core baseline: Table 2 only compares 3D and 6DoF methods co-trained from scratch, while the full method includes large-scale human pre-training. Why is there no 6DoF baseline under the same pre-training conditions? Could this comparison change the paper’s central conclusion?
- Reliability of the evaluation: Each task has only eight trials, and some task-success criteria are lenient. Can the authors report results using stricter success criteria and provide repeated evaluations or statistical analyses to establish the reliability of the reported improvements?
- Post-training performance degradation: Figure 4 shows declining performance for some tasks after post-training. How do the authors explain this behavior, and does the decline persist across repeated training runs and evaluations?