- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
BATCH addresses cross-embodiment robot learning from human demonstrations. It learns temporal representations using GTCC and applies subsequence dynamic time warping to retrieve and temporally align human demonstration segments with robot windows. The aligned data are used to fine-tune a video-action diffusion model through two objectives: attention-isolated human–robot co-training with shared parameters, and human-to-robot future-video prediction conditioned on aligned human observations and robot scene context. Deployment requires only the robot stream.
The evaluation measures correspondence quality using phase overlap and phase-progress error, and evaluates real-world policy execution on Object in Container and Cup on Saucer. The policy experiments test configurations represented in human demonstrations but absent from robot training data. The paper reports improved aggregate performance over the compared baselines and ablations.
Critical strengths
- The cross-embodiment prediction objective provides a concrete extension of human–robot co-training. The style-transfer branch predicts robot future video using an aligned human clip while masking the robot conditioning latent and action/state registers. This explicitly couples the embodiments during training while preserving robot-only inference. Its integration into a video-action model provides a plausible mechanism for transferring information from human demonstrations to robot control.
- The evaluation connects correspondence learning with real-world policy performance. Table 1 compares temporal representations, generic visual features, pose information, and temporal-matching alternatives. The policy experiments separately compare the complete method with co-training, OT-based transfer, and removal of alignment. The improved aggregate performance on both single-arm and bimanual manipulation supports the practical potential of the framework.
Critical weaknesses
-
The downstream advantage of the proposed alignment design over simpler alternatives remains insufficiently established. Table 1 compares several representations and matching strategies, but the policy evaluation contrasts the proposed alignment primarily with randomly sampled, unaligned trajectories. It does not include DINOv3 + DTW or the GTCC variant without DTW, although both are evaluated for correspondence quality. Consequently, the experiments support the complete alignment procedure but do not establish whether the advantages of its particular representation and matching choices translate into better control.
Moreover, the “without alignment” ablation changes both which human segments are selected and their temporal correspondence. It therefore does not separate relevant-segment selection from temporal alignment. I regard this as a limitation in attributing the policy gains, rather than evidence that the alignment procedure is ineffective. Nevertheless, this attribution is consequential because behavior alignment is a central contribution of the paper.
-
The stability of the reported policy advantage is unclear from the presented evaluation. Figures 4 and 6 provide aggregate and per-scenario point estimates without showing uncertainty. The training and evaluation descriptions do not clearly identify how many independently trained policies contribute to these results. Thus, the consistency of the gains over EgoVerse and the OT variant across training runs cannot be assessed from the reported comparisons.
This does not establish that the results are irreproducible. It does, however, limit confidence in the empirical advantage, particularly when assessing the incremental contribution of the proposed training objective. Reporting the number of independent training runs and any available uncertainty would materially strengthen the evidence.
Taken together, these limitations leave me leaning toward weak rejection: the complete framework is promising, but the evidence for the downstream value of its alignment choices and the stability of its empirical advantage is not yet sufficiently convincing.
Questions for authors
- How does downstream policy performance change when the same training objectives use DINOv3 + DTW or GTCC without DTW? Do the correspondence-quality differences in Table 1 translate into differences in robot execution?
- Can the authors distinguish relevant-segment retrieval from temporal correspondence through a control that retains the retrieved windows and sampling frequencies while perturbing their pairing or relative temporal alignment? This would clarify which aspect of the alignment procedure explains the policy gains.
- How many independently trained policies underlie Figures 4 and 6? If multiple independently trained policies were evaluated, are the gains over EgoVerse and the OT variant consistent across runs? Please clarify any available uncertainty estimates.
These questions concern validation of the current contribution rather than requests for additional application domains.
Dear reviewers,
Thanks for serving as a reviewer. As the discussion period comes to a close and the authors have submitted their rebuttals, I kindly ask you to take a moment to review them and provide any final comments.
If you have already updated your comments, please disregard this message.
Thank you once again for your dedication to the OpenReview process.
Best,
Area Chair