- Rating
- 3(+2)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
OneDemo uses sparse-reward reinforcement learning to adapt a single demonstration to new object poses. The editor learns segment durations and object-relative geometric corrections within a fixed sequence of semantic stages. It serves as both a task policy and a demonstration generator for downstream imitation learning, evaluated in simulation.
Critical strengths
- Restricting exploration to timing and geometric edits provides a clear, practical way to reuse demonstrated motion for policy learning and data generation.
- Generated data substantially improves downstream policies across nine DexMimicGen tasks at matched dataset size, with multiple training seeds. Ablations support the roles of timing and geometric adaptation, and RoboTwin adds complementary results.
Critical weaknesses
- Applicability is narrowly constrained by the source strategy. Fixed stage order, arm assignments, and hand commands prevent discovery of a different strategy when a new configuration makes the original one infeasible. Two RoboTwin tasks require separate demonstrations and editors for different modes. This is a major limitation for generating data across materially different initial states, despite strong results on compatible pose variations.
- The main policy-learning and sample-efficiency evidence comes from relatively simple Meta-World tasks, limiting its relevance to complex manipulation. Harder benchmarks demonstrate data quality but lack complete editor-training and generation costs; the Threading ablation alone uses 20 million interactions. Comparison controls are also insufficient: Figure 3 uses Meta-World v3 for OneDemo and v2 for MoDem, while DexMimicGen policy baselines are taken from published results. Matched comparisons on harder tasks, including other learned editors, are needed.
Questions for authors
N/A
3 comments
Thank the authors for the response. Most of my concerns are addressed. I have updated my rating.
We sincerely thank the reviewer for taking the time to reconsider our submission and for their constructive feedback. We appreciate your thoughtful engagement with our rebuttal and updated experimental results.
Response to Reviewer 7VQm
W1: Applicability is constrained by the source strategy and cannot generalize to different behavior modes.
RW1: We agree with the reviewer that OneDemo preserves the high-level strategy of the source demonstration, including stage ordering, arm assignments, and hand commands.
This is an intentional design choice that separates spatial generalization from behavior-mode learning: by treating each source demonstration as specifying one feasible behavior mode, OneDemo focuses RL exploration on learning its temporal and geometric adaptation across task configurations, rather than discovering new manipulation strategies. This structured formulation makes sparse-reward learning more tractable in the single-demonstration setting for complex, long-horizon manipulation tasks.
When additional behavior modes are necessary, OneDemo can accommodate them through additional source demonstrations and independently trained editors, as demonstrated on RoboTwin in Appendix A.8. We acknowledge that automatically discovering and selecting new behavior modes remains outside the scope of the current work.
We have clarified this distinction in Section 1 (Introduction) and Section 5 (Limitations and Future Work) of the revised manuscript.
W2: Need stronger matched comparisons on complex tasks and training costs.
RW2: We address the reviewer's concerns regarding matched comparisons, training costs, and benchmark differences as follows.
1. Matched comparisons on challenging tasks. Please refer to MR3 in our Meta Review. The additional residual RL comparison demonstrates that OneDemo's structured trajectory adaptation substantially improves learning efficiency over low-level residual learning on challenging bimanual tasks, highlighting the benefit of restricting exploration to temporally and geometrically meaningful edits.
2. PPO training and data-generation costs. OneDemo incurs an upfront PPO training cost once per learned editor. After training, the editor achieves near-perfect trajectory-generation success rates, enabling successful demonstrations with very few wasted rollouts. Thus, the upfront training cost is amortized as more demonstrations are generated. We clarify this distinction in Section 4.4 and Appendix A.11.
3. Meta-World version difference. Regarding the Meta-World version difference, MoDem's released implementation uses Meta-World v2, reflecting the benchmark version available at the time of its publication. We evaluated OneDemo on the updated Meta-World v3 to reflect the current benchmark implementation, rather than restricting our experiments to an older version solely for strict numerical comparison.
4. DexMimicGen downstream policy baselines. We follow the standard practice of comparing against published benchmark results. These comparisons are not presented as independently reproduced evaluations. To supplement them, we conducted additional controlled evaluations on challenging bimanual tasks, including the DexMimicGen trajectory-generation reproduction summarized in MR1 of our Meta Review and reported in Section 4.4 and Appendix A.11 (Table 8 and Figures 7–8) of the revised manuscript.