- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
OneDemo-α transfers a demonstrated robot skill by reusing recorded motion and using a frozen VLM to predict functional bindings, motion assignments, and sparse edits. The paper introduces OneDemo-Bench and evaluates transfer success and inference cost in simulation and on a physical robot.
Critical strengths
- Reusing demonstrated motion while adapting it to new objects and goals is a useful and well-motivated direction.
- Combining spatial reasoning with a geometric executor is intuitive, and the simulation and physical results provide encouraging evidence.
Critical weaknesses
-
I find it difficult to assess how representative OneDemo-Bench is. Appendices B–E describe its construction, but more detail on task selection, perturbation design, exclusions, and development exposure would help establish that the evaluation is not overly tailored to the proposed transfer interface.
-
The simulation results span multiple platforms, but largely follow the same custom transfer protocol. This provides coverage, though I remain unsure whether the gains extend to an independently defined one-shot transfer evaluation.
-
The component contributions are not sufficiently clear. Re-anchor and Rigid-only controls are described, but I could not find their aggregate success rates. Comparisons across VLMs do not isolate the contributions of functional bindings, motion assignments, and sparse edits.
-
Some comparisons are difficult to interpret. Native Astra receives different source information, and its success rates and costs in Table 1 come from single-response and multiround settings, respectively. These differences are disclosed, but limit conclusions about the success–cost tradeoff and the benefit of the adaptation mechanism itself.
Questions for authors
- Could the authors provide more detail supporting the task and perturbation choices in OneDemo-Bench, including exclusions and the separation between development and evaluation conditions?
- Is there evidence that the gains hold under an independent one-shot transfer protocol or on tasks outside the benchmark construction process?
- What are the aggregate results for the full method, Re-anchor, and Rigid-only on identical targets?
- Could Native Astra’s success rate and cost be reported under the same control setting, with the effect of differing source information clarified?