- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
RoboCoach uses a world model to guide demonstration acquisition and skill-specific policy updates for long-horizon manipulation. Its Route–Imagine–Diagnose–Improve loop executes skill experts in CoachWorld, uses a progress judge to identify the first timed-out subtask, and requests demonstrations for frequently failing subtask–expert pairs. The corresponding LoRA adapters are then updated while the shared policy backbone remains frozen. Experiments on LIBERO, RoboTwin, Franka, and AgileX show improvements under fixed additional demonstration budgets. The paper also evaluates whether the updated experts can be reused in previously unseen task compositions.
Critical strengths
- The real-robot results are substantial and consistent with the targeting. The real-robot gains are large on both platforms (13.3% to 75.0% on Franka and 40.0% to 83.8% on AgileX, against 30.0% and 47.5% for the baseline), and per-task improvements appear in the round where the corresponding subtask is selected (Tables 11, 15 and 16).
- Skill-specific adapters enable efficient and reusable policy improvement. Each skill uses an independent LoRA adapter on a shared, frozen policy backbone, allowing additional demonstrations to update the corresponding skill without retraining the entire policy. The updated adapter can then be reused across tasks, so targeted coaching can potentially benefit multiple tasks that involve the same skill.
Critical weaknesses
-
The conceptual advance over existing pipelines appears limited. Policy evaluation inside action-conditioned world models (e.g., Ctrl-World; Guo et al., 2025) and failure-driven demonstration acquisition (e.g., AdaDemo; Mu et al., 2024) are both established directions. RoboCoach combines them by using imagined subtask bottlenecks to request demonstrations and selectively update skill-specific LoRA adapters. I therefore view the contribution primarily as a useful system integration, with relatively modest methodological novelty.
-
The reliability of coaching-target selection remains unclear. Figure 3 shows task-level success agreement, while Table 2 evaluates the judge against annotations of generated videos. Neither directly establishes that imagined failures identify the skills responsible for real failures. Moreover, premature completion judgments can trigger incorrect expert switches and misattribute subsequent failures to the next skill. The overall policy gains are encouraging, but do not resolve whether the system reliably selects the right coaching targets.
Questions for authors
- Could the authors clarify how the expert library is constructed?
- Have the authors evaluated how often the router selects the correct next subtask, given that a routing error would attribute the resulting failure to the wrong expert in the scorecard?
- See weakness
4 comments
Dear Reviewer C3Vt,
Thank you again for your thoughtful review. We have provided additional analyses on Router reliability and target selection, along with further clarification of our methodological contribution.
We hope these results address your concerns and would appreciate your consideration in the final assessment :-)
Best regards, Authors
Thank you for the thoughtful response and additional experiments. The expert-library construction is now clear, and the new controlled comparisons and Router evaluation strengthen the empirical support. These additions address several of my concerns. I appreciate the practical value of this work and maintain my rating of 3 (Weak Acceptance).
We sincerely thank you for your thoughtful feedback and for maintaining your positive assessment! We appreciate your recognition of our additional experiments and clarifications, particularly regarding the expert library and Router evaluation.
Thank you again for your constructive suggestions and encouragement!
Response to Reviewer C3Vt
We thank the reviewer for highlighting the real-robot gains and skill reuse. We clarify the contribution and provide direct routing measurements.
Q1. Contribution Beyond Ctrl-World and AdaDemo
A1: RoboCoach couples two decisions at the subtask–expert level: what supervision to acquire and which reusable policy component to update.
Ctrl-World uses world models for policy evaluation and improvement; AdaDemo guides demonstration collection from policy weaknesses. RoboCoach links these directions through the same subtask–expert unit: imagined first-timeout diagnoses are aggregated into task-balanced priorities, which determine both real demonstration requests and the LoRA experts to update. This gives the world model an active coaching role—allocating scarce supervision to reusable skills whose updates can benefit multiple task compositions.
The new simulation controls test these two decisions (R1):
These controls support targeted acquisition and expert-specific adaptation separately. On held-out compositions, RoboCoach achieves 35.0% mean success versus 0% for Single + Uniform, demonstrating transfer of updated skills in the combined system. The hardware experiments further establish its practical utility.
Q2. Construction of the Expert Library
A2: We follow AtomicVLA's semantic atomic-skill decomposition. For example,
pick soup can,pick mug, andpick moka potare different subtasks but can share one Pick LoRA expert on the frozen shared backbone.The vocabulary and expert mapping are manually defined. New semantic skills can be added by initializing another adapter from the shared base and training it on demonstrations. Autonomous expansion requires a criterion for creating categories, acquiring their data, and integrating them into the Router and Judge.
Q3. Router Correctness and Erroneous Expert Switching
A3: We added a four-platform offline Router evaluation covering 2,115 decision points from 220 reference videos (R5). We use the paper's original prompt and correct completed prefixes. Each decision is scored for the next skill category and for the exact skill–object pair; the reported accuracies aggregate decision points sampled within the videos.
A separate 500-initial-state test gives 91.0% (455/500) next-skill accuracy and 83.4% (417/500) exact matching.
The gap between skill and exact matching highlights errors in target-object selection. In the RoboTwin object-candidate ablation, exact matching rises from 65.74% to 88.89% (+23.15pp), with next-skill accuracy remaining similar (95.24% versus 94.58%). This identifies object-candidate configuration as an effective way to improve exact routing in this test.
Errors in the Judge's completed prefix can change the next routing decision. Our diagnostic pipeline requires three consecutive positive completion judgments before advancing. R4 evaluates how perturbations of these judgments affect acquisition priorities: all three noise seeds preserve the Top-2 at 5% noise, while 10–20% noise affects the second target.