- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper addresses the high cost of adapting robot manipulation policies to new deployment environments. EmbodiRSI builds task-specific simulations from target real-world scenes and performs recursive policy improvement in a Real-to-Sim-to-Real setting. Starting from an initial policy trained with generated demonstrations, the system repeatedly rolls out the current policy, diagnoses its failures, generates corrective trajectories through Collaborative Error Correction, and collects additional demonstrations targeted at weak configurations through Adaptive Data Collection. The accumulated experience is then used to retrain the policy, and the updated policy enters the next improvement round, forming a feedback-driven self-improvement loop. After several simulation rounds, the policy is further refined with a small amount of real-world human-in-the-loop data before deployment. Across two RSI updates, the method improves scene-balanced simulation success from 50.4% to 83.5%, and achieves 83.1% real-world success with 400 simulated trajectories and only 10 real refinement trajectories per subtask.
Critical strengths
- The overall Real-to-Sim-to-Real pipeline is well integrated, combining scene reconstruction, trajectory generation, failure recovery, adaptive data collection, and iterative policy updates.
- Collaborative Error Correction generates supervision from policy-induced imperfect states rather than simply resetting the task, which helps cover states missing from nominal demonstrations.
- The method shows clear gains over static data collection under matched trajectory budgets and is further evaluated on real robots.
Critical weaknesses
- The methodological novelty appears somewhat incremental. Collaborative Error Correction and Adaptive Data Collection build on ideas closely related to prior work on learner-induced-state supervision, failure recovery, and adaptive experience collection, as discussed in the introduction. The main contribution therefore appears to lie in integrating these mechanisms into a unified R2S2R self-improvement pipeline.
- The related-work section discusses several closely related RSI approaches, including SOAR, RECAP, VERITAS, RoboClaw, and RISE, but the experiments do not include external RSI baselines. The main comparisons are limited to Static collection and Real-only adaptation.
- The two core components are not independently ablated, making it difficult to determine how much improvement comes from Collaborative Error Correction, Adaptive Data Collection, or their combination.
- The R0–R2 comparison is confounded by the increasing training-data budget (50/200/400 trajectories per subtask). Although the matched-budget Static comparison partially addresses this issue, it still does not isolate the individual contributions of the RSI components.
- The implementation of several key agents, including the scene agent, trajectory agent, and rollout monitor, is under-specified. The paper states that the overall agent system is based on GPT-5.5, but provides limited details on prompts, tool configurations, and agent-specific decision logic, which may affect reproducibility.
Questions for authors
The following issues should be addressed:
-
It would be helpful to provide separate ablations for Collaborative Error Correction and Adaptive Data Collection to determine how much of the improvement is contributed by each component individually and whether their combination provides additional benefits.
-
The reported improvement from R0 to R2 is accompanied by an increase in the cumulative training budget from 50 to 200 and 400 trajectories per subtask. Therefore, it would be useful to further disentangle the effect of the proposed recursive self-improvement procedure from the effect of simply using more training data. The matched-budget Static comparison partially addresses this concern, but does not fully isolate the contribution of the individual RSI mechanisms.
-
Several key agents, including the scene agent, trajectory agent, and rollout monitor, are described only at a relatively high level. Since the overall agent system is based on GPT-5.5, it would be helpful to provide more details on the prompts, tool interfaces, model roles, and decision logic used by these agents, as these choices may significantly affect reproducibility.
-
The related-work section discusses several closely related recursive self-improvement approaches, such as SOAR, RECAP, VERITAS, RoboClaw, and RISE, while the experimental evaluation mainly compares EmbodiRSI with Static collection and Real-only adaptation. It would be better to include comparisons with stronger external RSI baselines.
-
The current evaluation is limited to three custom tabletop environments constructed by the authors. It would be valuable to evaluate EmbodiRSI on standardized public benchmarks, such as RoboCasa365 or LIBERO-Pro, where applicable, to better assess generalization and facilitate comparison with prior methods. Such experiments would also help demonstrate that the observed gains are not specific to the particular reconstructed scenes and task configurations used in this study.