- Rating
- 4
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
In this work, the authors show how human demonstrations of failure recovery can effectively improve robot recovery behavior. To do so, the authors introduce EgoRecovery, a co-training framework that bridges the gap between the human and robot embodiment. The method jointly uses human and robot recovery data by using the "corrective intent" of the recovery behavior, which contains the timing and magnitude of the necessary correction. This shared target space and encoding, together with separate action decoder models, are used to successfully leverage the information and diversity represented in the human recovery data.
In summary, the paper presents two components:
- a corrective intent policy learning setup that leverages human recovery demonstrations to improve robot recovery behavior.
- a gated intent modulation component that decides when a recovery is necessary.
Overall, the paper presents a clear idea that addresses how to effectively use human recovery demonstrations to learn better robot recovery. The results are clear and exciting. I enjoyed reading this work and recommend accepting it.
Critical strengths
-
The paper addresses a timely problem; teleoperation data for recovery is sparse and difficult to obtain. The authors show that collecting human recovery demonstrations scales by 10x, and that their method, EgoRecovery, can successfully extract and learn from this information despite the embodiment gap.
-
In general, the paper is well structured, and the ideas are presented cleanly and intuitively. The results are convincing, and the website very nicely shows video results.
-
Using the gated intent mechanism is a clever idea to guide the supervision signal.
-
The authors show results across four tabletop manipulation tasks and two systems, Aloha dual-arm and Franka Panda arm.
Critical weaknesses
I don't see critical weaknesses. In the appendix, the tables could be better structured, and a more detailed explanation could improve understanding of the results and findings.
Questions for authors
-
I would like to see the system in action during the closed-loop rollouts: what labels are predicted, when do they switch, etc.
-
The results show that some robot recovery data is required. The evaluation only varies human recovery data (or both at the same time); it would be interesting to see how success rates change when only the amount of robot recovery data changes. Did the human recovery data reduce the significance of robot recovery data in any way?
-
I dont quite understand why the authors never evaluate using all four data mixes (Robot success, Robot Recovery, Human success, Human recovery).