- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
BGDL combines PPO with a demonstration loss whose weights depend on physical margins, required interactions, and predicted failure. It evaluates five humanoid tasks and includes a local theoretical analysis and Unitree G1 trials.
Critical strengths
-
The paper addresses a useful problem: how to use demonstrations more effectively when precision requirements vary across a task. Giving more supervision to critical states is a reasonable design, and the guidance modules add no computation at deployment.
-
The experiments provide credible evidence of the overall improvement. BGDL outperforms random weighting (91.2% vs. 87.8%) with the same total imitation weight, helping distinguish better supervision placement from simply using more imitation. Five training runs per task further strengthen this comparison.
Critical weaknesses
-
Table 5 reports 91.2% success with all cues and 87.0% without the physical-margin cue, but does not state whether total imitation weight is matched. As reported, this comparison does not separate better state selection from a change in supervision strength. The 1.4-point gain over phase shuffling also lacks an interval for the difference, and the within-trajectory control described on page 29 has no clearly identified result. These gaps limit the evidence for the specific state-selection rule, despite the supported overall gain.
-
Two descriptions need clarification. Section 3.1 and the supplied code score raw policy commands in the demonstration loss, while Appendix D.2 says executed actions are used. Figure 2(d) shows tabletop pick-up, whereas Section 4 lists ground pick-up and sitting among the evaluated tasks. The paper should specify the action representation used in the experiments and whether tabletop pick-up was evaluated. I treat both as minor reporting issues.
Questions for authors
-
Could the authors clarify how the method performs when deployed on a real robot, particularly whether the gains observed in simulation carry over to real-world deployment?
-
Was the tabletop pick-up in Figure 2(d) included in the reported experiments, or is it only an illustration? Please clarify its relation to the task list in Section 4.
-
In Table 5, did the all-cue (91.2%) and event-plus-failure (87.0%) variants use the same total imitation weight and reward shaping? If not, could the authors report a comparison with these held fixed to isolate the physical-margin cue’s contribution?
Reminder to respond to the authors’ rebuttal
With one day left in the rebuttal period, please read the authors’ response and leave a comment. It would help the authors to know which of your concerns they have addressed and which questions remain open, so they can make the most of the time left.
Thanks for your time. Your constructive feedback helps the authors improve their work and strengthens the ICLR community.
Best regards,
Area Chair