- Rating
- 4
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies how to use a world model for robot planning. A world model can predict the outcome of candidate actions, but the robot still needs a way to judge which predicted outcome is closer to the goal. RoboCTR addresses this by training a reward model that scores predicted trajectories using the available goal information, such as text instructions, goal images, or demonstration videos.
The authors first train this reward model on robot demonstrations, then use it to guide the world-model predictor and to rank candidate action sequences during MPC. They also introduce RoboTrain, an eight-task simulation dataset. On seven RoboTwin2 Easy tasks, RoboCTR reports 84.3% average success versus 79.7% for π0, and provides qualitative demonstrations on an ALOHA dual-arm platform.
Critical strengths
-
S1. The shared reward interface is coherent and intuitive. Using one goal-conditioned critic both to shape the world-model predictor and to rank MPC candidates provides a clean connection between training and planning. Supporting text, goal images, and demonstration videos within the same interface is also practically appealing.
-
S2. The paper reports encouraging simulation results and broad design studies. RoboCTR improves over π0 on four of the seven reported tasks, including gains of 15 and 22 percentage points on Pick Dual Bottles and Place Object Basket. The experiments also cover training stages, reward interfaces, goal modalities, task decomposition, and planning/guidance weights.
Critical weaknesses
W1. The progress score may not reflect real progress toward success. Equation 5 assigns higher scores to later frames in a successful window, but being later in time does not necessarily mean the robot is closer to completing the task. This leaves a gap between the learned score and actual task progress.
Questions for authors
- Table 5 arithmetic. The Default row reports 84.3%, but the deltas are computed against 82.7%; for example, 74.1% is listed as −8.6 instead of −10.2. Please correct the table.
Reminder to respond to the authors’ rebuttal
With one day left in the rebuttal period, please read the authors’ response and leave a comment. It would help the authors to know which of your concerns they have addressed and which questions remain open, so they can make the most of the time left.
Thanks for your time. Your constructive feedback helps the authors improve their work and strengthens the ICLR community.
Best regards,
Area Chair