- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
ThinkWorld learns a shared motion-token representation from human and robot data, then uses agreement between predicted and observed future features as a GRPO reward to refine the VLM. The trained VLM supports continuous action generation, while motion-token generation and future prediction are not required at deployment.
Critical strengths
-
The method offers an interesting way to use videos without action annotations, combining motion supervision with feedback from observed future states.
-
The real-world generalization results are encouraging. The future-feature visualizations and CoD perturbation experiments provide evidence that the motion tokens help predict relevant scene changes.
-
The additional prediction branches are used only during training, avoiding their generation overhead during robot execution.
Critical weaknesses
-
Stronger direct comparisons are needed. I would like to see comparisons with π₀.₅ and Fast-WAM under matched downstream settings, particularly on real robots. Please also report training GPU-hours, including the additional GRPO cost, and inference latency and memory on the same hardware.
-
The cross-embodiment analysis needs more evidence. The t-SNE plot appears to contain relatively few samples, and the sample count and selection procedure are unclear. Quantitative cross-embodiment retrieval or motion-classification results would make the alignment claim more convincing.
-
The contribution of CoD and GRPO needs clearer isolation. Please clarify how CoD differs from existing shared or latent action representations, and separately evaluate the benefit of human videos. Since GRPO adds only 1.2 percentage points in the reported ablation, a comparison with continued future-prediction training using the same data and a comparable compute budget would be useful.
Questions for authors
Please see the above weaknesses.
3 comments
Thanks for the authors' rebuttal and my questions have been solved. I will retain my positive score.
We are glad that our response has addressed your concerns, and we sincerely thank you for your thoughtful review and engagement.
Response to Reviewer JpiN
We thank the reviewer for the constructive feedback. We summarize the additional experimental results in the general response and address each point below. Changes addressing your comments are marked in purple in the revised manuscript.
[W1] Comparison with π0.5 and Fast-WAM; training and inference cost → Figs. 1, 3; Tabs. 5, 6, 9, 10
We have added real-robot comparisons with π0.5 and Fast-WAM. Since their released checkpoints were not trained on YAM data, we first adapt both baselines on MolmoAct2-BimanualYAM, then fine-tune them on the same task-specific robot demonstrations as ThinkWorld, with the same amount of task data. All methods use the same evaluation hardware and control settings. ThinkWorld achieves the highest OOD success and outperforms π0.5 overall, with fewer parameters and no proprietary robot pretraining data.
Inference latency and peak memory are measured on the same RTX 3090 GPU at batch size 1.
In addition, RL accounts for only 4.2% of the total pretraining compute. Since CoD is used only during training, ThinkWorld incurs no inference-time reasoning overhead and runs faster than MolmoAct2.
[W2] Cross-embodiment analysis on CoD space beyond t-SNE → Sec. 4.5 (Tab. 13); App. C.6 (Tab. 14, Fig. 15)
In our submission, Fig. 6 visualizes randomly selected post-CoD
</think>representations from human and robot datasets, colored by motion direction.We have added motion-classification and retrieval evaluations in Sec. 4.5 and App. C.6 (Tabs. 13–14), using 2,398 windows from EgoDex, YAM, and RoboCOIN with four motion directions. With frozen representations, a linear probe trains on two sources and tests on the third; retrieval searches only the other sources.
<think>before CoD</think>after empty CoD</think>after CoDPost-CoD representations perform best on every held-out source and in retrieval, supporting transferable motion information across embodiments. Fig. 15 further shows shared motion-direction structure in a subspace learned from human videos, with some dataset-specific structure remaining.
[W3] Contributions of CoD, human videos, and GRPO → Fig. 14; Tabs. 11-12
(1) CoD vs. latent actions. As described in lines 196–202, CoD represents human and robot trajectories as FAST-style motion tokens generated autoregressively by the VLM. Unlike pixel-derived latent actions such as LAPA [1] and UniVLA [2], CoD serves as a shared reasoning sequence whose generation is refined by comparing imagined consequences with observed futures.
(2) Benefit of human videos. With robot data fixed, we vary the human-video share in SFT and apply the same RL stage (Fig. 14). Results below report LIBERO-PRO average success.
Human videos improve performance beyond the robot-only control with the same amount of data, and RL improves every variant. On real-robot skill composition, adding human videos raises success from 3/20 to 13/20 with identical robot demonstrations and instructions (Tab. 12), providing full-sequence supervision absent from the atomic robot data.
(3) GRPO vs. continued training. Starting from the same SFT checkpoint and using the same data, we compare 2k additional iterations of continued SFT with future prediction against GRPO (Tab. 11). Continued SFT lowers performance, while GRPO consistently improves it across seeds.
We are happy to discuss any remaining questions.
[1] Latent Action Pretraining from Videos, ICLR 2025
[2] UniVLA: Learning to Act Anywhere with Task-centric Latent Actions, RSS 2025