- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
WorldLine builds an action-conditioned visual simulator through robot-video pretraining, spatial action grounding, and causal distillation. It adapts Cosmos3-Nano on over 10,000 hours of robot video, then uses approximately 2,500 hours of action-labeled trajectories across more than ten embodiments. Image-space action maps, multi-view and failure-enriched training, and relational supervision support interaction prediction. The experiments evaluate AgiBotWorld video prediction, DROID transfer, success classification, and RoboTwin trajectory selection with two policies.
Critical strengths
The paper demonstrates substantial downstream gains with useful controls. At 32 candidates, WorldLine improves RoboTwin success from 58.9% to 78.0% for π0.5 and from 41.0% to 62.4% for LingBot-VLA.
The ablations test the main training choices, and the evaluation includes real failures. Table 3 matches total compute when removing action-free data, supporting the value of additional video coverage beyond longer training. Failure data improve LingBot-VLA selection from 51.6% to 62.4%, while native-action conditioning performs worse for both policies.
Critical weaknesses
The experiments do not isolate the benefit of robot-focused distillation. The causal model delivers a 4.3× speedup but reduces DROID robot IoU from 0.2739 to 0.1986 (Table 2; Section 5.3). A matched causal-student ablation of Equation 8 would establish how much the robot-region and motion losses contribute to preserving robot motion.
The evaluation does not isolate robot–object interaction accuracy. Table 2 measures image fidelity and robot-mask overlap; Table 3 adds planning success but no object-motion or contact metric. The planning gains establish utility, but do not quantify how accurately the model predicts contact transitions and object motion.
Questions for authors
How do the robot-focused distillation losses change robot IoU and planning success relative to the same causal student trained without them, particularly on the tasks with the largest regressions?