- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
KineWorld proposes an action-conditioned world model for robotic manipulation, which improves action-conditioned video prediction through two key components. Kinematic Transport Lifting (KTL) converts robot kinematics into a camera-aligned visual transport field, which serves as a video generation condition to guide the prediction of action-relevant regions. Transport-Aware World Diffusion (TAWD) leverages the transport field to spatially reweight the flow matching loss, encouraging the model to focus more on robot motion regions. Experimental results demonstrate that KineWorld significantly improves action responsiveness and video prediction performance compared with the baseline.
Critical strengths
- The experimental results are reasonably comprehensive, both the ablation studies and comparison experiments validate the effectiveness of the proposed method. The ablation studies separately evaluate the contributions of KTL and TAWD, demonstrating that introducing the robot-motion transport field and the corresponding loss reweighting mechanism can both improve action responsiveness and future video prediction performance. Meanwhile, compared with baselines such as Wan2.2, KineWorld achieves significant improvements across multiple evaluation metrics, demonstrating the effectiveness of the proposed kinematics-guided mechanism for action-conditioned world models.
Critical weaknesses
1.Lack of validation in real-world robotic scenarios. The current method is trained and evaluated entirely on limited simulation data. The proposed framework heavily relies on accurate robot kinematic models, camera calibration information, and the robot foreground transport fields obtained through rendering. However, in real-world robotic environments, factors such as camera vibration, inaccurate intrinsic/extrinsic calibration, and discrepancies between simulated and real robot appearances make it difficult to obtain such precise foreground optical flow information. Therefore, the effectiveness of the proposed method in real-world settings remains unverified, and its generalization ability for practical robot deployment is unclear.
2.Insufficient fairness in experimental comparisons. The comparisons with existing world model approaches may not be fully fair, making it difficult to draw definitive conclusions about the superiority of KineWorld. Different methods are often trained under different robot embodiments and data distributions. For example, Ctrl-World is primarily trained on the Franka robot, while KineWorld is evaluated on the ALOHA–AgileX platform, and there is no unified training and evaluation protocol across methods. Therefore, directly comparing performance across different embodiments may not accurately reflect the relative capabilities of the models, limiting the persuasiveness of the comparison results.
Questions for authors
1.Generalization to Real-World Robotic Scenarios The current experiments are entirely conducted on the RoboTwin 2.0 ALOHA–AgileX simulation dataset. However, KineWorld heavily relies on accurate robot kinematics, camera calibration, and the rendered robot transport field. In real-world settings, factors such as camera motion, calibration errors, and the gap between simulated and real robot appearance may make it difficult to obtain reliable foreground optical flow and transport fields. It would be important to evaluate whether KineWorld can generalize to real robot scenarios. For example, experiments on real robot platforms or robustness analysis under different levels of calibration and perception errors would help demonstrate whether the proposed transport field remains reliable beyond simulation. 2.Fairness of Experimental Comparisons The comparison with existing world models is not entirely convincing because different methods are evaluated under different robot embodiments and data distributions. For example, Ctrl-World is mainly developed for the Franka robot, while KineWorld is evaluated on ALOHA–AgileX. Therefore, the performance differences may partly come from the choice of embodiment and dataset rather than the proposed method itself. A more meaningful comparison would be against action-conditioned world models trained on the same embodiment. Without such comparisons, it is difficult to isolate the actual contribution of KineWorld from the influence of different robot platforms and datasets. 3.Limited Improvement in Interaction Modeling Both KTL and TAWD derive their supervision signals from the robot-induced transport field. Therefore, the proposed method mainly emphasizes regions corresponding to robot motion. However, in manipulation tasks, successful execution depends more fundamentally on the interaction between the robot and the environment, including object motion, contact dynamics, and physical constraints. It remains unclear whether the robot transport field is a sufficient proxy for interaction-relevant regions. For tasks such as pushing, pulling, or grasping, object motion may be more important than robot motion itself. Additional analysis with object-motion-aware or contact-aware signals would help verify whether KineWorld truly improves interaction modeling rather than only improving robot motion prediction. 4.Definition of World Action Model The paper refers to KineWorld as a World Action Model (WAM), but the proposed method mainly focuses on action-conditioned future video prediction. It does not explicitly address action generation, planning, policy optimization, or closed-loop decision making, which are commonly associated with WAMs. The authors should clarify the distinction between KineWorld, action-conditioned world models, and World Action Models.
Dear Reviewer opjZ,
Please respond to the author soon and engage in the discussion.
Best,
AC