- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes WEM for long-horizon embodied video generation with interleaved navigation and manipulation. Its main role is to separate world and ego, so scene consistency and instruction following are not entangled in a single generation stream. Authors also build the HTEWorld dataset and benchmark.
Critical strengths
S1. The proposed solution is sound and shows clear potential. Defining world and ego by interaction role (background and unmanipulated objects versus the robot and manipulated objects) is a promising direction for embodied tasks.
S2. The evaluation is thorough. Experiments cover HTEWorld, WorldArena, and real-world DROID, with ablations of the state predictor, SR-MoE, assignment proxies, and Neighbor-Expanded Assignment; the dataset itself—125K training clips and 300 multi-turn trajectories with interleaved navigation-manipulation annotation—is a potential contribution to the community.
Critical weaknesses
W1. Separating controllable from uncontrollable dynamics and ego-motion from object dynamics has precedents in world models and video generation; the contribution here is more a systematic engineering instantiation than a novel principle. The empirical margins are also thin: on WorldArena, WEM's EWMScore is 58.10 versus CogVideoX's 57.90 (+0.20), while action-conditioned Ctrl-World reaches 59.70.
W2. The central claim is not directly proved, and the component it relies on is unreliable. The paper targets interleaved navigation and manipulation, but the real-world evaluation (DROID) covers only tabletop manipulation, so the long-horizon navigation-manipulation setting lacks real-world evidence.
Questions for authors
The paper’s central claim targets interleaved navigation and manipulation, but the real-world evaluation on DROID covers only tabletop manipulation. Could the authors either provide real-world evidence for the long-horizon navigation–manipulation setting?
We thank Reviewer b7C8 for the careful and constructive assessment. We appreciate the reviewer’s recognition of our World-Ego decomposition and the HTEWorld benchmark, as well as the positive assessment of our experimental evaluation. We address the weaknesses (W) and question (Q) below.
W1: Principle Novelty and WorldArena Results.
Principle Novelty. The contribution of this work is to investigate the distinct dynamics of environment evolution and robot interaction in long-horizon tasks with interleaved navigation and manipulation, and to decompose embodied videos into the World and the Ego according to their current interaction roles. We further identify that the two exhibit different conditioning dependencies. Modeling them jointly in a single generation stream makes it difficult to simultaneously maintain scene consistency and instruction following. Therefore, we separately model their evolution to mitigate the entanglement between these different conditioning dependencies.
WorldArena Results. The comparison with CogVideoX (58.10 vs. 57.90) does not isolate the contribution of World-Ego decomposition, as the two methods use different video-generation backbones. To provide a more controlled comparison, we additionally evaluate PAN on WorldArena using the same Wan2.2 backbone as WEM. WEM achieves an EWMScore of 58.10, outperforming PAN (56.65) by 1.45 points. This result further demonstrates the effectiveness of World-Ego decomposition in short-horizon tabletop manipulation tasks.
W2/Q: Real-world Long-horizon Navigation-Manipulation Generation.
To further evaluate the proposed World-Ego decomposition in real-world long-horizon navigation-manipulation generation, we conduct additional experiments on the real-world Galaxea Open-World dataset [1], which contains real-world trajectories involving both navigation and manipulation.
Experimental Setup. We select 3,637 episodes from the Galaxea Open-World dataset, comprising approximately 90K video clips. Following an episode-level split, 3,337 episodes are used for training, while 300 episodes (approximately 6.5K video clips) are held out for testing, with no overlap between the two sets. From the 300 held-out episodes, we construct 500 multi-turn evaluation trajectories, each containing 3–12 instruction rounds and involving both navigation and manipulation, resulting in approximately 5K instruction rounds in total. We compare WEM with PAN [2], using Wan2.2 as the video-generation backbone for both methods. We follow the same training and evaluation protocols as those used for HTEWorld in Appendix B.
Table R1: Results on Galaxea Open-World. PAN and WEM use the Wan2.2 backbone. Higher EWMScore is better.
Results and Analysis. WEM achieves an EWMScore of 57.18, outperforming PAN (53.59) by 3.59 points. These results provide real-world evidence for the effectiveness of the proposed World-Ego decomposition in long-horizon navigation-manipulation generation. We include these additional experiments in Appendix E.3.
We hope these new controlled experiments and clarifications address the concerns and welcome further feedback.
References
[1] Tao Jiang et al. Galaxy Open-World Dataset and G0 Dual-System VLA Model. In 2026 IEEE International Conference on Robotics and Automation (ICRA), pp. 20749–20756, 2026.
[2] Jiannan Xiang et al. PAN: A World Model for General, Interactable, and Long-Horizon World Simulation. arXiv:2511.09057, 2025.