- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper asks when decisions made inside a world model still hold up when they are used in the real environment. The authors create a theory on how to evaluate this. Experiments are conducted on small-scale custom-built environments combined with custom model architectures.
Critical strengths
- The paper's general idea is worth considering.
- The reproducibility material and appendix is extensive (checkpoints, code, seeds, etc.)
Critical weaknesses
-
The paper is very hard to follow. Very abstract and complicated written. Without considering experiments/results at this point, in the current form this paper is not appropriate for publication, because of the used terminology and writing style. In terms of terminology it gets very confusing. To name a few, what is "command-consequence correspondence", "legal causal policy", "model substitution discrepancy", "post-action physical response", "physical noise floor", "probing consequential comparisons", "admissible control continuations", "A useful starting bank makes errors that displace its incumbent consequential.", "relevant control continuations"? This is far outside the scope of world models / model-based RL literature/terminology and a major concern.
-
The authors motivate the paper with Genie, Cosmos, V-JEPA 2 and DreamerV4, but no experiment touches a model like this, or any established world-model in the size of like ("Dreamerv2", "LeWorldModel", "TD-MPC2", "PlaNet", "World Models"), nor any real-robot data. Given the evidence, their theory is not tested under realistic settings and the title, framed as a question, is therefore not substantially answered.
-
The paper does not use any known or standard datasets that related methods consider. The data and all environments are generated by the authors which are tabular, small grid or custom 2D environments. These experimental results provide no anchor to ground their work in the broader literature.
References:
- Hafner, Danijar, et al. "Mastering atari with discrete world models." arXiv preprint arXiv:2010.02193 (2020).
- Maes, Lucas, et al. "Leworldmodel: Stable end-to-end joint-embedding predictive architecture from pixels." arXiv preprint arXiv:2603.19312 (2026).
- Hansen, Nick, Hao Su, and Xiaolong Wang. "Td-mpc2: Scalable, robust world models for continuous control." International Conference on Learning Representations. Vol. 2024. 2024.
- Hafner, Danijar, et al. "Learning latent dynamics for planning from pixels." International conference on machine learning. PMLR, 2019.
- Ha, David, and Jürgen Schmidhuber. "World models." arXiv preprint arXiv:1803.10122 2.3 (2018)
Questions for authors
- Which of Theorems 1-3 do you consider novel?