- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper studies the question of understanding the quality of world models. The authors argue that looking at the world model's agent score or reward alone is not sufficient to judge whether the world model accurately models the underlying environment. Instead, the authors propose to explicitly measure the faithfulness of world models. The authors propose two main metrics to assess the faithfulness: 1) latent rollout consistency (LRC) which is the coefficient of determination (R^2) between the distribution of encoded observations (with history of length h) into latents and the distribution of predicted latents after h prediction steps. 2) the ground-truth decoding quality. The motivation behind that is that LRC cannot capture collapsed latent vectors for which the correlation would be perfect.
The authors conduct a controlled study in three different environments (pendulum, cartpole and reacher) testing three different world model types (DreamerV3, TD-MPC2 and LeWM) from both pixel and state inputs. The authors find that none of the world models can model the underlying dynamics faithfully despite they work well for control. Throughout a series of studies the authors identify gaps in the baseline models.
Critical strengths
- The authors study an important problem of whether the learned dynamics of world models is accurate.
- The authors intentionally use simple and interpretable environments to make interpretable judgments about world models.
- The authors present an in depth analysis of different aspects of world model faithfulness.
Critical weaknesses
- poor motivation of the LRC metric. Despite this is a central part of the contribution, the paper presents only a very short justification of the metric choice. This is, in my opinion, an important missing point as it makes understanding of next sections much harder. The authors should add a more in-depth discussion that justifies the choice of it. For example, a simple L2 distance could be an alternative or a more advances distributional distance (for example, batch-wasserstein).
- Specifically the authors should justify why does this metric provides a normalization (between 0 and 1) such that a fixed level of it means the same level of faithfulness (or not) regardless of other factors such as the dimensionality of the latent. Given that the authors use different latent dimensionality for different observation types and different models, this can be a confounding factor.
- The space of tasks is a bit too small. I would agrue that tasks like ant or hopper are simple too since they are significantly more simple that dexterous manipulation for example. Those tasks (ant or hopper) could have been studied in this work too.
- The writing makes a few parts of the paper a bit hard to follow.
I think that these weaknesses are not fatal and they can be addressed in during the rebuttal.
Questions for authors
- minor error: Line 118 – I think the authors meant SIGReg instead of reconstruction loss.
- why LeWM performs better on states and barely works on pixels? that model was originally proposed for pixel observations.
2 comments
Thank you for the detailed feedback. My concerns are resolved now. I will reflect the rebuttal and my resolved concerns in my final assessment.
We thank the reviewer for the positive review, and we agree that the weaknesses raised can be addressed. We have updated the manuscript (changes highlighted in blue) with new validation experiments and clarifications addressing each of your points.
Motivation and validation of LRC (W1/W2).
We agree that LRC needed a stronger motivation in the paper, which we also discussed with reviewer VtU7. We added Appendix B.1 and B.2 where we validate LRC against state prediction in physical space and comparing the R2 in LRC it with L2 and cosine similarity.
Validation in physical space (Appendix B.2). We introduce physical rollout consistency (PRC), which decodes each predicted latent with the frozen state probes and computes R2 against the true simulator state. PRC is computed in the same physical coordinates for every model, so it does not depend on latent dimensionality or scale. LRC and PRC are strongly correlated (ρ=0.81, p=2.53×10−46, n=196, Fig. 12), and the main results are unchanged when PRC replaces LRC (Fig. 13). PRC needs the ground-truth state and an accurate probe, so we keep LRC as the primary metric and use PRC as a check.
Choice of R2 (Appendix B.1–B.2). Variance-weighted R2 normalizes prediction error by target variance, giving a fixed scale across latent dimensionalities (1 is perfect prediction, 0 corresponds to predicting the mean) and invariance to translations, global rescaling, and orthogonal transformations. In Appendix B.2, LRC, cosine similarity, and L2 distance all correlate well with PRC (ρ=0.81, 0.78, and 0.71; Fig. 14). However, raw L2 distance lies on an arbitrary model-specific scale and grows with latent dimensionality, and cosine similarity has no fixed reference point.
Adding new environments (W3).
We chose three simple systems on purpose, because they let us compare each model against the true state and dynamics, and our claims are counterexamples to the assumption that high reward implies an accurate model. However, we agree that expanding the range of tasks helps show how far these failure modes extend. We added Appendix H (Fig. 27; also referenced in Section 5.1), evaluating the 317M-parameter multi-task TD-MPC2 model trained from states across 30 DMControl tasks spanning 11 environments (including locomotion tasks such as hopper and walker). Our core finding holds: task reward and LRC remain uncorrelated across the 30 tasks (Spearman ρ=−0.11, p=0.56), with many locomotion tasks reaching almost perfect reward despite very low LRC.
Clarity of writing (W4).
We revised the theoretical formulation and Definition 1 in Section 2, clarified the LRC evaluation protocol in Section 4.2, and added self-contained details on LRC computation and validation (Appendix B.1–B.2) and own-policy trajectory evaluation (Appendix C). If specific passages were still hard to follow, please let us know and we will gladly revise them.
Answer to Questions:
Q1: Line 118. Thank you for catching this. The sentence now lists SIGReg regularization separately from reconstruction losses.
Q2: Why does LeWM work from states but barely from pixels? Our pixel LeWM matches the original results under their original evaluation protocol (Fig. 20). The original evaluation is goal reaching, where the model must reach a goal state that is close to the start state. Our tasks are more complex (e.g. reach over longer distances, swing-up) with nontrivial unforced dynamics. Solving them requires accurately predicting how positions and velocities evolve over many steps, where pixel-based LeWM breaks down.
We hope these additions address your concerns, and we would be glad to discuss any remaining points.