- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
World models learned from camera images are now a practical basis for planning and control. The authors argue that they are mostly tested on systems driven by the agent's own actions, and that training them stably does not guarantee they recover the system's true state or dynamics. The paper aims for "mechanistic" world models: ones that control well, reproduce the true dynamics over long horizons, and let the governing equations be read out. It builds on representation-learning objectives that are known to recover the true state under idealized conditions.
The proposed framework, world2vec, trains an image encoder together with a small network that models how the encoded state changes over time, as a differential equation; the training objective and the form of the dynamics model are treated as interchangeable choices. It learns offline from random-action data by rolling predictions forward many steps and matching the encodings of later frames. On three simple simulated control tasks, this makes the model's predictions agree with its own future encodings far better than established world models do. The authors report state-of-the-art control: planning towards an encoded goal image matches or beats the strongest baselines on two of the three tasks and trails them on the third. With a sparse polynomial dynamics model, the authors also apply the approach to 71 chaotic systems whose states are passed through a random nonlinear transformation into 50 dimensions. They show one example where near-correct equations are read off after aligning the learned coordinates to the true state.
Critical strengths
-
Clear ablation of training horizon and dynamics form (Tables 2–3). Two choices both help:
- training to predict 20–40 steps ahead instead of one;
- modelling the latent as changing continuously (an ODE) rather than predicting the next state directly.
The gains also show in a measure the method is not trained on: decoding the true simulator state from the latent. With the contrastive objective, this rises from 93% to 98% R² on Pendulum and from 71% to 94% on Reacher. This is the paper's most trustworthy and transferable result.
Critical weaknesses
- The main evidence that world2vec models the world better is a score it is trained to maximize, and the baselines are evaluated under different conditions (Sec. 5, Table 1, App. A, D.1).
- The headline "equivariance" scores measure how well the model's predictions match its own encoder's encodings of later frames. The training loss (Eq. 7) minimizes exactly this gap over horizons covering the 1 s evaluation, and the baselines' losses do not. World2vec should therefore score higher whether or not its latent captures the true state.
- The same score picks the best of 90–141 trained models per row. Results are reported on the validation episodes used for that choice, and the test episodes go unused (Sec. 4).
- The baselines are scored on different episodes than world2vec, and LeWM uses larger images and a modified planner. LeWM's rewards (1 on Pendulum, 48 on Reacher) contradict the 81.5% Reacher success of the authors' own reproduction (App. D.1), which suggests the baseline is broken here.
- Three of the six world2vec rewards behind "state-of-the-art control" come from the only one of three trained models whose planner worked (Table 1, footnote a). On Cartpole, world2vec gets ~300 against ~900 for DreamerV3 and TD-MPC2.
- True-state decoding is the one measure that does not depend on the model's own encoder, and it is not reported for the baselines.
- The result that does hold, that training on multi-step predictions helps (Tables 2–3), is already standard practice: TD-MPC2 (one of the baselines) and SPR train their latents to predict several steps ahead, and the method builds directly on dynamics contrastive learning. Without a comparison at matched data and prediction horizon, it is unclear what world2vec adds.
- The experiments do not test the paper's motivating claims: systems that evolve on their own, and equation discovery (Abstract, Secs. 1, 5–7, App. I).
- The paper motivates itself with systems whose dynamics are not driven by the agent, and claims to be "first ... to control systems with autonomous dynamics" (Sec. 7). Yet control is tested only on the baselines' three standard DeepMind Control tasks.
- The abstract claims the true state is recovered from nonlinearly distorted observations. Fig. 4 never measures how well the true state can be decoded, only agreement between runs and self-prediction.
- Equations are shown for only one of the 71 chaotic systems (SprottA), picked by the authors. Obtaining them required:
- a linear map fitted to the true states;
- zeroing small coefficients;
- the known maximum polynomial degree.
- The true states are unavailable in practice, as the authors note (Sec. 6), so this is not equation discovery from observations alone.
- In these equation experiments, the encoder is trained with one-step prediction (App. I.1), not the multi-step training the paper calls its key ingredient.
- The submission reads as an unfinished draft. A figure caption still contains an editing note ("Figure edit: relabel LRC as Equiv. R²", Fig. 6), two appendices are empty (G.10, H), and the "Baseline" row of Table 1 is never defined in the main text. The main-text table captions are mostly seed and model-selection bookkeeping (e.g. "Only one of three model seeds planned (a: seed 42, b: seed 789)") rather than what the tables show.
Questions for authors
-
(Weakness 1: evaluation metric and baselines) Please evaluate every method on the same held-out test episodes, at the same image resolution, on measures world2vec is neither trained nor selected on:
- how well a simple decoder recovers the true simulator state from each method's latent;
- control reward averaged over all trained models, with failed runs counted.
If world2vec still recovers the state clearly better than DreamerV3, TD-MPC2 and LeWM and matches their rewards across all models, the "better world model" and "state-of-the-art control" claims would stand. If not, its advantage reflects optimizing its own score.
-
(Weakness 1: is the gain specific to world2vec?) The paper credits most of its gain to training on 20–40-step predictions, and TD-MPC2 and SPR already train latents to predict several steps ahead. Trained on the same offline random-action data with the same long prediction horizon, does TD-MPC2 or LeWM match world2vec? Does world2vec keep its advantage when trained on the baselines' dataset, where its reward falls to about 179 (Table 5)? If either answer goes against world2vec, the contribution reduces to a known training choice.
-
(Weakness 2: state and equation recovery without the true state) On how many of the 71 chaotic systems do the recovered equations contain exactly the correct terms, without using the true states to align coordinates (for example, by choosing the alignment that makes the equations sparsest, as in Muratore & Mathis, 2026)? In the distorted-observation experiment (Fig. 4), how much of the true state can a linear map recover from the latent at each distortion depth? Equation recovery on a substantial fraction of systems without access to the true states would support the scientific-discovery claim. Otherwise it remains a single supervised demonstration.
-
(Weakness 2: framing around systems that evolve on their own) Pendulum, reacher and cart-pole are the same tasks the baselines already solve. What evidence supports the claim to be "first ... to control systems with autonomous dynamics"? Can you show a task with strong dynamics not driven by the agent where world2vec succeeds and the baselines fail? Without it, the paper's stated motivation is not addressed by its experiments.
We thank the reviewer for the very thorough review and the concrete suggestions. Changes are incorporated in the revised PDF, with the main changes highlighted in blue (see also the general response).
W1. Evaluation metric, model selection and baselines
Self-referential metrics (Q1). Following the reviewer's suggestion, we added Physical Rollout Consistency (PRC): an MLP probe is fit to decode the true state from encoded latents and then applied unchanged to the predicted latents. PRC is used only for evaluation, never for training or model selection. At 1 s, world2vec-dcl reaches 94.3% PRC, compared with 23–54% for DreamerV3, TD-MPC2 and LeWM, on the same held-out test episodes (Table 1).
Model selection and test episodes (Q1). Hyperparameters are selected on validation EQA, and all metrics (including PRC) are now reported on the held-out test split, which is the same for all models. Planners are selected on 25 validation episodes, and rewards are reported on 25 disjoint test episodes.
Single-seed rewards (Q1). Every cell in Table 1 now reports mean ± bootstrap SE over model seeds, with failed runs included. After fixing a data-collection bug in CartPole (the cart (with the pole) left the camera viewin about 16% of frames), world2vec-dcl solves all three tasks (836 / 897 / 769; CartPole was ~300 before).
LeWM rewards vs. the 81.5% Reacher success. The two numbers measure different things. Our reward is the dm_control return over a full episode (maximum return 1000) toward a target, whereas LeWM's protocol measures success at reaching a recorded goal frame only 25 steps ahead within a fixed budget, which is a much easier task. We now report both (Table 2): under LeWM's protocol, LeWM reaches 81.6% success, and world2vec matches it 25 steps ahead (86.2%) and clearly outperforms it 200 steps ahead (80.2 vs. 52.9%), while planning 3–8x faster.
Is the gain specific to world2vec? (Q2) We do not claim that multi-step prediction is new. Our controlled ablations (Tables 3–4) keep data, architecture and evaluation fixed and change only the training horizon and the dynamics parameterization. Our one-step SIGReg baseline is effectively LeWM, and extending it to a 20–40-step rollout with an Euler-integrated vector field is what makes it solve Pendulum and Reacher; with the DCL regularizer, the same change also solves CartPole. TD-MPC2 also trains multi-step latent consistency, but its objective requires reward and value prediction, so it cannot be trained in the reward-free setting; world2vec shows that the same principle works without any reward signal.
W2. Autonomous dynamics and equation discovery
Autonomous dynamics (Q4). By "autonomous dynamics" we mean environments whose state evolves even without actions, as in Pendulum and CartPole, where gravity drives the system. This is where world2vec's gains in rollout consistency are largest (Fig. 3), and where reward-free baselines fail: LeWM stays low, and our one-step baselines reach at most 199, while world2vec reaches 836 and 769. Under nonlinear mixing of the CartPole state, world2vec still solves the task (~700–850 reward), while the baselines fall to about 200–330 from two mixing layers on (Fig. 6). The claim is restricted to reward- and reconstruction-free models, which we now state explicitly in the conclusion. Reward-based methods like TD-MPC2 also solve these tasks, but use the task reward.
State recovery. Table 1 now reports State R², the R² of an MLP probe that decodes the true simulator state from each method's encoded latents, for all methods on the same held-out test episodes. All methods encode the state well (world2vec-dcl 96.0%, DreamerV3 98.4%, TD-MPC2 99.2%, LeWM 99.7%). The difference lies in the dynamics: decoded from predicted latents after 1 s (PRC), the state is preserved for world2vec-dcl (94.3%) but not for the baselines (23–54%).
Equation discovery (Q3). Equation discovery no longer uses the true states. We now train with multi-step prediction (K ∈ {10, 20, 40}, App. G) and find the affine change of coordinates in which the learned SINDy model is sparsest, following DYSCO (Muratore & Mathis, 2026). The number of terms is chosen from validation LRC alone. Across all 71 systems at α = 0.5, this recovers exactly the correct terms with correct signs for 9 systems (12%) fully unsupervised; 3 of those are in the original dysts axes and the rest are exact affine rewrites. If the number of terms is known, 28% are recovered (Fig. 8c). Ground truth is used only for scoring and for aligning the displayed equations. All 70 systems with a sparse model are listed in STab. 6, and each system is shown as flow fields in SFigs. 4–9. We still assume the polynomial degree is known.
W3. Presentation
Thank you for pointing these out. We have greatly improved the presentation of the paper, and hope the reviewer will find it more clear and informative.