- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
MORE learns compact, motion-conditioned register tokens during video pretraining and reuses them for driving world modeling and planning. The method builds on V-JEPA and introduces two complementary objectives: predicting masked patch features using only register tokens as context, and predicting masked register features. During downstream training, a world model predicts future registers, which are combined with observed registers to generate and score candidate trajectories.
The paper reports 92.5 EPDMS on NAVSIM-v2 and 93.2 PDMS on NAVSIM-v1, together with zero-shot closed-loop results on 436 HUGSIM scenarios. Ablations examine motion conditioning, the pretraining objectives, future-state prediction, and the number of registers. The reported inference latency is 110 ms on a single RTX 4090.
Critical strengths
The paper makes a convincing case for training the registers during pretraining. Table 4 shows that simply adding registers has little effect. The larger improvement comes from making them the only source of context for masked patch prediction: EPDMS rises from 85.6 to 88.5. Register masking and motion conditioning bring further gains. This is a useful finding because it shows how to make a compact representation retain information that matters for planning.
The approach performs well across several evaluations. MORE achieves strong aggregate results on both NAVSIM versions, and the closed-loop HUGSIM evaluation provides additional evidence that the method remains useful when its actions affect later observations. The reported latency of 110 ms also makes the approach practically interesting. Taken together, these results support the value of using the same compact representation for prediction and planning.
Critical weaknesses
It is still unclear how much the future-prediction objective contributes. In Table 4, removing future prediction reduces EPDMS from 91.8 to 91.1. However, this also removes the predicted tokens from the planner’s memory, so the comparison changes more than the prediction objective. The gain could come partly from the extra computation or memory available to the planner. A comparison that keeps those tokens but removes their future-state supervision would make the contribution clearer. This matters because learning a state space suited to future prediction is a central claim of the paper.
Some conclusions are stronger than the evidence supports. The paper does not report variation across training runs, so it is difficult to judge the smaller gains in the ablations. The HUGSIM results also deserve a more balanced discussion: MORE has the best average scores, but its advantage is concentrated in Easy and Medium scenarios. It does not lead on Hard or Extreme scenarios, and its Extreme HD-Score is 11.1, compared with 18.1 for Latent-WAM. The overall results are encouraging, but they provide less support for robustness in the most difficult settings.
Questions for authors
-
Could you keep the future tokens in the planner but train them only with the planning losses, without the future-prediction loss? This would help show whether the improvement comes from predicting future states or simply from adding more tokens and computation.
-
How well does the model predict future registers on unseen data, and how does accuracy change when predicting further ahead? Does it perform better than simply keeping the current registers unchanged? Since each variant learns different representations, please use the same evaluation method to make the comparison fair.
-
Can you report variation across training seeds for the full model and the key ablations?
-
Please specify the patch and register masking ratios, block-sampling rules, and downstream world-model architecture for reproducibility.