- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes WorldPrior, a training-only adaptation framework for internalizing multimodal semantics in latent world models. Its cosine semantic distillation objective aligns intermediate predictor states with multimodal semantic representations through trainable projections, while reference-predictor retention constrains deviations from the original predictive function. Experiments show that applying WorldPrior to V-JEPA2 improves performance on EgoDex and EgoPAT3D.
Critical strengths
- Deployment efficiency. WorldPrior addresses the inference overhead associated with VLM-guided world modeling by incorporating multimodal semantic supervision only during training. The auxiliary branches are removed at deployment.
- Evaluation across multiple benchmarks and backbones. The evaluation covers three backbones (V-JEPA2, LeWM, and DINO-WM) and two benchmarks (EgoDex and EgoPAT3D) providing a broader assessment of the framework’s applicability.
Critical weaknesses
- Limited novelty. ThinkJEPA has demonstrated the utility of VLM-derived representations for JEPA-style prediction, which is closely related to WorldPrior’s use of multimodal semantic supervision.
Questions for authors
Please see the weaknesses above.