acceptodds
Under review as a conference paper at ICLR 2027

MEND: Measuring and Constraining Latent Dynamics in World Models

Abstract

World models used for planning and simulation must preserve dynamics under repeated prediction. In joint-embedding predictive architectures (JEPAs), one-step accuracy does not ensure this behavior. We formulate latent prediction as an approximate semi-conjugacy. In the linear-symplectic setting, this relates dimensional collapse to encoder rank and prediction drift to predictor spectrum. MEND measures frequency, instability, and contraction in latent trajectories and uses these measurements to constrain a new predictor while keeping the encoder frozen. An orbit-averaged log-determinant separates physical dissipation from least-squares attenuation. An autonomously iterated V-JEPA 2 predictor has at least 12 positive finite-time Lyapunov exponents and loses an oscillator signal within to steps, while the encoder retains it. On a real pendulum video, MEND constrains a conformal-symplectic predictor in a two-dimensional observable. It extends the open-loop horizon from 21 to 651 steps (0.6 to 18.4 periods), approximately 31 times, while following the observed decay. These results support video-based system identification and prediction of mechanical motion using frozen representations. Extending the constraints to action-conditioned world models could support longer-horizon planning and control.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.