- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates whether JEPA world models preserve the information needed to stabilize unstable systems. The authors show that standard prediction objectives and anti-collapse regularization may fail to preserve unstable modes. To address this issue, they propose Endpoint Inverse Dynamics (EP-IDM), which reconstructs action sequences from the initial and final latent states. The paper provides theoretical guarantees for linear systems and evaluates the method on CartPole, Walker2D, and PointMaze, showing improvements in latent-LQR stabilization and the preservation of walking dynamics.
Critical strengths
-
A meaningful distinction between predictive accuracy and suitability for feedback control. The paper identifies a specific and consequential failure mode: a representation can remain non-collapsed and support accurate latent prediction while discarding the unstable modes needed for stabilization. The linear counterexample demonstrates that prediction and SIGReg can simultaneously attain their minima without preserving these modes. This is a substantive conceptual contribution because it exposes a limitation of the training objectives themselves, rather than merely documenting an optimization failure or insufficient model capacity.
-
A principled intervention supported by targeted control diagnostics. EP-IDM provides a simple, control-motivated training objective, and the exact-reconstruction result connects it to the preservation of finite-horizon reachable directions. The CartPole evaluation goes beyond aggregate success rates by examining local dynamics, empirical regions of attraction, and Lyapunov-function changes. Together, these results provide useful evidence that action reconstruction can improve the suitability of learned models for local feedback control, even though the broader interpretation requires further validation.
Critical weaknesses
-
The experiments do not sufficiently establish the proposed mechanism or its broader applicability. Although three tasks are evaluated, CartPole provides most of the direct evidence for nonlinear stabilization. LQR failure alone does not establish that the encoder has lost unstable information; inaccurate local dynamics could also explain the failure, especially since the SIGReg models perform well with CEM and GBP. The Walker2D results mainly show SAC-driven trajectories within the learned model, which may reflect better fitting of familiar walking trajectories rather than accurate recovery dynamics after disturbances. PointMaze does not test unstable dynamics. Consequently, the evidence for unstable-mode preservation beyond the CartPole setting remains limited.
-
A substantial gap remains between the theoretical guarantee and practical training. Theorem 1 requires exact action reconstruction, sufficiently rich action excitation, and restrictive dimensionality conditions. In practice, EP-IDM is used as a soft objective without requiring zero reconstruction error. Different action sequences can also produce identical endpoints, making exact recovery impossible in some settings even without representation compression. The paper does not establish when reducing an approximate reconstruction loss reliably preserves unstable information. This weakens the connection between the theoretical result and the practical method.
Questions for authors
-
What evidence distinguishes unstable information being lost in the encoder from inaccurate local dynamics in the predictor? Can the SIGReg representation support stabilization after refitting the predictor while keeping the encoder fixed?
-
Could the Walker2D evaluation include a mid-rollout perturbation and compare the predicted recovery with the corresponding MuJoCo recovery under the same SAC policy? This would help distinguish accurate recovery dynamics from simply reproducing a normal gait.
-
Which experimental settings satisfy the feasibility and action-excitation conditions of Theorem 1? When reconstruction error is nonzero, what evidence connects a lower EP-IDM loss to better preservation of unstable information?
-
Which physical-state variables are provided as proprioceptive inputs? Do the available vision-only, proprioception-only, and combined-input results establish whether the improvement comes from better visual representations or from the supplied state information?
4 comments
Point-to-point response to Reviewer NV9j (2/2)
3. Feasibility, excitation, and approximate reconstruction (Weakness 2, Question 3).
When different action sequences produce identical endpoints, our nonzero-loss extension (in the general response) compares reconstruction with the unavoidable physical-endpoint loss. Distinct action sequences share a physical endpoint when their difference lies in . These differences produce no endpoint displacement and cannot be recovered even from the full physical state. Therefore, matching the optimal physical-endpoint loss requires , so the encoder introduces no additional ambiguity. This is equivalent to .
The linear-Gaussian setting discussed in our response to Reviwer UzQg also provides a quantitative margin on this preservation. We can write the affine action estimate as , with the terminal-latent decoder block and the fixed offset. For and , the reconstruction error bounds , yielding
\qquad v\in\mathcal R_ H.$$ Thus, small excess reconstruction loss and bounded decoder gain provide a nonzero preservation margin. In the nonlinear experiments, $H=3$ yields $mH=3$, $18$, and $6$ for CartPole, Walker2D, and PointMaze, respectively. Our nonlinear experiments evaluate EP-IDM as a soft objective, as stated immediately after Theorem 1. Although the theorem assumes zero reconstruction loss, in practice we train with gradient-based methods and do not require the loss to get to zero. The bound also above explains why nonzero loss can still preserve reachable directions in the linear setting. **4. Proprioceptive inputs and modality ablations (Question 4).** The proprioceptive inputs are the four-dimensional CartPole state $(p,\dot p,\theta,\dot\theta)$, the standard $17$-dimensional Walker2D-v4 observation (torso height/orientation, six joint angles, and nine generalized velocities), and the four-dimensional PointMaze position/velocity state (supplemental Table 5). Supplemental Table 13 directly tests what happens when proprioception is removed. With the same frozen iBOT encoder and proprioceptive inputs, LQR success is $0$\% for MSP, $40$\% for MSP + PR-SIG, and $100$\% for MSP + PR-IDM. When proprioception is removed, MSP + PR-IDM drops from $100$\%, $80$\%, and $70$\% success with LQR, CEM, and GBP, respectively, to $0$\% with all three planners, and the same happens with the SIGReg models. The LQR gain therefore persists when the input modalities are held fixed. In the state-only transformer ablation, EP-IDM also increases LQR success from $20$\% to $80$\% (supplemental Table 11).Thank you for the clarification and additional analyses. These have addressed some of my concerns, although I remain uncertain about the respective roles of encoder information loss and predictor inaccuracies in explaining the nonlinear results. Overall, I am raising my rating and lean toward acceptance based on the theoretical insight and practical benefits.
We thank the reviewer for their time and the positive assessment of our work and for raising their score. We really appreciate that.
Point-to-point response to Reviewer NV9j (1/2)
We thank the reviewer for taking the time to review our work and for their constructive feedback. We appreciate the reviewer's perspective on our counterexample as an important step towards highlighting the limitation of the standard JEPA-style training objectives for latent stabilization, as well as the importance of our reachable-subspace guarantee, and the proposed control diagnostics beyond simply success rates.
1. Scope of our mechanism and nonlinear evidence (Weakness 1, Question 1). Lemma 2 proves that encoder information loss can make stabilization impossible even with an exact predictor. In nonlinear CartPole, the LQR failure and the multiple accompanying diagnostics and ablations (supplemental Figs. 9–16 and 19 and Tables 11–14) evaluate the learned encoder-predictor pair. They do not evaluate the literal encoder collapse, as preserving the information needed for control means keeping the directions feedback needs to observe and correct (encoder), and have those directions aligned with the physical ones in the latent space (predictor). We note that performing well with CEM for the CartPole task with models trained with SIGReg does not mean that the learned model reproduces well the evolution of the physical system, especially locally around the unstable equilibrium (that's evaluated by the LQR).
LQR is a “cheaper” method for feedback stabilization for CartPole, as CEM requires repeated sampling and model rollouts. On Walker2D, the SIGReg models also perform poorly with CEM.
Moreover, Figures 5 and 6 and 9–16 evaluate local dynamics and stability, Fig. 19 evaluates rollout error, and Tables 11–14 evaluate state-only predictors, sensory inputs, encoder sensitivity, and fixed-point consistency. We will keep the distinction between the exact linear dynamics failure and the empirical improvement in nonlinear feedback control. We have also provided ablations on a fixed encoder (DINOv2 and iBOT) when adapted with our proposed loss and with SIGReg (Table 4 and supplemental Table 12).
2. Walker2D and PointMaze (Weakness 1, Question 2).
The Walker2D experiment in our submission evaluates whether closed-loop model rollouts preserve the SAC-induced gait. We have included new experiments to evaluate the recovery after a mid-rollout perturbation. We inject a torso-velocity perturbation (δθ˙=±6rad/s) at step t=50 of each episode and roll each model's predictor forward for 80 steps using the ground-truth SAC actions (open-loop), decoding latent states via the learned MLP probe. We report two errors relative to the physical states: predictor MSE, computed by decoding the predicted latents, and re-encoding MSE, computed by encoding and decoding the actual post-perturbation frames. EP-IDM reduces re-encoding MSE from 47.02 to 13.03, indicating that the encoder and probe recover the physical state more accurately from perturbed observations.
We have also included additional experiments for the Walker2D planning performance:
We deliberately included PointMaze to verify that our proposed EP-IDM objective is still effective on tasks without unstable modes.