- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Normalizing-Flow World Model (NFWM), a framework that aims to bridge video world models and latent world models. NFWM consists of an invertible encoder based on normalizing flows and an action-conditioned probabilistic predictor that models a Gaussian distribution over future latent states. The two components are jointly trained through exact maximum likelihood, which enables stochastic future prediction while preventing representation collapse without additional anti-collapse regularization. To make the learned latent space suitable for goal-conditioned planning, the authors further introduce an auxiliary inverse-dynamics objective that encourages action-sensitive representations. The paper evaluates NFWM on goal-conditioned planning in deterministic and stochastic environments, robotic action selection in LIBERO, and policy learning through imagined rollouts in Atari Boxing. The results show that NFWM achieves the highest average planning success across four deterministic control tasks, outperforms JEPA-based baselines in stochastic planning and robotic action selection, and achieves better returns in imagination-based policy learning.
Critical strengths
-
The use of exact maximum likelihood provides a unified objective for jointly learning visual representations and stochastic dynamics. The invertibility of the encoder and the log-Jacobian term eliminate the need for additional anti-collapse regularization. The auxiliary inverse-dynamics objective provides a reasonable mechanism for shaping the latent geometry toward downstream planning.
-
NFWM achieves competitive or superior performance compared with JEPA-based baselines across multiple control tasks, with particularly encouraging results in stochastic environments and imagination-based policy learning.
Critical weaknesses
- One of my main concerns is that the novelty of the proposed framework relative to existing latent world models, particularly RSSM-based approaches such as Dreamer, is not sufficiently established. Stochastic latent dynamics, generative representation learning, and policy learning through imagined rollouts have already been extensively studied in prior work. Moreover, incorporating inverse dynamics to encourage action-relevant representations is also not a new idea (e.g., Iso-Dream [1]).
[1] Iso-Dream: Isolating and Leveraging Noncontrollable Visual Dynamics in World Models. NeurIPS 2022.
-
Moreover, the experimental comparisons focus primarily on deterministic JEPA-based world models (LeWM and SMWM). Since these baselines do not explicitly model stochastic future distributions, their inferior performance in stochastic environments is not entirely surprising. I believe that direct comparisons with established stochastic latent world models are essential to substantiate the claimed contributions and clarify whether the improvements arise specifically from the proposed normalizing-flow formulation rather than probabilistic dynamics modeling in general.
-
NFWM operates on 144 × 192 latent features, whereas the JEPA baselines use compact 192-dimensional representations. The input resolutions also differ. Although the paper provides objective ablations, these differences make it difficult to determine which components are primarily responsible for the observed performance improvements.
-
The robotic evaluation is limited to a single LIBERO task involving placing a mug on a plate. Moreover, the model is evaluated primarily as an action-sequence ranker over candidates generated by a pretrained policy, rather than through closed-loop planning or policy execution. It remains unclear whether the proposed approach generalizes to more diverse manipulation tasks, longer-horizon interactions, or more complex robotic environments.
-
The paper does not provide a systematic comparison of inference latency, rollout throughput, memory consumption, or planning cost. Since the invertible encoder preserves high-dimensional image representations and the planning procedure evaluates many candidate trajectories, it is unclear how much computational advantage NFWM achieves in practice, particularly when scaling to higher-resolution observations or multi-camera robotic settings.
Questions for authors
-
Could the authors report inference latency, rollout throughput, peak memory usage, and overall planning time compared with JEPA-based and diffusion-based world models under comparable hardware settings?
-
Removing the inverse-dynamics objective reduces Push-T success from 86% to 34%, despite the representation remaining invertible and the dynamics predictor still being trained with exact likelihood. Does this indicate that likelihood-based representation learning primarily preserves visual information without learning a useful geometry for control?
Thanks for the rebuttal. The rebuttal addresses my main concerns. I have no further questions and will keep my original rating.