- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper presents WorldModelLens, a framework for mechanistic interpretability of heterogeneous world models. Its main design ideas are a capability-typed interface, time-indexed hook sites, and an intervention-replay mechanism intended to support interventions over recurrent states, actions, and imagined trajectories. The framework also includes several analysis modules, such as probing, replacement ablations, attribution, latent lenses, attribution patching, and statistical testing. The empirical study focuses primarily on I-JEPA ViT-H/14, examining context attribution, information routing through target tokens, the evolution of target representations across predictor depth, and the accuracy-efficiency trade-off of attribution patching.
Critical strengths
-
The paper addresses an important gap and proposes a world-model-specific abstraction. WorldModelLens makes world-model-specific concepts, such as recurrent state, latent state, actions, environment or imagination steps on top of existing existing interpretability frameworks which already support activation caching and internal interventions.
-
The I-JEPA case study is carefully controlled and methodologically stronger than many interpretability studies. The paper consistently includes controls that help rule out common interpretability artifacts. For example, the replacement experiments compare zero, mean, and resampled activations rather than relying only on zero ablation. All three intervention types strongly affect target-token positions while having little effect on distant context positions, which makes the result more convincing than a single ablation condition would.
Critical weaknesses
-
The central methodological contribution is not directly validated in the setting where it matters most. The strongest novelty of the paper lies in its treatment of time, actions, recurrent or stochastic state, and multi-step intervention replay. However, the main case study uses I-JEPA, which does not contain action-conditioned recurrent dynamics or imagined trajectories. In the experiments, the replay horizon is zero, so the proposed replay mechanism becomes standard activation patching. This creates a significant method–experiment mismatch. The paper introduces machinery specifically intended for questions such as how an intervention at one time step affects future predicted states, rewards, values, or policies, but none of these capabilities are tested at scale. A much stronger validation would require experiments on models such as DreamerV3 in which internal states or actions are intervened on and the effects are traced over multiple future steps.
-
Cross-model generality is demonstrated mainly through backend implementation rather than scientific transfer. The paper implements multiple adapters, but implementing a backend is not equivalent to demonstrating that the same interpretability analysis works reliably across model families. The central claim would be substantially stronger if the paper showed the same analysis code applied, without model-specific logic, to at least two substantially different dynamic world models, with comparable and interpretable results. At present, the paper’s claim of transfer across families rests mostly on interface design and backend coverage rather than on empirical evidence. The authors explicitly acknowledge this limitation.
-
The practical advantage over existing generic intervention frameworks is not sufficiently demonstrated. Many of the individual analysis techniques used in the paper—probing, Integrated Gradients, activation patching, attribution patching, latent-lens-style readouts, and representational similarity—are established methods. The main added value of WorldModelLens therefore needs to come from its world-model-specific abstraction. However, because the main I-JEPA experiments do not require recurrent state, actions, or multi-step rollouts, the paper does not clearly demonstrate when WorldModelLens enables an analysis that would otherwise be difficult to implement with more general intervention tooling. A concrete comparison showing the amount of model-specific code required to implement the same multi-step analysis in a generic framework versus WorldModelLens would make the infrastructure contribution more compelling.
Questions for authors
- Please validate intervention replay on a genuinely dynamic world model. The most important missing experiment is a multi-step intervention study on a model such as DreamerV3. For example, the authors could intervene on a latent state, recurrent state, or action at one time step and trace how the effect propagates through future predictions, rewards, values, or policy outputs.
- Please include a strict cross-backend transfer experiment. It would be valuable to implement one analysis once and run exactly the same analysis code on at least two substantially different world-model architectures. This would directly test the paper’s central “write once, run across backends” motivation.
- Please distinguish more clearly between implemented, tested, and scientifically evaluated backends. The current backend table demonstrates broad engineering coverage, but only I-JEPA receives a large-scale scientific evaluation. Explicitly distinguishing these levels of validation would make the empirical scope of the paper clearer.
- Please clarify the practical advantage over generic intervention frameworks. A concrete case study comparing the implementation of the same multi-step intervention analysis in WorldModelLens and in a generic intervention framework would make the contribution easier to assess.
DreamerV3 replay and the scope of WorldModelLens
Thank you for your feedback.