- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper argues that world models should distinguish agent actions from causal interventions and should reason over intervention spaces that may extend beyond the agent’s ordinary action space. It proposes viewing future world models as “intervention engines” that represent intervention targets, causal mechanisms, propagation of intervention effects, and uncertainty over competing mechanisms. The paper discusses several open problems in causal representation learning, counterfactual reasoning, intervention-driven exploration, and evaluation, and sketches a possible intervention-centric world-model architecture based on a causal encoder, latent causal graph, intervention module, causal dynamics model, and decoder.
Critical strengths
-
The paper highlights a valid distinction between agent actions and causal interventions, and correctly notes that action-conditioned prediction can have interventional semantics only under appropriate assumptions.
-
The manuscript collects several relevant open problems at the intersection of world models and causal reasoning.
Critical weaknesses
- The central position is too broad and insufficiently novel.
The main claim is that world models should distinguish actions from interventions and reason over an intervention space that may be broader than the agent’s action space. However, this distinction largely follows directly from standard SCM semantics: an action is a decision variable entering through the agent’s control interface, while an intervention may modify any variable or mechanism in the causal system. I found it difficult to identify what new scientific claim is established beyond applying these existing causal concepts to world models. A position paper can be valuable without introducing a new algorithm, but in that case the position itself should offer a sufficiently sharp or non-obvious conceptual advance. I do not think this manuscript currently reaches that bar.
- The proposed “intervention engine” is not operationally defined.
The paper states that “a causal WM is an intervention engine,” but it does not provide clear necessary or sufficient criteria for what qualifies as such a model. It is unclear whether an intervention engine must explicitly represent a causal graph, support unseen do-operations, perform counterfactual inference, maintain uncertainty over mechanisms, identify informative interventions, or satisfy some combination of these capabilities. Without an operational definition, the term remains largely rhetorical. This also makes the taxonomy in Table 1 difficult to interpret consistently, because the paper itself later states that an explicit causal graph or symbolic do-operator is not required.
- The proposed formulation leaves nearly all of the difficult technical problems unresolved.
Section 4 presents a five-module architecture consisting of a causal encoder, latent causal graph, intervention module, causal dynamics model, and decoder. However, the paper does not provide a learning objective, identification assumptions, training procedure, or mechanism for learning the intervention space and the action-to-intervention mapping. The manuscript itself acknowledges that recovering causally meaningful latent variables is a difficult identification problem requiring assumptions, supervision, or interventional variation. Consequently, the “possible formulation” functions more as a conceptual block diagram than as a developed methodological framework.
- The paper provides no concrete validation that the proposed perspective changes what a world model can actually do.
Again, I do not view the absence of experiments as automatically disqualifying for a conceptual paper. However, because the proposed position is broad and the technical framework remains underspecified, there is also no empirical, theoretical, or even worked-out synthetic demonstration showing that distinguishing actions from a broader intervention space leads to a capability that existing world-model formulations cannot already provide. The result is that the paper remains almost entirely at the level of verbal argument and illustrative examples.
Questions for authors
-
What is the single new scientific claim of this paper beyond the standard causal distinction between conditioning, actions, and interventions?
-
What are the necessary and sufficient capabilities for a world model to qualify as an “intervention engine”?
-
How are the causal variables, intervention targets, and action-to-intervention mappings in the proposed architecture actually identified from data, and under what assumptions is this possible?
-
Can the authors provide a concrete setting in which an existing action-conditioned world model provably or empirically fails, while the proposed intervention-centric formulation resolves that failure?
-
If explicit causal graphs, symbolic do-operators, and a particular causal architecture are all optional, what precisely distinguishes the proposed class of causal world models from sufficiently expressive existing world models evaluated under intervention-style perturbations?
3 comments
Thank you for the detailed rebuttal and additional clarifications. I appreciate the authors' efforts to refine the central position, clarify the definition of intervention capability, and provide supporting theoretical and experimental evidence.
However, my primary concern remains the novelty and significance of the central position. The distinction between action-space and intervention-space adequacy largely follows from established causal identifiability principles. While the additional evidence strengthens the argument, I remain unconvinced that the paper offers a sufficiently novel conceptual contribution or a concrete research perspective beyond existing causal reasoning frameworks.
Although I acknowledge the improvements, I believe these fundamental concerns remain unresolved. I therefore maintain my original rating of 1 (Clear Rejection).
Thank you for the follow-up. We agree with the reviewer on one important point: the causal identifiability principle underlying our argument is not itself new, and we do not intend to claim a new causal inference framework.
Our intended contribution is instead a position about how world models should be conceptualized and evaluated. In current WM research, strong predictive performance over an agent's action space is often treated as evidence of increasingly general world understanding. Our claim is that this inference is not justified: even when action-conditioned prediction has valid interventional semantics, correctness over the agent's action space does not establish correctness over a broader intervention domain involving changes to environmental variables or mechanisms.
The contribution is therefore not a new SCM formalism, but three things:
-
A world-model-specific distinction: we separate action-space adequacy from intervention-space adequacy and argue that the latter should be stated explicitly as part of a WM's intended domain of reliability.
-
An operational criterion: we define intervention capability behaviorally, relative to a specified intervention family , rather than requiring a particular causal graph, architecture, or symbolic operator.
-
A research and evaluation perspective: we show concretely that ordinary predictive and action-generalization tests can fail to reveal intervention-space non-identifiability, and argue that WM benchmarks should therefore test mechanism interventions, identifying variation, counterfactual correctness, and uncertainty over competing mechanisms.
The new benchmark is intended to make this distinction concrete rather than to establish a new causal theorem. It demonstrates that two mechanisms can be indistinguishable under ordinary action-conditioned prediction while diverging under interventions, and that simply adding intervention descriptors is insufficient without identifying variation.
We therefore agree that our position builds on established causal reasoning principles. Our claim is that these principles imply a specific and, in our view, underemphasized consequence for the design and evaluation of modern world models.
Thank you for the detailed feedback. We agree that the previous version did not state the central scientific claim sharply enough.
Q1. What is the new scientific claim beyond standard SCM distinctions?
We agree that the distinction between conditioning, actions, and interventions is established. We revised the paper to make the central claim more precise:
Action-space adequacy does not imply intervention-space adequacy. A WM may correctly predict every action in its ordinary action space A while remaining non-identified for interventions in a broader domain I∗.
This is not a claim that action-conditioned prediction is inherently non-causal. Under appropriate assumptions,
p(zt+1∣zt,at=a)=p(zt+1∣zt,do(at=a)).
The issue is instead reliability over $\mathcal{A} $ versus reliability over a broader $\mathcal{I}^* $. We added both a formal construction and a controlled benchmark showing that distinct mechanisms can agree on all action-conditioned transitions yet disagree under interventions outside the action space.
Q2. What qualifies as an "intervention engine"?
We replaced the architecture-centered characterization with a behavioral definition. Given an intervention family $\mathcal{I}^* $, we call a WM intervention-capable if it can reliably predict the consequences of interventions I∈I∗ while preserving mechanisms not targeted by the intervention.
An explicit causal graph or symbolic do(⋅) operator is not required. Counterfactual reasoning, mechanism uncertainty, and active intervention selection are stronger capabilities rather than defining requirements.
Q3. How are causal variables and intervention mappings identified?
We clarified that they are generally not identifiable from passive or ordinary action-conditioned trajectories alone. Identification may require assumptions, supervision, multi-environment variation, known intervention targets, or interventional data.
We also revised Sec. 4 so that the five-module decomposition in Fig. 2 is presented as one possible implementation rather than a solved identification procedure. In particular, the causal encoder is now explicitly described as an open causal representation learning problem.
Q4. Can you give a concrete failure case?
Yes. We added a controlled benchmark designed to isolate the distinction between action-space prediction and intervention-space identification.
For
v_{t+1}=v_t+\Delta t\,\frac{g a_t-cv_t}{m},$$ the transition in a fixed environment depends only on $g/m$ and $c/m$. Thus, $(m,c,g)=(1,0.2,1)$ and $(2,0.4,2)$ induce exactly the same action-conditioned dynamics. We verified zero discrepancy over $10^6$ random samples and 200-step rollouts. However, applying the same intervention to one mechanism breaks this equivalence; Fig. 1 in the revised paper visualizes this directly. We also trained learned predictors over five seeds: | Condition | Action-only | Intervention-aware | Descriptor control | |---|---:|---:|---:| | Original environment | $5.8\times10^{-9}$ | $7.1\times10^{-7}$ | $1.3\times10^{-8}$ | | Held-out actions | $1.3\times10^{-8}$ | $1.3\times10^{-6}$ | $2.0\times10^{-8}$ | | $\mathrm{do}(m=2.0)$ | $4.4\times10^{-2}$ | $8.0\times10^{-7}$ | $6.0\times10^{-2}$ | | Combined intervention | $4.3\times10^{-2}$ | $1.6\times10^{-6}$ | $6.5\times10^{-2}$ | *50-step rollout MSE, mean over five seeds.* The action-only model generalizes to held-out action values but fails under mechanism interventions. Crucially, the descriptor control uses the same architecture and the same $(m,c,g)$ inputs as the intervention-aware model, but is trained only on action-equivalent environments with fixed $g/m=1$ and $c/m=0.2$. It fails similarly to the action-only model. Thus, the key factor is **identifying variation**, not simply providing additional inputs. We emphasize the limited scope: the intervention-aware model is given the post-intervention values explicitly, so the benchmark does not test intervention detection or online adaptation. It supports the narrower identifiability claim that perfect prediction in a fixed action-conditioned environment does not determine responses to independent mechanism changes. ### Q5. What distinguishes this from a sufficiently expressive existing WM? The distinction is behavioral, not architectural. An existing WM can satisfy our definition if it is reliable over the relevant intervention family. Our claim is only that success on ordinary action-conditioned trajectories does not establish that capability.