- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper investigates whether a world model that accurately reproduces observational trajectories can correctly predict the effects of interventions on hidden fast mechanisms. The authors formalize intervention identifiability using observational fibers, showing that an intervention target is identifiable if and only if it is constant across observationally equivalent models. They also derive a two-point minimax lower bound and a gauge-based non-identifiability criterion.
The framework is described using a slow–fast stochastic system in which the fast process follows Ornstein–Uhlenbeck dynamics. The authors construct microscopic models that induce identical averaged slow dynamics but yield different responses to interventions on the fast conditional mean. They then characterize additional measurements sufficient to identify the intervention response, including stationary fast means, variance, and lagged covariance. A perturbation bound quantifies the stability of intervention estimation. Synthetic experiments illustrate the theoretical results, while an additional comparison of single-rate and multirate GRUs examines observational prediction.
Critical strengths
-
The paper provides a clear mathematical example in which different microscopic mechanisms produce identical observational dynamics but different intervention responses. In particular, the averaged slow dynamics identify the combinations and , whereas replacing with a fixed value produces the target , which is not identified from the reduced coefficients alone. The exact finite-scale scaling symmetry strengthens this result beyond the averaging-limit example. This provides a concrete illustration of an important limitation of observational world models.
-
The paper usefully distinguishes identification of an intervention response from recovery of the entire microscopic model. For example, the fast conditional mean identifies , making identifiable, while the stationary variance can alternatively identify the target through . Recovering the fast relaxation rate requires additional temporal information.
Critical weaknesses
-
The general results in Section 4 are largely direct consequences of the definition of identifiability. Theorem 1 states that an intervention target is identifiable exactly when it is constant on observational equivalence classes; Proposition 1 follows from the standard two-point argument, while Proposition 2 is an immediate consequence of the same equivalence relation. Therefore, these results primarily reformulate established identifiability principles rather than introducing a new theoretical technique. The more substantive contributions concern the specific OU slow–fast model. However, the non-identifiability result follows from the simple parameter ambiguity , and the sufficient-anchor results follow from elementary stationary OU moment formulas. Although these derivations are correct and illustrative, it is unclear how substantially they advance existing theory on structural identifiability. In particular, the paper does not provide a general characterization of intervention-identifiable functionals beyond this restricted model class.
-
Despite the paper's motivation in learned world models, the central experiments use a synthetic system with explicitly specified dynamics and known intervention mechanisms. The anchor experiments initially assume that the reduced slow-dynamics coefficients are known, while the additional joint-estimation experiment uses controlled initial states and independent short trajectories. These conditions are substantially stronger than those encountered when learning a world model from partially observed trajectories. Moreover, the recurrent architecture comparison evaluates only observational prediction through CRPS. It does not evaluate whether learned world models recover the correct intervention response or whether incorporating the proposed anchors improves intervention prediction. Consequently, the experiments show the mathematical construction but provide limited evidence for the paper's broader implications for learning and evaluating multiscale world models. A direct experiment comparing intervention estimates from observationally equivalent learned models, with and without the proposed anchors, would materially strengthen the contribution.
Questions for authors
-
The observational-fiber characterization and gauge criterion appear to be direct consequences of standard identifiability definitions. Could the authors clarify which general theoretical conclusions are new relative to structural identifiability? Beyond the OU example, does the framework yield a nontrivial characterization of target-sufficient measurements for a broader class of nonlinear or learned dynamical systems?
-
The non-identifiability construction relies on replacing by the same numerical value across models with differently scaled hidden fast variables. How is this intervention operationally defined when the fast-state coordinate is unobserved?
-
Can the authors demonstrate the proposed identifiability gap using learned world models rather than only analytically specified microscopic systems? In particular, do independently trained models with similar observational prediction accuracy yield different estimates of the same intervention response, and do the proposed cross-scale anchors reduce these differences?