- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper introduces Causal Disentanglement World Model, a framework that splits the latent dynamics into an Environment pathway and an Intervention pathway. A null-action anchor constrains the architecture so that, under the authors’ stated assumptions, it is identifiable at the level of conditional means. The intervention defines an agency bonus for exploration in MCTS. Experiments were performed on Atari100k to evaluate performance, post-hoc branch-removal and isolation of the agency bonus on Venture, and qualitative representation diagnostics. These suggest the split is useful and that the bonus can improve early exploration on at least one task.
Critical strengths
• The authors are very careful and honest in their treatment of causality and identification, the architecture is separated from causal interpretation: They show why input restriction alone is not enough and so they introduce the null-action anchor. They also show that the agency signal is invariant to zero-mean transition noise at the population level giving a clear idea of what the pathways can mean.
• The split yields queryable components reused by exploration and the experimental results on Atari100k are competitive.
Critical weaknesses
• While being very careful about the causal interpretation, it still rests on very strong and unvalidated assumptions: Identifiability requires state sufficiency, a valid null-action anchor, action coverage, realizability, and global risk minimization. NOOP as a causal anchor is questionable in Atari, sufficiency is unverified, and leakage between branches is not ruled out, baselines are borrowed from other papers, only 3 seeds used and no statistical robustness tests (IQM, CIs, etc), the agency bonus ablation isolation is only evaluated on Venture.
• The null-action anchor’s enforcement is unclear, discrepancies in the figures (noted by the authors), the text of the paper is not easy to understand and not very well composed.
Questions for authors
• How exactly is the Null-action anchor constraint enforced in the reported experiments: as a hard output constraint, by architectural zeroing, or as a penalty term? If it is a penalty, what is its coefficient and how sensitive are the results to it? Please also show performance with and without the anchor, since this determines whether Proposition 1 applies to the model you actually trained.
• How confident are the authors that NOOP is a valid autonomous baseline across the 26 games and states, given partial observability and a learned encoder? Is there any diagnostic, counterexample analysis, or alternative anchor showing where NOOP holds or fails? If Atari cannot validate the assumptions, what evidence do the authors consider sufficient?
• Can the authors report IQM, stratified aggregates, and 95% confidence intervals with per-game seed dispersion, and resolve the mismatch between the reported aggregates (2.81 mean, 1.24 median) and the game-level en-tries? Please also state which baseline numbers were re-run under your protocol and which were copied from prior work.
• Can you provide more experimental results on the isolation of the agency bonus beyond Venture?