- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes DeCALM, a framework designed to improve the robustness of object-centric latent world models against visual background disturbances, built on causal-jepa. The method introduces two main components: BLE and MCA. BLE constructs a dictionary of background prototypes from training data and integrates these prototypes into the latent representation to approximate backdoor adjustment. MCA combines next-state prediction with incremental state change prediction through a gating mechanism, aiming to reduce error accumulation during long-horizon rollouts. Experiments on 3 manipulation tasks from OGBench and MetaWorld show improvements over world model baselines.
Critical strengths
-
Meaningful performance improvenemt : The paper addresses an important challenge in visual world modeling: background disturbances can affect latent predictions and consequently degrade planning performance. Authors' results suggest that the proposed approach can improve the practical robustness of latent world models under the evaluated visual disturbances.
-
Practical integration with pretrained world models and supporting analysis : DeCALM builds upon a causal-jepa model while keeping the visual encoder, slot-attention module, and dynamics backbone frozen. This makes the approach potentially useful for improving existing world models without retraining the entire architecture.
Critical weaknesses
-
The causal claims seem stronger than what the method actually supports : I believe the paper makes somewhat strong claims about "deconfounded dynamics," including in the title. The proposed method mainly addresses background dependence in latent predictions, but this does not necessarily mean the learned dynamics are deconfounded in a broader causal sense. I also find the use of the term "counterfactual" somewhat misleading. The method replaces background tokens while keeping object representations and future targets fixed. This seems closer to prediction consistency regularization under background substitution than actual counterfactual reasoning. I believe there is also a gap between the backdoor adjustment in Eq. 4 and its implementation in Equation 6-8. Averaging background features before prediction is not generally equivalent to averaging predictions over background conditions, especially with a nonlinear predictor. While their Appendix B discusses the idealized adjustment, it remains unclear how closely the actual feature-level implementation approximates it.
-
The method relies on fairly strong assumptions that should be discussed more explicitly : The method assumes that background information can be separated from object representations and summarized using a fixed number of prototypes. However, background changes do not always affect only the background slots. For example, changes in lighting (as authors mentioned in the paper) can affect the entire observation, including object appearances, shadows, and boundaries. In such cases, keeping object representations fixed while changing background tokens may not be a realistic assumption. Also, all baseline models that they compare with do not use the same background-specific information (or SCM). I think it makes it difficult to disentangle the benefits of the proposed causal formulation from those of the additional background-specific inductive biases.
Questions for authors
-
Could the authors clarify why incremental state prediction is considered a form of causal alignment? From the current formulation, it seems similar to residual next-state prediction with an auxiliary loss. What makes this component specifically causal, rather than a standard architectural choice? Could the improvements be explained by the skip connection or additional supervision?
-
Could the authors provide a comparison with simpler alternatives, such as removing the background token or randomly replacing it during training? This would help clarify whether the improvements come from the proposed causal adjustment or more general background invariance regularization.
-
Could the authors compare the proposed feature-level prototype integration with the prediction-level backdoor adjustment in Eq. 4? This would help clarify whether the approximation captures the intended causal effect or mainly acts as a context adaptation mechanism.