- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates the mismatch between world-model prediction accuracy and planning performance. It proposes two complementary methods: a support gate that penalizes positive predicted rewards based on state-action data support, and a pairwise action-effect loss that supervises differences between action outcomes from the same state. Experiments on DoorKey, CartPole, and MuJoCo environments demonstrate improvements in planning performance, particularly when combining the support gate with pairwise training.
Critical strengths
- The paper addresses an important issue in world-model planning: low prediction error does not necessarily lead to better action selection. Its analysis of relative prediction errors provides useful motivation for decision-oriented model repair.
- The proposed support gate improves planning performance without retraining the world model. Experiments across multiple environments and component comparisons further demonstrate the potential benefits of combining support-gated planning with pairwise supervision.
Critical weaknesses
Recent studies including CoCo [1], CQM [2], and AD-WM [3] have explicitly addressed action-dependent prediction and relative action effects in world models. In particular, CQM directly learns differences between counterfactual action outcomes, closely related to the proposed pairwise loss. The paper does not sufficiently distinguish its contributions from these approaches.
[1] Overcoming Statistical Bias in Action-Controllable World Models, arXiv:2608.04653.
[2] Counterfactual Quotient Models: Learning What Actions Change, Not What the World Does, arXiv:2608.22092.
[3] AD-WM: Action-Discriminative World Models for Counterfactual Model Predictive Control, arXiv:2609.30264.
Questions for authors
- What are the key methodological differences between the proposed pairwise action-effect loss and existing approaches such as CoCo, CQM, and AD-WM? Could the authors clarify what limitations of these methods the proposed loss addresses and provide comparisons where feasible?
- Could the authors provide more controlled ablations to isolate the contributions of the proposed mechanisms? Specifically, how does the support gate compare with additive penalties using identical state-action support information, and does pairwise supervision provide consistent improvements under matched training-update budgets?