- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates why latent world models with similar prediction accuracy can have different planning performance. To understand this, the authors propose ATM, a diagnostic framework that evaluates action-identifiability and cross-domain consistency between real and predicted latent transitions. Following LeWM, the paper also introduces AITS and AITS-P, which add inverse dynamics supervision to real and predicted transitions, respectively. The experiments show promising correlations between ATM diagnostics and planning success, as well as improvements on several planning tasks.
Critical strengths
- The distinction between action-identifiability and cross-domain consistency is interesting and provides a useful perspective on why latent world models can fail to plan despite accurate predictions.
- The experiments are clear and show promising results. In particular, the improvement from 74% to 84% on OGBench-Cube and the strong correlation with planning success support the practical relevance of the proposed analysis.
Critical weaknesses
- AITS is very similar to the inverse dynamics supervision proposed in Sensorimotor World Models: Perception for Action via Inverse Dynamics (Ivashkov et al., 2026). Both methods encourage recovering actions from consecutive latent representations. The novelty of AITS is therefore unclear, and the paper should better distinguish its contribution from this existing work.
- Although ATM provides an interesting analysis, the additional benefit of cross-domain consistency over true-transition action-identifiability is relatively small. The Spearman correlation only improves from 0.8130 to 0.8239 after adding the cross-domain term. More evidence is needed to demonstrate why the full ATM is necessary rather than simply evaluating inverse dynamics prediction loss.
Questions for authors
- What is the key difference between AITS and the inverse dynamics supervision in Sensorimotor World Models? I would like to see a clear comparison with this related work.
- Can the authors provide stronger evidence that cross-domain consistency is necessary for evaluating planning performance, rather than simply using a true-transition inverse dynamics loss?
3 comments
Follow-up: Highlighted Revisions and Evidence for the Full ATM
Thank you again for your thoughtful review and for recognizing the value of ATM. We have uploaded an updated manuscript, with new and revised content highlighted in blue for easier reading.
We would particularly like to highlight two additions.
1. Clarification regarding SMWM
We have expanded Related Work to explicitly compare ATM with SMWM and DynaMo.
SMWM uses inverse-dynamics supervision to learn action-aligned representations and prevent collapse. In our work, AITS and AITS-P instead serve as controlled interventions to study supervision in real versus predicted transition domains. ATM's main contribution is the independent bidirectional diagnostic framework, rather than the inverse-dynamics loss alone.
2. Why the full ATM matters
Our new Rope Manipulation experiments (Sec. 4.6) evaluate 400 checkpoints with closed-loop CEM planning. Cross-domain inverse risk achieves Spearman 0.786 with planning quality, compared with 0.495 for .
More importantly, the new Table 4 illustrates the additional information captured by the complete matrix:
| Rope checkpoint | CD ↓ | ||||
|---|---|---|---|---|---|
| AITS-P / 23 | 0.341 | 1.451 | 9.750 | 0.053 | 2.786 |
| Both / 31 | 0.336 | 1.454 | 4.749 | 0.018 | 1.308 |
These checkpoints differ by only 1.34% in and 0.20% in , yet have substantially different reverse-transfer risks and planning outcomes. The latter performs better on all 10 evaluation cases.
We also added a formal risk decomposition in Sec. 3.3 (Eq. 6) and a constructive counterexample in Appendix B.3, where two models have identical prediction loss, , , and , but different and planning errors.
Thus, the full ATM provides structural information beyond within-domain inverse loss and even one-way transfer, rather than merely improving a scalar correlation.
Thank you again for your time and valuable feedback. We would be happy to discuss any remaining questions or concerns.
If you feel that our revisions and responses have sufficiently addressed your concerns, we would greatly appreciate it if you would consider increasing your rating.
I appreciate the authors' responses and summary. These address my concerns, and I acknowledge the contributions of this paper. However, since the experiments are conducted exclusively in simulated environments, the applicability of the proposed method to real-world settings remains unclear. Therefore, I will maintain my current score.
We thank the reviewer for recognizing the value of distinguishing action-identifiability from cross-domain consistency and for highlighting the encouraging planning results. We address both concerns below.
1. Relationship Between AITS and Sensorimotor World Models
We appreciate the reviewer's observation regarding the similarity between AITS and Sensorimotor World Models (SMWM). We agree that both employ related supervised inverse-dynamics objectives. We also note that the two works emerged within a short period, with ATM's initial public version, including AITS, appearing slightly earlier. To preserve double-blind anonymity, we refrain from linking to the earlier public version here.
Nevertheless, their research objectives differ. SMWM uses inverse-dynamics supervision to learn action-aligned representations and mitigate representation collapse. In our work, AITS serves as a controlled intervention within the ATM framework, designed to examine how improving true-transition action-identifiability affects cross-domain structure and planning.
Crucially, we also introduce AITS-P, which supervises predicted transitions instead, and evaluate both interventions individually and jointly. This allows us to examine how supervision in different transition domains produces distinct ATM signatures and planning outcomes, without modifying the planner.
Furthermore, ATM evaluation uses two freshly trained, independent inverse probes on frozen world models, rather than the auxiliary heads used during training. This separates diagnostic measurements from intervention objectives.
Thus, our primary contribution is not the inverse-dynamics loss in isolation, but the formulation and diagnosis of cross-domain action-transfer structure, together with controlled interventions that reveal its distinct properties.
2. Why the Full ATM Matters Beyond True-Domain Inverse Risk
We acknowledge that adding the cross-domain penalty to the scalar screening score yields a modest Spearman improvement on OGBench-Cube (0.8130 to 0.8239). However, this scalar score summarizes only part of ATM; its marginal ranking improvement does not reflect the information provided by the complete bidirectional matrix.
We have added three complementary pieces of evidence.
First, the new Rope Manipulation experiments (Sec. 4.6, Fig. 3) evaluate 400 checkpoints with closed-loop CEM planning. Cross-domain inverse risk −DT,P achieves 0.786 Spearman correlation with planning quality, substantially exceeding 0.495 for −DT,T. It also achieves 0.571 Pearson, compared with 0.180 for prediction loss, indicating a much stronger linear relationship with planning quality. Fig. 3 further illustrates how prediction loss compresses high-performing checkpoints into a narrow numerical range, whereas cross-domain risk provides clearer discrimination.
Second, Table 4 demonstrates the additional information captured by the complete matrix. Two Rope checkpoints differ by only 1.34% in DT,T and 0.20% in DT,P, yet their reverse-transfer risks DP,T differ markedly (9.750 vs. 4.749), alongside substantially different planning outcomes (CD 2.786 vs. 1.308). The better checkpoint outperforms the other on all 10 evaluation cases. The reverse-transfer direction thus reveals structural differences that are difficult to identify from true-domain inverse risk or one-way transfer alone.
Third, we provide a formal explanation in Sec. 3.3 (Eq. 6) and Appendix B.3. Under squared loss, the Bayes-optimal cross-domain excess risk satisfies
= \mathbb{E}_{\mathcal{D}_T} \left[\|h_P^{*}(\xi)-h_T^{*}(\xi)\|_2^2\right].$$ This characterizes disagreement between the inverse rules of the two domains, which cannot be determined from their in-domain risks alone. Appendix B.3 further constructs **two world models with identical prediction loss, $D_{T,T}$, $D_{T,P}$, and $D_{P,P}$, but different $D_{P,T}$ and planning errors**. This formally demonstrates that even one-way transfer can miss planning-relevant structural differences. **Together, these results establish that the full ATM provides non-redundant diagnostic information beyond true-transition inverse loss, rather than merely improving a single scalar correlation.**