- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper studies whether inverse-dynamics supervision helps latent world models retain control-relevant information under visual diversity. Concat IDM predicts actions from consecutive latent states and updates the shared encoder. A theoretical example shows that merging different action outcomes can incur inverse-prediction error even when latent forward prediction is exact. Experiments vary appearance while holding physical trajectories fixed, with additional interventions and representation probes.
Critical strengths
1.The controlled appearance experiment addresses a useful question. Keeping physical trajectories fixed makes the effect of visual diversity easier to interpret. On Push-T, the benefit of Concat IDM grows from 15.3 percentage points with one appearance to 68.1 points with multiple appearances. TwoRoom shows a similar trend.
2.The supervision interventions strengthen the empirical finding. Blocking gradients into the encoder and shuffling action labels both reduce performance. This supports the conclusion that correct action supervision must shape the representation; simply adding an auxiliary head does not explain the gain.
Critical weaknesses
1.The algorithmic contribution is limited relative to prior work. PLDM[1] already combines latent forward prediction, representation regularization, and action prediction from consecutive latent states. The authors acknowledge this precedent, so the contribution should rest on the new analysis of visual diversity rather than on Concat IDM as a new method. The paper needs to make clearer what this analysis establishes beyond the known benefit of inverse-dynamics supervision.
2.The theoretical result does not explain the main empirical distinction. Proposition 3.1 establishes an error floor when distinct action labels are mapped to the same inverse-model input. It does not establish sufficient dynamics information or explain why concatenated states should outperform state differences. This gap matters because the two variants have similar action-decoding performance and identical mean planning success on TwoRoom.
3.The PLDM comparison does not isolate the source of improvement. Both methods use concatenation-based inverse prediction but differ in predictors, regularization, and optimization. The paper’s own regularizer ablation changes Concat IDM success from 77.2% with SIGReg to 26.0% with VICReg. The 77.2% versus 53.2% comparison with PLDM therefore cannot be attributed to the proposed inverse-dynamics design.
4.The main evaluation supports a narrower conclusion than learning intrinsic dynamics in general. Initial states and goals come from the world-model training trajectory pool, with matching appearances drawn from the training palette. This is disclosed, but limits the generalization claim. Unseen-palette success remains 13.4%, and the candidate-cost analysis uses the model’s own latent distances rather than an independent measure of physical outcome quality.
References
[1]. Sobal, U., Zhang, W., Cho, K., Balestriero, R., Rudner, T. G. J., & LeCun, Y. (2025). Learning from reward-free offline data: A case for planning with latent dynamics models. Advances in Neural Information Processing Systems.
Questions for authors
1.With the backbone, regularizer, and optimization held fixed, what substantive difference remains between Concat IDM and PLDM’s inverse-dynamics objective? Which component explains most of the reported performance gap?
2.Can candidate-action rankings be evaluated against physical-state error or actual task progress? This would help explain why Concat IDM plans better on Push-T despite similar action decodability.
3.Do the main findings hold on initial-state/goal pairs from trajectories excluded from world-model training?
4.Is the appearance mismatch in Figure 7 limited to visualization export, or was it also present in the planner inputs?