- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The authors argue that perfect world model predictions are not sufficient for reaching a desired goal state given a restricted sampling budget. They propose a framework that learns a contrastive intuition model in parallel with the world model and use it to help initialize candidates sampling for planning (e.g., CEM). The main experiments evaluate their method on several simulated environments, such as OGBench-Cube, PushT, and Two-Room.
Critical strengths
None
Critical weaknesses
- The evaluation constructs goals in a way that is particularly favorable for demonstration-based retrieval. Although Appendix J evaluates disjoint trajectories, the paper does not test goals requiring novel action sequences or extrapolation beyond the demonstration distribution. It remains unclear whether the proposed approach generalizes to more complex planning settings or situations with limited data support.
- The InfoNCE objective learns compatibility between demonstrated actions and start-goal pairs, but does not establish whether the learned intuition scores reliably indicate task success or physical feasibility. It would be helpful for the authors to evaluate how these intuition scores relate to task success. Adding a hybrid cost can also degrade performance, as observed in Push-T (Table 3).
- The paper does not discuss prior work on using memory-based warm-starting of model predictive control [1], despite retrieval initialization accounting for a large part of IMWM's performance gains (Table 3).
[1] Mansard, N., Del Prete, A., Geisert, M., Tonneau, S., & Stasse, O. (2018). Using a Memory of Motion to Efficiently Warm-Start a Nonlinear Predictive Controller. IEEE International Conference on Robotics and Automation (ICRA).
Questions for authors
- How well does IMWM generalize to goals outside the demonstration distribution or settings with limited data coverage?
- Can the authors provide experimental results showing that intuition scores reliability predict task success?