- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper focuses on compounding error in learned dynamics models for robots. The authors relate how fast the error grows to how sensitive the system is to initial conditions, and propose MTM-Pro, which is trained with a multi-step loss (overlapping forecasts fused by a learned mixture) and a rollout loss, but runs as a one-step AR model at test time. Results show 5s of open-loop drift on four robot datasets and the Lorenz system.
Critical strengths
-
The sensitivity view is a clear framing that explains why AR and multi-step models win in different regimes.
-
Multi-step supervision is used only in training, so deployment is a single forward pass (about 180 Hz on an embedded CPU).
-
Baselines are compared at matched parameter budgets; the appendix is thorough, and code and a new off-road UGV dataset are released.
Critical weaknesses
-
I am not fully convinced by the motivation. As far as I know, a world model on a real robot gets ground-truth observations or state estimates all the time, and these correct the drift. MPC also replans at every step with a horizon well below 5 s. When does a robot actually need to predict 5 s ahead with no feedback at all? Some concrete cases would help.
-
The presentation of this paper needs to be improved. The introduction is under-cited. 1) Terms like world model, MPC, and MBDRL appear without any reference. 2) Many paragraphs are very long, which makes the paper hard to follow. 3) Some numbers do not match across the paper. AR TCN training time on PI-TCN is 23 h in Table 1 but 53 h in Sec. 4.4. Lorenz drift reduction is "more than three orders of magnitude" in the abstract but "more than four" in Sec. 4.1. I found a few more. Please go through all the reported numbers carefully.
-
There is no closed-loop real-world experiment. Everything is open-loop drift on logged data, although the paper is motivated by MPC and MBRL. The authors mention this in the limitations, but I still think at least one MPC experiment is needed, even in simulation, to show that lower drift actually helps control.
Questions for authors
See Weaknesses