- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper studies auto-regressive world models that predict how objects move and additionally estimate how confident they are in each prediction. The authors show that once an object leaves the camera view, this confidence can become misleading. The model is most confident about the predictions that are furthest from the object's real position(?). They argue the cause is that the model's internal representation gradually loses track of where hidden objects are, while its confidence only reflects how well it predicts that representation. On CLEVRER environments, the model's most confident out-of-view predictions are about 20% less accurate than average, and a correction trained with ground-truth positions largely fixes this.
Critical strengths
- The general phenomenon is interesting. When an object is out of the field of view (or occluded), the model is most confident about exactly the predictions that are "most wrong". This can be easy to miss, because it disappears when you look at visible and hidden objects together. Splitting the error into parts helps explain where the problem comes from.
Critical weaknesses
-
The paper is very hard to follow. Without even considering experiments/results at this point, in the current form this paper is not appropriate for publication. While it is not particularly math-heavy, I repeatedly struggled to understand the content. Sentences are always very short and the terminology is confusing, which seems to me out of the scope of world models / model-based RL terminology/literature. E.g., what is "selection population", "world-error residual", "projected risk", "keep-all", "corrected confidence", "residual risk scoring", "world-error supervision", "forecasts", "clock term", "projected world score", "physical error", "published score", "readout", "scene/scene history", "risk ranking" ...? This is not an exhaustive list. Also risk, score, confidence and certainty seem to mean the same thing in this work. In my opinion, the paper needs a major rewrite ...
-
In essence, the paper is a limited empirical observation on a subset of world models. In particular, the observations hold more for slot-based models (VideoSAUR and SAVi on CLEVRER) rather than dense-based ones (DINOv2) where the evidence is too thin. For IntPhys, the slot-based observations also become weaker (in comparison to CLEVRER). Overall, different kind of WMs (as cited by the authors) need further investigation for broader conclusions.
-
Figure 1 right is unclear and does not present the idea. I can't make sense of the x- and y-axis labeling and when the peak in latent error occurs. What is the relation to the two images? What is the statement here? What is "true spread"?
-
The connection to some of the discussed world models (like DINO-WM and V-JEPA 2-AC) is not clear, since these models do not output covariances and they are also action-conditioned. So, the empirical evidence for broader justification is not given.
-
The AI use statement does not disclose everything correctly as described by the ICLR website.
Questions for authors
- No questions.