- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper argues that world models trained on pixels without reconstruction still fail when the camera moves or the background changes. The remedy is a change to the training data rather than to the model. A causal model states which image factors can change, background and camera placement, and which must not, the task physics. Training then shifts each recorded sequence by one fixed offset, keeps actions, rewards and labels as recorded, and leaves the network, its objective and its inference untouched.
The analysis shows that if the model's hidden state barely moves when the image shifts, a fixed policy's score can move only a little. With jitter in both training and testing, the five-task average score on DMC is 715.5 (on the usual 0 to 1000 scale) against 310.5 for the same network trained without the intervention. When jitter appears only at test time, the baseline falls from 863 to 314 while the method falls from 849 to 650, so the gain lies in holding up under unseen image change rather than in raising the ceiling.
Critical strengths
-
The paper contributes a training-time data intervention guided by a causal model, and shows that it improves control under camera jitter. Fixing background and camera placement as the only factors allowed to vary reduces the intervention to one translation offset per sequence. It needs no architectural change and nothing at test time.
-
The paper locates the source of robustness in the training data rather than in added capacity. The intervention changes nothing about the architecture, the objective or the inference, so the gain on a matched backbone cannot be credited to extra parameters or a new training objective, and a policy trained without jitter degrades far less than the baseline when jitter is added at test time. The stability argument relates the return change to how far the latent state moves under shift, which supports that reading.
Critical weaknesses
-
The claims outrun the evidence. The abstract and introduction speak about decoder-free world models as a class, while every experiment uses a single R2-Dreamer, five DMC tasks and three seeds, with camera jitter implemented as a 2D image translation over DAVIS backgrounds. No result swaps in another decoder-free backbone, and no nuisance other than translation is tested. The practical claim that the causal model tells you which proxy to choose is therefore demonstrated on one configuration only.
-
The theory is conditional and its premise is never instantiated. The bound requires posterior movement to be uniformly limited across all reachable states and intervention pairs, whereas Section 4.4 gives a Jensen-Shannon estimate over 81 pad-4 translations, a reduction of about a quarter, which is a sanity check rather than an instantiation. The causal argument itself is only supported ordinally, since in Table 1 brightness and contrast also improves all three tasks.
Questions for authors
The experiments cover one decoder-free backbone and five DMC tasks, while the abstract states the claim more broadly. Could the authors clarify the intended scope of the conclusions and which aspects of generalization remain untested?
Reminder: Please Review the Authors' Rebuttal
Dear Reviewers,
As the discussion phase is approaching its end, I would like to kindly remind you to review the authors' rebuttal and provide your feedback if you have not done it. Please let us know whether the authors' responses address your concerns and update your assessment if appropriate. Your engagement in the discussion is important to ensure a fair and thorough review process.
Thank you for your time and effort!
Your AC