- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
WorldEngine asks whether an AI coding agent can turn a task description and a few visual examples into a simulation, ensure that simulation is correct, and be used to train video-generation model to solve visual puzzles. It's worth noting that the agent/WorldEngine's rules, rendering, and validation logic can therefore be inspected and modified directly. The paper’s motivation is that adapting a visual model to a new task usually requires someone to manually build a simulator, generate correct demonstrations, and write an evaluator. WorldEngine tries to automate that infrastructure from sparse task evidence.
Critical strengths
The authors proposes an interesting idea of whether automatically built environments can be useful teachers. The authors combine environment reconstruction through agentic frameworks to training a separate pixel-space video planner.
The improvement from 2% to 24% on independently generated puzzles shows that the synthesized engine produces useful data. However, I would still say that, it is unclear if the WorldEngine produces worse data, does that actually affect the improvement?
Critical weaknesses
- I am of the opinion that this is primarily a system paper and lacks methodological insights. Coding agents for inverse graphics or inverse physics are popular. The video generated models are not the novelty here.
- I have some serious concerns about overclaiming: the authors demonstrated the construction -> generation -> solving puzzles pipeline in very limited settings, yet calling this a WorldEngine. There is substantial overlap between the video generator's fine-tuning distribution and its test distribution, which makes this much more limited, i.e., implementing mechanics already supplied in text and using the generated images mainly to reproduce the mechanics.
- The paper largely demonstrates that a structured agent workflow catches some defects, but far from a systematic proof that the agent workflow is reliable.
Questions for authors
Please answer the weakness section, particularly about train/test distribution and why this would be generalizable to unseen dynamics.