- Rating
- 2
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper introduces PhysEditWorld, a dataset for studying whether game world models can change generated motion in response to gravity settings. The authors use a UE5 plugin to record interactions and replay them under different gravity levels while keeping the scene, initial state, controller, and camera policy fixed. This allows motion across the resulting videos to be compared directly. The dataset covers 12 scenes, over 100 hours of interaction, and more than 60 million rendered frames, with action, camera, and engine-state annotations. The main contributions are the matched data and collection pipeline, along with an evaluation that separates event success, usable pair coverage, and correct gravity-response ordering. Fine-tuning Wan2.2, LingBot-World, and Qwen3-VL on the data yields reported improvements in gravity-conditioned generation and gravity recognition on unseen scenes. Engine comparisons and controlled-input tests are also used to check the reliability of the evaluation.
Critical strengths
The main value of this paper is the dataset and its collection pipeline. The authors combine action recording, matched replays under different gravity settings, rendering from multiple views, and state annotations in a UE5 tool, providing a reusable way to build the data. The paired videos share the same interaction conditions, allowing researchers to examine more directly how changes in physical parameters affect motion. I think this dataset and the accompanying tools can help advance world model research, particularly by supporting training and evaluation of how models respond to specified physical conditions.
Critical weaknesses
I find the coverage of “physics editing” fairly narrow. The data and experiments mainly focus on jumping and falling under different gravity settings. To me, what matters is whether the model follows the specified physical conditions. Real-world scenes can serve as a baseline, while motion in some visual effects scenes can also be described through different external forces, elasticity, or damping. Including these parameters and their combinations would make the dataset more broadly useful and potentially increase its impact. The current experiments mainly show that models respond to gravity changes; there is not yet enough evidence that the approach works for other physical effects.
Questions for authors
Please refer to the Weaknesses section.
2 comments
Thank you for the detailed response and additional experiments. I will maintain my original rating.
Response to Reviewer 2BVq
We thank the reviewer for recognizing the value of the matched data and the UE5 collection pipeline. We would like to clarify that the dataset already includes physical variations beyond gravity. The supplementary material provides additional recordings with changes to friction and restitution. These are collected data, rather than proposed extensions of the tool.
Gravity is the focus of the main experiments, not the sole physical parameter covered by the data. We chose it as a controlled setting for evaluating whether models respond to specified physical conditions, using matched interactions and an evaluation that separates event success, usable pair coverage, and response ordering. We agree with the reviewer that following the specified physical condition is the central goal.
The additional recordings in the supplementary material broaden the data coverage beyond the gravity-conditioned jumping and falling examples emphasized in the main text. We will make these recordings more prominent in the revision and revise the scope description to distinguish the physical parameters already represented in the data from those evaluated quantitatively in the model experiments. In particular, our reported model results concern gravity-conditioned generation and recognition; the supplementary examples document the broader physical variations available in PhysEditWorld.
We appreciate the suggestion to study additional parameters and their combinations. The matched-replay protocol provides a common collection framework for these settings, allowing physical conditions to vary while preserving the interaction setup. We will clarify this broader data contribution without extending the model-performance claims beyond the conditions evaluated.