- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper looks at physical control in video generation: you give the model physical parameters like force, mass, gravity, friction, and restitution, and the generated motion should change the way physics says it should. The key observation is that a parameter’s effect depends on what is happening in the scene at that moment, and the authors argue existing parameter-conditioned methods leave this state-dependent process implicit. They propose EnactPhys, which adds an object-state branch to a pretrained Wan2.2 video DiT. The branch keeps a latent state for each object over time, injects force, gravity, and mass through per-object temporal attention, and injects friction and restitution only through gated messages between objects in contact, then writes the updated states back into the video features. Training uses about 110K synthetic MuJoCo/Blender videos, with per-frame masks and contact labels as extra supervision.
Besides the framework, the authors introduce PhysDelta, a benchmark that keeps the same initial image, changes one parameter at a time, and checks both whether the motion changes as expected and whether things that should stay the same actually do, such as pre-impact motion or other objects’ motion. It has a simulated split with numerical ground truth and a real-image split scored on direction only. EnactPhys beats all baselines, including same-backbone, same-data variants, on all four PhysDelta control metrics while keeping video quality on par, and does well on Physics-IQ and MORPHEUS.
Critical strengths
-
The paper identifies a real and well-motivated gap in physical control for video generation. Its core observation is that a parameter’s effect depends on the evolving scene state, for example restitution only matters once a collision happens. Framing the goal as both accuracy and selectivity gives a clear and useful way to define what correct physical control means.
-
I think the PhysDelta evaluation protocol is a useful contribution that other work could adopt (for example, counterfactual analysis?). It keeps the same initial image and changes one parameter at a time, which makes generated motions directly comparable across parameter settings. It also explicitly checks whether unaffected phases and non-target objects stay unchanged, a property that is important for controllable world models.
-
The main comparison is well controlled and appears well. The Wan(Text-only) and Wan(ControlNet) baselines share the same backbone, training data, and step budget as EnactPhys, so the comparison isolates the effect of how parameters are injected. The gap over these variants is large, especially on Object Control. EnactPhys maintains strong generation quality alongside its control gains. Video quality and artifact rates are on par with the strongest fine-tuned baselines, and the model also performs well on external benchmarks such as Physics-IQ and MORPHEUS.
-
I think the explicit object-level states make the model easier to probe and manipulate. The state-intervention experiments show that editing the learned states steers the generated motion while the input parameters are held fixed, which indicates that these states carry causal information about the motion.
Critical weaknesses
-
I think the writing currently holds the paper back somewhat. The same results and claims appear several times across the abstract, introduction, results, and conclusion, and it would help to use that space to explain what actually goes wrong when the state-dependent process is left implicit. The framing around "executing physical processes" also feels a bit stronger than the mechanism. In my view, the most convincing story in the paper is that contact-gated, role-separated parameter pathways drive the selectivity gains, and the paper could benefit from putting that at the center.
-
It is somewhat difficult to separate the architecture's contribution from the additional supervision. EnactPhys uses mask supervision, contact-label supervision for the gates, and extra motion losses, and I could not tell whether the baselines were trained with the same losses. Could the authors clarify whether the All-to-All ablation retains any contact supervision? An ablation that removes gate supervision, and a version of the Wan baselines trained with the same motion losses, would make the attribution clearer.
-
The contact-window and message-intervention experiments are useful, but the core motivation could be tested more directly through a quantitative test involving multiple physical parameters. The paper argues that parameter effects depend on the scene state, while PhysDelta varies one parameter at a time and the composed-event results are shown qualitatively. If possible, a small quantitative test, for example where force determines whether a collision occurs and the effect of restitution is measured accordingly, would nicely support the main claim.
Questions for authors
Please refer to the Weaknesses section; I would appreciate it if the authors could address those points in the rebuttal.
I am open to adjusting my score based on the authors’ response.