- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes Phys4D, a three-stage post-training recipe that uses simulation data to make pretrained video diffusion models more physically consistent while keeping their real-video appearance prior. The authors also build an asynchronous multi-solver simulation pipeline. Validation covers CogVideoX-5B, Wan2.2-5B and Open-Sora 1.2 on Physics-IQ, VBench-2.0 Physics and PhyGenBench. The paper adds geometry/motion diagnostics on 20 held-out simulated templates and a Physics-IQ ablation that separates structural supervision from simulator-RGB flow matching.
Critical strengths
-
The core design choice is reasonable, and the RQ4 control is the right experiment. Using simulation for structure (depth, flow, masks, trajectories) rather than as an appearance target is a sensible way.
-
The evaluation is broad. Three backbones, three external physics benchmarks plus Physics-IQ Verified, and the RQ4 comparison against a direct simulator-RGB LoRA (Table 4) all address the obvious worry that the model just learns simulator appearance.
-
The scalable simulation pipeline and the dataset it produces. The authors build an asynchronous, tiled-rendering data engine on Isaac Sim / GarmentLab. The coupled-physics simulation pipeline covers rigid, deformable, fluid, cloth and granular cases and exports aligned depth, flow, masks and trajectories. If it is released as promised, people working on physics in video models could use it.
Critical weaknesses
-
The pipeline is overly complex, and its necessity is never shown. It stacks three stages (pseudo-label head pretraining, noise- and mask-gated adapter training with six losses, then PPO on a Chamfer reward). That costs about 864 H100 GPU-hours plus a 1.25M-video simulator corpus. The paper never shows that a simpler recipe, such as Stage II alone or the structural losses without the gating machinery, would not recover most of the gain.
-
The training simulations may overlap with the Physics-IQ test scenes. The supplementary configs include weight_on_pillow, light_on_block, duck_and_domino, potato_in_water, domino_in_juice and others, which closely mirror Physics-IQ scenes. The held-out split is only among the authors' own templates.
-
No comparison with the closest physics post-training methods. The main results only compare Base with +Phys4D. Several methods are directly comparable: they use the same backbones and have public code and checkpoints such as PISA (Li et al., ICML 2025), VideoREPA (Zhang et al., NeurIPS 2025), WISA (Wang et al., 2025) or simply Flow-GRPO with a physics reward at matched compute.
-
Figure 3 needs a redesign. The pipeline figure looks largely AI generated. That is fine in itself, but the result is crowded, the text is too small to read at print size, and it does not match the method text.
Questions for authors
-
Do your training templates replicate Physics-IQ scenarios?
-
Can you provide evidence that all three stages are necessary? For example, train the heads from scratch in Stage II without Stage I, and compare Stage III against Stage II trained longer with the same compute.
-
Can you ablate the noise gate, the learned spatial gate and the mask weighting? Please also report the loss ablations at the Stage II checkpoint, before Stage III, so the two stages are not mixed.
-
Can you compare against PISA on Open-Sora 1.2 and against VideoREPA / WISA on CogVideoX-5B, under your benchmarks?