- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper jointly generates video, velocity, acceleration, and depth representations, integrating this information through a gated DiT. It combines real-video filtering, simulated data, and error-weighted training to improve the plausibility of dynamics. The experiments evaluate video quality, physical commonsense, and trajectories in simple scenes.
Critical strengths
Using simulated data to supplement inaccurate physical-field supervision in real videos is a valuable idea and provides more reliable training signals for some dynamic scenes. Improvements over the original backbone and the trajectory results in the appendix support the effectiveness of this training scheme in some scenarios.
Critical weaknesses
- “Physics-consistent refinement” supervises reconstruction errors within the physical-field branches without directly checking whether these fields correspond to the actual motion in the generated video. Shared hidden states allow information exchange, but the relationship between more accurate physical-field predictions and more consistent video motion remains unverified. The trajectory experiments in the appendix support improved motion in some scenarios, but do not resolve this question of correspondence across branches.
- The positioning relative to prior work is inaccurate. VideoJAM already jointly models appearance and motion, so moving physical information from external guidance into joint generation is insufficient by itself to establish the main novelty. The paper does not clearly explain what new modeling capabilities arise from adding acceleration, depth, and gating.
Questions for authors
Are the jointly generated physical fields consistent with the actual motion in the generated video? Compared with existing joint appearance–motion modeling, what specific, previously unresolved problem does this work address?