acceptodds
Under review as a conference paper at ICLR 2027

Distilling Dense Trajectory Teachers for Large-Motion Video World Models

Abstract

Video world models are expected to generate videos that accurately follow specified camera trajectories while maintaining consistent 3D structures. However, existing models are predominantly trained on densely sampled videos with small inter-frame camera motions. When applied to sparse, large-step trajectories, they often produce frozen frames, inaccurate camera motion, and severe geometric drift. We attribute this degradation to a mismatch between the gradual viewpoint transitions seen during training and the large viewpoint changes required at inference time. To address this problem, we propose Dense Trajectory Teacher Distillation (DTTD), a post-training framework that transfers a model’s generation capability from dense trajectories to large camera motions. Given a sparse trajectory, DTTD interpolates additional camera poses to construct a dense trajectory covering the same path. The frozen base model then generates reliable teacher videos along this familiar dense trajectory, and pose-aligned teacher observations are used to evaluate candidate videos generated under the original sparse trajectory. In this way, the model serves as its own generation teacher, requiring neither additional video data nor a stronger external video generator. We further combine dense-teacher supervision with geometry-aware rewards that assess cross-frame consistency and camera-trajectory following, and use the resulting preferences for offline preference optimization. To stably expand the model’s motion range, we introduce a cumulative curriculum that progressively incorporates larger motion steps while retaining simpler trajectories to reduce capability forgetting. Experiments demonstrate that DTTD effectively alleviates frozen-frame degradation, improves trajectory following and cross-frame geometric consistency under large-step camera motions, and preserves the visual quality of the base model

Then back it, or bet against it.

Related papers

Open the market on this paper to see 7 more related papers.