Pixelle-Video: A Cross-Shot and Cross-Modal Coordination Framework for End-to-End Video Production
Abstract
Recent video generation models can synthesize visually compelling short clips, yet producing a complete video requires coordinating persistent information across shots, modalities, and heterogeneous production stages. We introduce Pixelle-Video, a fully automated engine for end-to-end video production. A Stateful Storyboard persists throughout production, accumulating multimodal artifacts and execution metadata as a shared evolving state across stages. Building on this, Pixelle-Video introduces two coordination mechanisms: (1) Cross-Modal Temporal Coordination, which uses the duration of synthesized narration as a shared temporal clock for visual processing and clip composition; and (2) Persistent Visual Memory, which carries character, scene, and visual references across shots and combines multimodal inspection with targeted regeneration to maintain visual consistency. Evaluations on VBench, ViStoryBench and DirectorBench show that Pixelle-Video achieves the best performance across all nine dimensions among representative automated video-production systems, spanning semantic consistency, cross-modal synchronization, and overall video quality.
Then back it, or bet against it.
Related papers
Open the market on this paper to see 7 more related papers.