- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes using scene programs for multi-view driving video generation. Given a text prompt, a Director first generates a world script that describes the global scene state, ego trajectory, entity list, map information, and other scene attributes. A Cartographer then projects the 3D scene into a 2D layout for each camera view. The resulting layouts, together with the geometric information, are compressed using Camera Interleaving and a Shared 3D VAE, after which the model generates the final multi-view videos.
Critical strengths
- Explicit 3D scene modeling helps enhance consistency across multiple views.
- The scene program partially disentangles the 3D scene representation, providing strong editability and interpretability.
Critical weaknesses
-
When the Director generates the world script, how does it ensure that the generated trajectories are consistent with the text description? For example, if the prompt specifies that the ego vehicle or a target vehicle should make a turn, how is the generated trajectory constrained to reflect this turning behavior? In addition, how does the method ensure that the generated scene entities cover all entities present in the reference image without omissions?
-
VistaGEN [1] also introduces an evaluator to assess generated multi-view driving videos and refine them accordingly. What are the advantages and novel aspects of the proposed Auditor compared with VistaGEN’s evaluator?
-
In Table 2, the results of different methods are reported using different numbers of frames and different resolutions. I do not think these results are directly comparable, because metrics such as FID and FVD are sensitive to these factors. The authors should standardize the evaluation settings before comparison. For methods generating fewer frames, the resolution should at least be matched; for methods generating more frames, the videos should be temporally sampled so that both the resolution and sequence length are aligned.
-
Most prior multi-view driving video generation methods (such as [2,3,4]) use cross-view attention to enable information exchange across views. Why does this work instead adopt Camera Interleaving together with 3D convolutions for cross-view interaction, rather than directly using cross-view attention?
-
RGB and geometry use a shared VAE and the same positional indices. However, since the VAE performs both spatial and temporal compression, how does the method ensure that RGB and geometry remain accurately aligned in latent space? In other words, how is it guaranteed that corresponding tokens from the two modalities actually encode the same spatial regions?
-
For View-Time Permutation, does the ordering of cameras within the same time step affect the results? Is the camera order fixed, or can it be arbitrarily permuted?
-
At the beginning of Auditor training, draft videos are used for critic training. How exactly are these draft videos generated?
-
The paper lacks a comparison with Cosmos-Predict2.5/Auto/Multiview [2] (the post-trained version for autonomous driving), which should be included as a baseline.
[1] Chen L H, Cheng K, Liu Y, et al. VistaGEN: Consistent Driving Video Generation with Fine-Grained Control Using Multiview Visual-Language Reasoning[J]. arXiv preprint arXiv:2603.28353, 2026.
[2] Ali A, Bai J, Bala M, et al. World simulation with video foundation models for physical ai[J]. arXiv preprint arXiv:2511.00062, 2025.
[3] Gao R, Chen K, Xiao B, et al. Magicdrive-v2: High-resolution long video generation for autonomous driving with adaptive control[C]//2025 IEEE/CVF International Conference on Computer Vision (ICCV). IEEE, 2025: 28135-28144.
[4] Chen R, Wu Z, Liu Y, et al. Unimlvg: Unified framework for multi-view long video generation with comprehensive control capabilities for autonomous driving[C]//2025 IEEE/CVF International Conference on Computer Vision (ICCV). IEEE, 2025: 25453-25463.
Questions for authors
Please see the "Critical Weaknesses" section