- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This work studies multi-agent multi-view driving video generation. The contributions of this work are two-fold. First, the authors propose a video generation framework named CoDrive that jointly models cross-vehicle multi-view videos. CoDrive is built on top of HunyuanVideo-1.5 with local attention for intra-agent modeling and global attention for cross-agent modeling. Second, the authors present CoDrive-Bench, a benchmark for cross-vehicle multi-view driving world models. Experiments on the CoDrive-Bench benchmark show the effectiveness of the proposed CoDrive.
Critical strengths
- The experimental results on the proposed CoDrive-Bench benchmark show the superiority of the proposed CoDrive over some state-of-the-art methods.
Critical weaknesses
-
The technical contribution of the proposed CoDrive method is limited. For multi-agent video generation, combining the diffusion transformer with intra-agent attention and cross-agent attention is a straightforward idea. Intra-agent multi-view modeling is common in driving scene video generation, while cross-agent attention can be considered as an extension of cross-camera attention.
-
The contribution of the proposed CoDrive-Bench benchmark is limited. CoDrive-Bench uses CARLA to generate synthetic video data, while the proposed metrics of controllability, scene consistency, and instance consistency are common in driving scene generation.
-
Writing needs improvement, especially the introduction section. The limitations of existing methods should be clearly discussed, with appropriate citations provided for the relevant prior work. In addition, citations should be added for the baseline methods mentioned in Lines 364-366.
-
Additional experiments are needed. The proposed CoDrive method is only evaluated on the proposed CoDrive-Bench benchmark. However, to validate the effectiveness and robustness of the proposed CoDrive method, results on additional datasets are needed.
Questions for authors
-
Please address the weaknesses.
-
For a fair comparison, can the authors compare the proposed CoDrive method with more state-of-the-art driving video generation methods, such as UniMLVG, by adding cross-agent attention layers to the diffusion transformer?
-
The proposed CoDrive method uses HunyuanVideo-1.5 as the backbone diffusion transformer model, while the compared baseline methods uses other models. To ensure a fair comparison, can the authors replace the backbone with other models, such as CogVideoX?
[1] UniMLVG: Unified Framework for Multi-view Long Video Generation with Comprehensive Control Capabilities for Autonomous Driving. Chen et al. ICCV 2025.
[2] CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer. Yang et al. ICLR 2025.