- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes DramaDirector, a framework for generating multi-shot short dramas from plot descriptions through geometry-guided storyboard planning. The method introduces a structured storyboard representation that separates static visual conditions from dynamic narrative instructions. The authors trained a text-visual alignment model to retrieve depth and pose references from a real short-drama database to guide first-frame generation. The authors further train the storyboard planner using multi-task SFT and GRPO, incorporating visual retrievability as a reward signal. They also introduce DramaBoard, a benchmark containing over 100K annotated shots from 35 short dramas. Experiments demonstrate improvements over existing methods in narrative quality, instruction following, and video generation quality.
Critical strengths
-
The paper addresses an interesting and practical problem in multi-shot video generation. Using depth and pose references to bridge the gap between textual storyboard planning and visual generation is a reasonable approach.
-
The authors construct a relatively large-scale short-drama benchmark with shot annotations, dialogue, and geometric information. The paper also provides extensive experiments and compares the method with recent baselines.
Critical weaknesses
-
In Table 4, the proposed method achieves only 9.54% Recall@10 and 14.29% Recall@20. Although these results outperform the baseline methods, the absolute retrieval accuracy is quite low and it is unknown whether the retrieved depth/pose references actually provide suitable geometric guidance. Also, the paper does not sufficiently demonstrate how retrieval accuracy correlates with actual spatial correctness in the generated videos.
-
The contribution of the retrieval-based GRPO reward seems relatively weak. In Table 13, incorporating the full retrieval reward only improves Recall@10 from 1.54% to 1.90% compared with SFT-only training. Moreover, the reward is computed by comparing generated storyboard descriptions against geometry from the target episode and a sampled negative episode, which does not necessarily reflect the geometric correctness or generation quality of individual shots.
-
The evaluation seems not to sufficiently measure the geometry-related improvements in the generated videos.Metrics such as retrieval accuracy, first-frame quality and video consistency do not directly show whether the generated videos follow the retrieved poses, whether depth and spatial relationships are preserved, or whether the camera movement is accurate. The human evaluation also focuses on general perceptual quality rather than geometry-specific correctness. It would be great if the paper can include more direct quantitative and human evaluations of spatial controllability.
-
Given the retriever is imperfect, and the short drama dataset has limited diversity, I'm wondering how the model behaves in such cases: for example, the storyboard requires a scenario that contains e.g. 4-5 people, but the retriever only obtained a depth map or pose video of e.g. 2 people. How will the generated video look like in such scenarios?
Questions for authors
See weaknesses