- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes an agentic pipeline for generating multi-shot short dramas. The inner loop chains a Planner, an Asset module with gray-box layout, a Director with identity binding, a Render step, a Reviewer and an Editor. The outer loop performs recursive self-improvement: a Failure Packet is attributed to a pipeline stage, the harness is updated, the update is validated by frozen replay and a paired canary run, and a Promotion Gate decides whether to keep it. The authors also introduce DramaR²-Bench, consisting of 15 videos scored on 6 drama-level dimensions and 5 pairs scored on 2 pair-level dimensions, with Qwen3.5-Omni-Plus assigning 0-100 scores. Reported results are Total 90.20 versus 88.39 for ViMax, Drama Overall 89.49 versus 86.78, CSD 57.48 on ViStoryBench and 84.41 on VBench.
Critical strengths
- The Promotion Gate, which requires frozen replay and a paired canary before accepting a harness change, is a sensible guard against regression drift in self-modifying pipelines.
- The pair-level evaluation across episodes addresses cross-episode consistency, which existing video benchmarks do not cover.
Critical weaknesses
- The recursive self-improvement claim is not isolated by any experiment; the inner loop already contains five separate improvements (gray-box layout, multi-view references with identity binding, pre-render checks, scoped context, boundary-checked editing), and no inner-loop-only baseline or per-round curve is reported.
- The evaluation is 15 videos and 5 pairs with no variance or confidence intervals, scored by a single VLM with no human agreement rate, and Figure 2 is explicitly labeled as illustrative with no measurements.
- Figure 3 shows only static frames, which cannot support claims about temporal coherence.
Questions for authors
- What is the score of the inner loop alone, with the outer loop disabled?
- What is the agreement between Qwen3.5-Omni-Plus scores and human raters on the 15 videos?
4 comments
Response to Reviewer wUwp(2/2)
W3. Evidence for temporal coherence
The complete videos corresponding to Figure 3 in the paper are available in Section 1 of the anonymous demo page (https://anonymous.4open.science/w/bsjfdjhdf/), under Three Sunsets. This section presents the same story from all five methods, so reviewers can inspect shot transitions, character continuity, dialogue, and story progression directly. It is the ocean-liner story in which a florist and an aristocratic passenger promise to share three sunsets before their voyage ends.
The new human comparison evaluates cross-episode causality and continuity after watching the sequences. Their means increase from 4.0 to 4.5 and 4.2 to 4.3 after the update. Automatic Pair scores also improve across all five cases when the three repeated evaluations are averaged. Section 3 of the demo page (https://anonymous.4open.science/w/bsjfdjhdf/) presents the production of The First Drop, including local segment repair, a one-second crossfade between segments, and timed subtitles. The completed episode can be watched directly in the same section.
E1. Character provenance and AI-content disclosure
All character faces in the experiments are AI-generated. No real-person face photographs were used as inputs or reference portraits, and the videos depict fictional characters. The experiments therefore do not involve unauthorized use of real individuals’ facial images or portraits, addressing the concern about consent and likeness use.
A gentle discussion-phase reminder
Dear Reviewer wUwp,
Thank you very much for your great efforts in reviewing this paper and for your recognition of our work!
As the end of the discussion period is approaching, we are eagerly anticipating your feedback to ascertain if our responses have adequately addressed your concerns. Your feedback will be instrumental in enhancing the quality of our manuscript. We would appreciate the opportunity to address any additional concerns you may have before the discussion period ends.
Thank you once again for your time and consideration!
Sincerely,
The Submission 1777 Authors
A Gentle Reminder Before the Discussion Deadline
Dear Reviewer wUwp,
Thank you again for your careful review and constructive suggestions.
As the discussion deadline approaches, we would greatly appreciate your feedback on our responses. We would be happy to clarify any remaining questions.
Thank you for your time and consideration.
Best regards,
The Submission 1777 Authors
Response to Reviewer wUwp(1/2)
To Reviewer wUwp
Dear reviewer, thank you for your comments. We address each concern point by point below.
With the outer RSI loop disabled, the initial harness runs the inner production loop with fixed rules. On DramaR²-Bench it obtains 88.51 Drama Overall, 63.30 Pair Overall, and 75.91 Total Avg. After RSI, the complete DramaR² system obtains 89.49, 90.90, and 90.20, respectively. The Pair gain is 27.60 points, with cross-causality and cross-continuity increasing by 24.80 and 30.40 points. Table 1 gives the dimension-level comparison.
The initial harness is the Baseline in Figure 4 of the paper. It retains story planning, asset management, rendering, review, local repair, and editing. The later checkpoints at Rounds 6, 9, and 12 measure production with the updated harnesses, with Round 12 corresponding to the complete system. Figure 2 illustrates the workflow, while Figure 4 reports the measured trajectory.
To examine one update separately from the cumulative results, we compare the frozen parent and updated harnesses on the same five episode-pair cases under a common base runtime and primary models. The parent harness obtains 89.63 Drama Overall, 84.03 Pair Overall, and 86.83 Total Avg. Its updated successor obtains 90.08, 91.93, and 91.00, respectively. Both harnesses remain fixed during production, and each result averages three fresh evaluations of the same completed videos.
The updated harness retains the parent rules, allocates shots to each intercut location, and explicitly stages successive emotional changes. On the 1–5 human rating scale, Drama averages change from 3.53 to 3.57, and Pair averages from 4.10 to 4.40. All five cases have positive mean automatic Pair gains. This comparison measures how a reusable update affects later productions.
Table 1. Inner-loop-only and post-RSI performance across DramaR²-Bench dimensions. (a) Drama-level.
(b) Pair-level and total performance.
The 15 videos and five episode pairs are per method. Across five methods, the original evaluation covers 75 videos and 25 pair tasks from ten source cases. These cases comprise five standalone stories and five two-episode stories. Figure 2 explains the method, while Figure 4 in the paper reports measured checkpoint results.
We added case-cluster uncertainty estimates that keep related episodes together. The original Drama Overall difference from ViMax is +2.71 points, with a 95% interval of [1.08, 4.76]. In the new policy comparison, Drama and Pair differences are +0.45 [−0.67, 1.61] and +7.90 [3.37, 13.27]; exact two-sided sign-flip tests give p = 0.5625 and p = 0.0625. Repeated judgments are averaged within cases, so cases remain the independent analysis units.
The follow-up human study uses a 1–5 scale, with ten ratings per task. The ten evaluators have backgrounds in film aesthetics, regular short-drama viewing, or short-drama production. DramaR² has the highest reported human mean across all eight dimensions, with Drama and Pair averages of approximately 3.73 and 4.40.
Using these expanded human ratings, we compare human and Qwen3.5-Omni-Plus Total Avg. rankings across the five methods. The method-level Spearman correlation is ρ = 0.90, with an exact two-sided permutation p = 0.0833. Human and automatic evaluations agree on 90% of pairwise method rankings and both rank DramaR² first.
For the same-video rater check, ten evaluators rated the first episode of A Marriage of Convenience and then the ordered episode pair. For each dimension, we compare pairs of raters and count score differences of at most one point. This percentage is 96.30% across the six episode-level dimensions and 100% across the two pair-level dimensions. These values describe agreement among raters on this example; the correlation above measures human–automatic agreement at the method level.