- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper presents CANVAS, a training-free agentic framework for multi-shot story videos with a frozen generator. A language model compiles a story overview into a validated shot plan, and before rendering each shot is assigned a boundary label (continue from the previous last frame or open from three-view identity packs), a selected text history, an object-action contract and a denoising tier set by a hand-weighted complexity score. A verifier gates frame quality and temporal consistency, and a reviser rewrites the prompt to address the failed check. With Qwen3.8-27B, FLUX.2-klein and MiniMax-H3 shared across systems, CANVAS reaches a global ViCLIP consistency of 0.694 on ViMax-Bench against 0.528 for ViMax and 0.452 for MovieAgent, at 0.76× the denoising of a uniform 25-step pass, and is preferred in 65–75% of human judgments.
Critical strengths
The consistency gains are large and agree across evaluators under a shared backend. The planner, image model, generator, resolution, frame rate, shot length and shot count are held fixed, and against ViMax CANVAS improves ViCLIP GC by 0.166, DINOv2 GC by 0.295 and ArcFace identity by 0.210, without loss in aesthetic or imaging quality. In a blinded study with 30 raters, CANVAS is preferred over HoloCine, ViMax and MovieAgent on all four criteria.
The routing principle is simple, transferable and candidly presented. Restricting pixel inheritance to one frame within continuous action reduces within-scene handoff change from 48.6 to 3.8, and transferring identity packs raises the baselines' GC by about 0.03. The authors score their 17 failed shots and explicitly report several negative findings.
Critical weaknesses
The headline gain is not attributed to the proposed mechanisms. On the ten ablation stories the full system scores GC 0.692, and removing chaining, identity packs, contracts or adaptive steps gives 0.659–0.688, while ViMax scores 0.527. Giving ViMax CANVAS's identity packs lifts it only to 0.563, which leaves about 0.13 GC unexplained, and the conclusion concedes that "the tested ablations do not explain the full global-consistency gap". The factors that have not been isolated are CANVAS's re-authored plan (5.3 scenes per film against 2–4 in the benchmark, to which ViMax is constrained), its prompt wording and the history selector H_i, which is central to Eq. 2 but never ablated; switching the planner LLM alone moves GC from 0.692 to 0.725. Mean pairwise similarity also rewards repeated sets, costumes and framing, and no shot-scale, camera-angle or location diversity is reported. In Fig. 8, the "median-gap" example, the five displayed CANVAS shots share one room and nearly identical wide framing (GC 0.859), while ViMax's vary in scale and setting.
Three listed contributions are contradicted by the appendix. Adaptive tiers versus uniform 25 steps change GC by +0.0013 [−0.0047, 0.0069], first-attempt pass rates by tier are 0.91, 0.88, 0.89, 0.88 and 0.96, and the authors write that "the tiers do not predict what fails"; a uniform schedule at the same mean spend is not reported, and the film-level budget is exceeded in 4 of 35 films. Object contracts "do not raise measured object-state fidelity" (0.743 vs 0.721). For typed revision, E1 records that of 47 repairs "2 fixed the failed check, 44 changed nothing, and 1 made it worse", yet Table 4 credits it with a GC gain of 0.047 over a one-take arm that differs on only about 6 of 88 shots. The verifier's scoring functions, thresholds and rewrite rules are not specified.
Baseline fidelity and missing records further limit the evidence. Both ported baselines score below their published GC, unmodified ViMax failed to parse about half its camera trees, and MovieAgent's keyframes come from its own StoryDiffusion module, so the image model is not fully held fixed. CANVAS uses MiniMax-H3's multi-image reference-to-video mode with up to three attempts per shot, while the baselines use single-keyframe image-to-video with one attempt. GroundShot, described as the closest work, is not compared. Tables 8, 9, 10 and 14 state that per-story records are unavailable, and the human study treats judgments from 30 raters on 24 stories as independent.
Questions for authors
-
Can a plan-swap experiment be reported, running the CANVAS executor on the baselines' own plans and the baselines' executors on CANVAS plans, together with an ablation of H_i?
-
What are the shot-scale, camera-angle and location diversity of each system, and what is the distribution of per-story GC gaps?
-
What do a uniform schedule and a shuffled tier assignment at the same mean spend achieve?
-
How does typed revision produce a 0.045–0.047 GC gain when about 9% of shots are re-rendered, and what are the verifier's exact definitions?
-
Which timing figures and which no-chaining GC are correct, are the Fig. 1 films from ViMax-Bench, and can the missing per-story records be provided?
8 comments
Response to Reviewer xM1C (2/5)
Q3 (W3). Baseline fidelity and input route
Both ported baselines score below their published GC, unmodified ViMax failed to parse about half its camera trees, and MovieAgent's keyframes come from its own StoryDiffusion module, so the image model is not fully held fixed. CANVAS uses MiniMax-H3's multi-image reference-to-video mode with up to three attempts per shot, while the baselines use single-keyframe image-to-video with one attempt.
A3.
- Published GC uses Gemini-3-Flash with Wan2.2 or Veo 3.1. Here every system uses Qwen3.8-27B and H3, and on CANVAS's plans the ported executors reach 0.605 and 0.580 GC.
- Camera trees: ViMax's call is constrained to its own response schema with one identical retry, so its trees parse.
- StoryDiffusion: MovieAgent's executor, StoryDiffusion keyframes included, comes within 0.073 GC of CANVAS on CANVAS's plans. Replacing its keyframes with CANVAS's identity packs raises its GC by only 0.032 (Table 16).
- Reference-to-video and attempts: CANVAS's plan text through plain text-to-video with one take and no references still leads ViMax by +0.185 GC; CANVAS with one take scores 0.645 against ViMax's 0.527 (Tables 7 and 16).
Revision. Section 4.1 states, per system, the keyframe source (FLUX.2-klein, or StoryDiffusion for MovieAgent), the input route and the attempts per shot; Appendix C lists ViMax's schema change, and Appendix M adds the text-to-video control.
Q4 (W3). GroundShot
GroundShot, described as the closest work, is not compared.
A4. GroundShot (arXiv 2606.20799) has released its core code, while its repository lists GroundBench, evaluation code and runnable examples as forthcoming. It reports results only on its own GroundBench (no ViMax-Bench numbers) with Vidu Q3, Kling or Wan2.1, and uses GPT-4o and GPT-4.1 for parsing, scheduling and verification, so a matched comparison needs adapting its pipeline to the shared planner and H3. The methods differ: GroundShot builds an entity memory from accepted shots and retrieves references for each shot, while CANVAS fixes each shot's text, boundary and steps in a plan compiled before rendering.
Revision. Section 2 and Appendix L consistently describe GroundShot as a closely related system and explain its different reference-memory design, benchmark and video models.
Response to Reviewer xM1C (3/5)
Q5 (W3). Per-story records and the human study
Tables 8, 9, 10 and 14 state that per-story records are unavailable, and the human study treats judgments from 30 raters on 24 stories as independent.
A5. Records. The revision adds per-story values for the earlier-route ablations and backbones (Tables 13 and 15, for revised Tables 12 and 14), the within-run controls (Table 18), the planners (Table 25), the repair re-runs (Tables 10, 11 and 31) and the baseline executors rendering CANVAS’s plans (Table 29) and text controls (Table 30). The single-seed no-chaining run (GC 0.676) is in Table 7. The printed per-story tables identify the experiments they cover.
Human study. Table 26 reports the recorded counts and shares (240 judgments per baseline and criterion). Table 33 (Appendix P) adds 95% percentile confidence intervals from 10,000 two-way product-weight (pigeonhole) cluster bootstrap repetitions (NumPy default_rng, seed 42), independently resampling stories (24 clusters) and raters (30 clusters). Each observed judgment receives the product of its story and rater resampling multiplicities as its weight, and the preference share is recomputed for each baseline and criterion. This accounts for both sources of dependence. All 12 intervals lie above 50%. As complementary evidence scored per story on all 35 stories, two VLM judges (Qwen3.8-27B, InternVL3.5-38B) compare storyboards of each pair under neutral names, in both orders; a story counts as a win when both orders agree and half a win when they disagree. Share of the 35 stories preferring CANVAS:
| Judge and baseline | Visual quality | Text alignment | Cross-scene consistency | Character consistency |
|---|---|---|---|---|
| vs. ViMax, Qwen3.8-27B | 0.54 | 0.63 | 0.64 | 0.64 |
| vs. ViMax, InternVL3.5-38B | 0.51 | 0.61 | 0.61 | 0.60 |
| vs. MovieAgent, Qwen3.8-27B | 0.56 | 0.80 | 0.86 | 0.89 |
| vs. MovieAgent, InternVL3.5-38B | 0.53 | 0.71 | 0.73 | 0.73 |
Both judges prefer CANVAS on text alignment and on both consistency questions against both baselines; on visual quality they are near parity, consistent with Table 2.
Revision. Section 4.2 and Figure 7(a) report the human study as counts and shares (Table 26, Appendix H); Appendix H cites the clustered intervals, and Appendix P gives the two-way bootstrap method and all 12 intervals (Table 33). Section 4.2 summarizes the VLM check, with its protocol and order swap in Appendix H (Table 27) and the judge prompt in Appendix N.
Q6 (Q1). Plan swap and an ablation of Hᵢ
Can a plan-swap experiment be reported, running the CANVAS executor on the baselines' own plans and the baselines' executors on CANVAS plans, together with an ablation of H_i?
A6. Plan swap: we ran it in both directions with both baselines; the grids are in the General Response. Hᵢ: we re-authored five films with Hᵢ on and off and rendered both with the same text-to-video executor; removing Hᵢ lowers GC by 0.038 across the five stories (Table 30).
Revision. Table 4 (Appendix A.1) shows both grids; Appendix M gives the plan conversion, the ten-story executor swaps (Table 29) and the text and Hᵢ controls (Table 30).
Response to Reviewer xM1C (1/5)
We thank Reviewer xM1C for the detailed review. It led to most of the new experiments, and we agree with its central point: the submitted ablations did not explain the gain, and three contributions were overstated. The revision addresses both. Table, figure, section and appendix numbers refer to the revised PDF; quoted review text keeps the submitted numbers. The plan-swap grids are in our General Response.
Q1 (W1). The headline gain is not attributed to the proposed mechanisms
A1. The new runs isolate the factors you listed:
Figure 8. The revision describes Figure 8 as a multi-character story and adds a benchmark-script story at the median gap (Figure 9), with CANVAS's and ViMax's shots side by side, so the example no longer depends on CANVAS's own scene layout.
Revision. Appendix M attributes the gain factor by factor (grids in Table 4), and Section 5 replaces "the tested ablations do not explain the full global-consistency gap" with this attribution.
Q2 (W2). Three listed contributions are contradicted by the appendix
A2. We agree, and the contribution list changes (General Response):
Revision. Section 1's contribution list states these roles; Appendix B gives the verifier's formulas and thresholds and the reviser's rules (Table 6).