- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper presents REEL, a trainable visual-memory planner for long-horizon multi-shot video generation. A Qwen3.5-9B planner uses a unified tool interface to retrieve references, create missing images, review candidates, and update memory, while per-backend adapters map its evidence plans onto frozen black-box generators, and training combines SFT with single-shot and multi-shot GRPO that carries policy-generated memory across consecutive shots. The paper contributes REEL-SFT-4k, REEL-RL-1k, and REEL-Bench (300 stories, 2,700 shots) and reports Core-100 gains on REEL-Bench, cross-shot consistency gains over the no-memory baseline on ST-Bench, and transfer to four unseen backends through adapters.
Critical strengths
A generator-agnostic planning interface demonstrated on unseen backends The paper targets the consistency bottleneck of long-horizon multi-shot generation and decouples memory planning from synthesis through a unified tool interface with per-backend adapters. The same frozen planner drives four unseen backends with no target-backend fine-tuning. This matters because generator-agnostic reuse of one memory policy is the paper's most transferable property and the clearest structural support for its generality claim.
Execution reliability at scale The full REEL checkpoint reaches 100% completion on REEL-Bench (all 2,700 requested shots, a mean of 9.0 successful shots per story) and completion 1.00 on the matched Seedance 2.0 and Kling 3.0 subsets, where the SFT planner completes only 0.54 and 0.59 of requests. Completion is measured by execution status rather than quality scores. This matters because stalled trajectories are a typical failure mode of tool-using generation pipelines, and this execution-level reliability is the paper's most robust result that does not rest on model-judged quality.
Critical weaknesses
Overstated primacy and unclear contribution boundary The concurrent work MVAgent (arXiv:2609.30609, September 2026) trains an agent for multi-shot condition construction that maintains a continuity memory, freezes the generator and judges, and optimizes per-shot rewards, a setting that closely matches REEL's. Earlier systems already cover multi-shot memory and reference selection (StoryMem, GroundShot, CoTriSyGen), and reinforcement learning for memory management is established in the LLM agent literature (Memory-R1, Mem-T). What remains relatively new in REEL is the unified tool interface with backend adapters and the multi-shot GRPO that carries policy-generated memory across shots, which amount to a combination and engineering of existing ideas. The paper presents its learned policy and backend-independent interface as the difference from prior systems, and the learned-policy part overlaps with MVAgent, which the paper does not discuss. The claim to be the first general-purpose trainable visual-memory planner therefore cannot be sustained, and the boundary of the contribution remains unclear.
Evaluation circularity and marginal external gains without significance testing The central claim is that the learned memory policy stably improves generation quality, and the evaluation cannot separate the reported improvements in quality, state compliance, and narrative coherence from in-domain optimization toward the same judge and backends used in training. REEL-Bench is judged by Gemini 3.5 Flash, the same model that scores the single-shot and multi-shot GRPO rewards, and the RL rollouts use JoyAI-Echo 1.5 and MiniMax-H3, the two backends of the main evaluation. On the external ST-Bench, the cross-shot consistency margin over the strongest baseline DirectorAgent is only 0.006 and 0.002, and global prompt following is lower. Neither benchmark reports confidence intervals or significance tests for the main comparisons, and the only analysis with Core-100 intervals excludes DirectorAgent. The abstract reports large relative gains of 15.1% and 20.7% on ST-Bench and 2.41 and 8.32 points on REEL-Bench over the weakest no-memory baseline, and the gaps against the strongest baseline are far smaller. The main conclusion of a stable quality improvement is therefore not supported.
Gains over baselines cannot be attributed to the proposed memory policy The reported gains are attributed to the learned memory planner. Every comparison against heuristic baselines bundles this planner with prompt rewriting, reference image creation, candidate review and revision, and extra generation and planning calls, so the gains over these baselines cannot be assigned to the memory policy alone. Those baselines only fill condition slots by fixed rules, and REEL additionally rewrites the full prompt, creates missing reference images, and reviews and revises candidates. The paper's own ablations show that disabling image creation and candidate review lowers the story score by 2.84 and 3.13 points. On the authors' own REEL-Bench, REEL's cross-shot consistency is lower than simple CLIP-based retrieval and StoryMem-style memory selection, and its Core-100 advantage comes mainly from motion, narrative, and prompt following. A memory-centric method that does not lead on the metric most directly tied to memory leaves the value of the learned policy unconfirmed and the share of the gain from stronger prompts and more calls undetermined, so the methodological contribution remains hard to assess.
Questions for authors
What is the minimal essential difference between REEL and the closest systems, MVAgent and GroundShot, and how much net gain remains if reinforcement learning is removed and only the tool interface and prompt rewriting are kept? Do the main comparisons pass paired significance tests, are the 0.006 and 0.002 consistency gaps on ST-Bench significant, and are all methods scored on a common set of fully completed stories? Has the shared judge for training rewards and evaluation been validated independently, and do the main results hold under an independent judge or human evaluation? What are the measured inference latency, call cost, and storage overhead relative to the general-purpose claim? Why is REEL's cross-shot consistency below CLIP and StoryMem-style baselines on REEL-Bench, and under the fixed Core-100 weights is that gap offset by the motion and narrative dimensions? Please withdraw or strictly qualify the claims of being first and of being general-purpose, and clarify the relationship to MVAgent and the reinforcement learning memory management line. Validate the main results with an independent judge or human evaluation and report agreement rates. Add paired significance tests and equal-capability controls that separate the memory policy, prompt rewriting, and extra calls. Report inference cost, failure statistics, and a limitations section, and explain the trade-off between cross-shot consistency and diversity or motion.