- Rating
- 2(+1)
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper proposes EvoReel, a training-free agentic harness for long-horizon video generation. All models stay frozen. The harness writes the script with role-specific agents over a story memory, renders each shot with references from a visual memory, and uses self-judges to revise weak scripts and re-render failed clips. It also builds an experience memory from past runs to guide new scripts.
Critical strengths
- The authors put clear effort into the experimental design and the benchmark construction. The overall presentation of the experiments is fairly standard and well organized.
- The method is close to plug-and-play. It is training-free and works with many kinds of models, both open-source and proprietary.
Critical weaknesses
- The human evaluation is limited. The study in Appendix A is small and preliminary, with three annotators, and one of them is an author. It is also not used to validate the automatic metrics. For a generative model, human judgment is a key source of evidence. Quantitative metrics and AI judges alone are not enough to show the real quality of the results.
- The "evolving" concept is overstated. In essence, the method is a memory retrieval process. I do not see the harness itself evolving. This is quite different from AutoHarness or Evo-Bench, where the harness optimizes itself.
- The overall presentation is unusual. The text reads as if it was heavily polished by AI. The main contributions do not stand out. The paper lists many components, but most of them feel like simple LLM-based designs. The novelty is limited.
- Figure 3 does not meet the usual standard of the venue. The lines are not aligned, and several labels and symbols are unclear. The fonts and spacing are inconsistent.
- I am not sure this paper fits ICLR. It also does not seem to fit a CV venue. An ACL-related venue may be a better match.
Questions for authors
- The anonymous link in the paper does not work. At the time of my review, it showed nothing. This is a video generation paper. Without any demo, even a cherry-picked one, it is hard for me to trust the actual visual quality.
- As a suggestion, the authors may consider extending the method to audio-video generation, for example with open-source models such as MiniMax-H3. Pure video output has limited expressiveness, and an audio-video version could make the system more practical.
- Which results use Veo 3.1 and which use LTX-2.3? Could the authors also report the cost of generating one film, including the number of model calls, the token usage, the extra renders from the video self-judge, and the total cost in dollars?
Hi Reviewers,
The authors have posted their rebuttal along with new experimental results. Please review their responses, engage with the authors to discuss any remaining concerns. Best,
Area Chair