- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
In my understanding, this paper introduces SkillPE, a prompt-engineering framework for improving the cinematic quality of text-to-video generation. It starts with expert-designed cinematic skills covering shot structure, camera movement, composition, lighting, editing rhythm, and sound design. The framework then uses real film clips as positive examples, negative examples, and creative near-misses to refine the skills and generate alternative versions. Each candidate skill is applied to prompts to generate videos, which are evaluated for prompt fidelity, cinematic quality, narrative appeal, and creativity. The best-performing skills are selected to form the final skill library. For the results, experiments show that SkillPE improves cinematic quality, storytelling, and creativity over conventional prompt rewriting methods. In essence, however, the method is mainly an expert rule library combined with reference-guided rule refinement and video-based candidate selection, rather than a truly autonomous or end-to-end self-evolving system.
Critical strengths
The paper addresses the real difficulty non-experts face when creating cinematic text-to-video prompts.
The paper evaluates multiple baselines, two video-generation backbones, benchmark metrics, custom metrics, and a human study.
Critical weaknesses
This method provides a rule database based on experts and a large amount of data. I think this is a good open-source contribution, but it is not a research work and does not provide me with any new inspiration. I am not sure whether such works are acceptable for ICLR. So could the author state the reusable design or findings not discovered before clearly?
The Seed Skill already provides most of the improvement, so whether the subsequent evolution is necessary is questionable. This also shows that the largest improvement comes from manual design, and fails to demonstrate that this framework can generalize to any prompt-engineering scenario.
Questions for authors
-
Could the authors evaluate the method on prompt-engineering tasks in other domains, such as advertisement generation? Otherwise, the claim that this is a general skill-evolution framework is not sufficiently supported.
-
How would the method perform if the initial Seed Skills were generated by an LLM rather than manually designed by experts? I am curious whether the knowledge from the experts is already learned by some SOTA LLM.
-
How does the size of the skill library affect the final performance? Would having too many final skills introduce redundancy or reduce the efficiency of skill selection and application? What happens if there are only five or seven Seed Skills from experts?