- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper introduces AdSpark-300K and AdSpark-Bench, addressing the under-researched task of product center advertising video generation. The dataset contains a huge number of samples with structured annotations. The benchmark evaluates beyond visual quality through metrics such as product fidelity, shot structure and execution, temporal coherence, audio alignment, and advertising effectiveness. The authors compare numerous open-source and closed-source models, demonstrating that fine-tuning LTX-2 on this dataset significantly enhances cross-shot consistency, shot fidelity, and narrative coherence. As a dataset/benchmark paper, this work exhibits notable practical value and potential community impact.
Critical strengths
The proposed task is pratically meaningful and important, while the proposed dataset is large-scale with complete annotation and cleaning process, which sounds like high quality. The hierarchical metrics and detailed experiment can provide important reference for this area.
Critical weaknesses
- the data generation and annotation process are high dependent on VLM, it will be more acceptable with a sampling manual inspection.
- Data deduplication and leakage analysis are insufficient. Table 3 combines indicators with different scopes and directions, lacking definitions for confidence intervals and significance tests.
Questions for authors
- How to ensure the generation and annotation quality of the automatic process?
- Is there any data deduplication analysis or significance analysis?