- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes SFVD, a framework for reducing the optimization complexity of video dataset distillation by representing each synthetic video with a single learnable image. The authors argue that the increased number of learnable parameters introduced by the temporal dimension makes conventional video dataset distillation difficult to optimize. Experiments on several dataset demonstrate improvements in classification accuracy and computational efficiency over the reported baselines.
Critical strengths
- SFVD and SFVD-T outperform the reported baselines across the four evaluated benchmarks.
- SFVD significantly reduces the distillation cost.
- The single-frame design considerably reduces the storage requirements of SFVD.
- The authors demonstrate Performance improvements when transferring distilled datasets to other architecture.
Critical weaknesses
- The idea of exploiting temporal redundancy and representing videos using a small number of learnable frames has already been investigated in prior work (e.g., Dancing with Still Images-CVPR'24, PRISM: Video Dataset Condensation with Progressive Refinement and Insertion for Sparse Motion-CVPR'26). Although the authors have compared their work with CVPR'24 work they have not mentioned about CVPR'26 work and properly compared with them. Furthermore, PRISM is particularly relevant because it also addresses the redundancy and optimization cost of video dataset condensation. However, PRISM is neither discussed nor experimentally compared in the submitted manuscript. This omission makes it difficult to asses the novelty and competitiveness of SFVD under comparable accuracy, storage, and computational budget.
- The authors attribute the difficulty of conventional video distillation primarily to the increased number of learnable parameters. However, the experiments do not adequately distinguish parameter dimensionality from other factors, including temporal information, optimization objectives, and representation constraints. Figure 5(b) shows that increasing the number of distilled frames reduces accuracy, but this observation alone does not establish that optimization dimensionality is the underlying cause.
- SFVD-T incorporates sampled real videos into the distilled representations, which raises questions about the contribution of the distilled frames relative to the additional real video information. The paper does not sufficiently isolate the benefit of the proposed fusion mechanism from that of simply including real video samples.
Questions for authors
- How does SFVD differ fundamentally from PRISM (CVPR 2026), particularly in its use of sparse learnable representations and interpolation? Could the authors provide comparisons under matched IPC, storage, and computational budgets?
- What experimental evidence establishes that the number of learnable parameters, rather than the optimization objective or temporal representation, is the primary source of convergence difficulties?
- In SFVD-T, how much of the performance improvement comes from the additional real video samples rather than the proposed channel reshaping module or the distilled images themselves?
- Since the implementation duplicates a single synthetic frame across the temporal dimension, what benefit does differentiable interpolation provide in this specific setting?