- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper presents a new efficient video generation system called PebbleVideo which incorporates DiT pruning, encoder distillation, step distillation, and quantization for on-device deployment. Its main contribution is a novel criterion that ranks DiT blocks by comparing the depth-wise sequence of denoising predictions produced by the original and block-skipped networks, using dynamic time warping for alignment. The selected blocks are structurally pruned using Optimal Brain Surgeon (OBS) and recovered through teacher-student distillation. The pipeline also compresses the text and image encoders, reduces sampling from 50 to 4 steps vid DMD distillation, and applies mixed-precision quantization. Experiments on ReCamMaster report a reduction from 8.13B to 1.57B total parameters (of the whole system) and deployment with 1.8 GiB peak memory on a mobile NPU.
Critical strengths
-
A novel block/structured pruning scheme: Rather than relying only on local representation similarity, it measures how skipping a block changes the depth-wise sequence of denoising predictions. The method seems to be superior to previously proposed heuristics.
-
The work presents a complete mobile deployment pipeline: It combines several compression techniques and demonstrates that the resulting model can run on a mobile NPU using only 1.8 GiB of peak memory.
Critical weaknesses
-
The system is not competitive with prior mobile video-generation work, and its novelty is quite limited. For example, Neodragon generates videos at 640 x 1024 x 49 resolution in approximately 7 seconds on-device, whereas the proposed system requires 146.8 seconds to generate 512 x 320 x 49, making it roughly 20 times slower despite operating at a substantially lower spatial resolution. Moreover, PebbleVideo takes an image and an existing video as inputs, making its V2V setting substantially more constrained than Neodragon’s T2V setting. Most components of the proposed pipeline are established techniques already used in prior work. The pruning scheme is the main new idea, but it is evaluated on only one V2V backbone (ReCamMaster) leaving its generality and usefulness for other models unclear.
-
The evaluation relies heavily on small differences in a custom VBench score. The paper averages only six selected dimensions rather than reporting the official aggregate score. Moreover, VBench metrics can be noisy and do not necessarily provide a reliable measure of perceptual quality, particularly when interpreting small score differences. Although the paper includes a human evaluation of the final system, it does not establish whether the small improvements attributed to the proposed pruning method are perceptually meaningful.
Questions for authors
-
Why was ReCamMaster chosen as the only backbone, given that it is specialized for camera-controlled V2V generation?
-
Can the authors evaluate TAFD and show its superiority over other heuristics on another DiT backbone, preferably a general-purpose T2V model?
-
Can the authors provide a controlled comparison with the latest mobile video generation systems (e.g., SnapGen-V, Neodragon, S2DiT, MobileWan) using the same task, hardware, resolution, and frame count? What are the advantages of the proposed system over previous work?
6 comments
Response to Reviewer JdHS (2/3)
W1.3: Its novelty is quite limited. Most components of the proposed pipeline are established techniques already used in prior work.
Thank you for your valuable comment.
Many existing studies on mobile video generation adopt a combination of model compression, few-step distillation, and hardware quantization for deployment. Our work likewise employs established DMD distillation and quantization techniques. However, we would like to emphasize that our core contribution is not a simple combination of existing techniques, but a unified framework based on functional-space compression sensitivity assessment to guide structural compression of different video generation components.
Specifically, existing compression methods typically rely on indirect proxies, such as feature similarity or changes in generation objectives, to assess component importance. These proxies may not accurately reflect the impact of structural removal on the model's core generative function. To address this limitation, we propose two key designs based on the functions of different video generation components.
-
For the DiT backbone, we map block outputs at different depths into a unified denoising function space and directly assess the vector-field deviation caused by structural removal by aligning the functional trajectories of the original and pruned models, rather than relying on indirect metrics such as local feature similarity or generation loss. Building on this, we further develop a progressive pruning and recovery strategy guided by TAFD sensitivity assessment.
-
For heterogeneous conditioning encoders, we employ cross-scale representation consistency to evaluate how well different compression strategies preserve conditioning functionality, thereby selecting either compact model replacement or in-place structural pruning. This enables encoder compression strategies to be guided uniformly by functional preservation rather than predefined empirical choices.
W1.4 & Q2: The pruning scheme is the main new idea, but it is evaluated on only one V2V backbone (ReCamMaster) leaving its generality and usefulness for other models unclear. Can the authors evaluate TAFD and show its superiority over other heuristics on another DiT backbone, preferably a general-purpose T2V model?
Thank you for your valuable and constructive suggestion.
Following your suggestion, we further apply the TAFD pruning method to Wan2.1-1.3B-T2V to validate its generalization across different DiT backbones and generation tasks.
We follow the pruning sensitivity ablation settings in Fig. 5 of the main paper, keeping the pruning configuration and recovery training procedure identical while varying only the sensitivity assessment criterion for a fair comparison. For the pruned models, we follow the official VBench evaluation protocol and report the official aggregate score (Total Score), Quality Score, and Semantic Score. The results are shown below:
| Method | Total Score ↑ | Quality Score ↑ | Semantic Score ↑ |
|---|---|---|---|
| Wan2.1-1.3B-T2V (Original) | 82.47 | 83.33 | 79.01 |
| Input–Output Deviation | 80.99 | 83.05 | 72.77 |
| DiT Output Deviation | 80.67 | 82.82 | 72.09 |
| TAFD | 81.55 | 83.30 | 74.56 |
As shown, TAFD outperforms previous feature-deviation-based sensitivity assessment methods across all three VBench metrics. These results demonstrate that TAFD is effective not only for V2V but also for general-purpose T2V generation, more accurately identifying pruning-insensitive structures and better preserving generation quality under the same compression settings.
Response to Reviewer JdHS (3/3)
W2: The evaluation relies heavily on small differences in a custom VBench score. The paper averages only six selected dimensions rather than reporting the official aggregate score. Moreover, VBench metrics can be noisy and do not necessarily provide a reliable measure of perceptual quality, particularly when interpreting small score differences. Although the paper includes a human evaluation of the final system, it does not establish whether the small improvements attributed to the proposed pruning method are perceptually meaningful.
Thank you for your valuable comments.
VBench does not support an official aggregate score for V2V tasks. Therefore, the original V2V model, ReCamMaster, does not report an official aggregate score either. Instead, it evaluates generation quality using six VBench metrics covering video consistency, visual aesthetics, and other aspects. To ensure consistency with the evaluation protocol of the original model, we adopt the same six metrics and additionally report their arithmetic mean to facilitate a more intuitive and concise comparison of overall performance across methods.
Experimental results show that our compressed model achieves an average score only 0.49 points lower than the original model, demonstrating the effectiveness of our method in preserving generation quality.
We agree that existing automated video evaluation metrics can be noisy and may not accurately reflect changes in perceptual quality. Nevertheless, VBench remains a widely adopted and well-recognized benchmark in video generation, providing a valuable quantitative reference for generation quality. For this reason, we also conducted a human preference evaluation. The results show that our method achieves a preference rate of 76.5% against on-device Sora and 38.6% against the original ReCamMaster. These results further validate the perceptible visual quality of our compressed model from a human perceptual perspective.
Q3: Can the authors provide a controlled comparison with the latest mobile video generation systems (e.g., SnapGen-V, Neodragon, S2DiT, MobileWan) using the same task, hardware, resolution, and frame count? What are the advantages of the proposed system over previous work?
Thank you for your valuable and constructive suggestion.
Following your suggestion, we further apply the complete compression pipeline to Wan2.1-1.3B-T2V, including encoder compression, structured DiT pruning, and few-step distillation. Due to time constraints, we have not yet completed mobile quantization and deployment of this model and therefore cannot provide a mobile quality–latency comparison under strictly matched hardware conditions.
However, as discussed in our response to W1.1, we have reproduced Neodragon on the same hardware platform and found that PebbleVideo achieves lower on-device inference latency at comparable visual token sequence lengths. This provides further experimental evidence of the inference efficiency of our compression method. Based on our completed T2V compression experiments, we further compare model sizes and generation quality, as shown below:
| Method | DiT Backbone | Encoder | Total Score ↑ | Quality Score ↑ | Semantic Score ↑ |
|---|---|---|---|---|---|
| Wan2.1-1.3B-T2V | 1.42B | 5.81B | 82.47 | 83.33 | 79.01 |
| Neodragon E2E | 2.97B | 1.97B | 81.61 | 83.68 | 73.36 |
| Neodragon T2V Multi-Step | 2.97B | 1.97B | 80.21 | 83.54 | 66.90 |
| Ours | 1.02B | 0.65B | 80.82 | 83.62 | 69.61 |
As shown, Neodragon achieves a higher Total score than our method through its multi-stage generation pipeline incorporating SSD-based first-frame generation, and we acknowledge this advantage. However, when excluding the multi-stage pipeline and focusing solely on model compression, we compare our method with the other Neodragon variant (reported in NeoDragen paper), which directly compresses the T2V diffusion model without SSD-based first-frame generation. Our compressed model achieves a Total Score of 80.82 with only four denoising steps, outperforming the 80.21 achieved by this Neodragon variant using multi-step generation. Furthermore, our compression pipeline reduces the DiT backbone and encoder parameters to 1.02B and 0.65B, respectively, substantially reducing model storage and weight memory overhead. We sincerely thank you again for your valuable comments.
Response to Reviewer JdHS (1/3)
Many thanks for the reviewer's valuable comments, which help us a lot to improve our work. We address your concerns as follows.
Thank you for your valuable comment.
Neodragon's video generation pipeline consists of three stages: (1) SSD generates the first frame; (2) T2V diffusion generates a video at 512 × 320 × 49 resolution; and (3) QuickSRNet performs 2× super-resolution to produce a video at 640 × 1024 × 49 resolution. Neodragon reports an end-to-end latency of 6.7 seconds for the complete pipeline.
Since inference latency can vary significantly across hardware platforms and deployment pipelines, we deploy Neodragon on the same Snapdragon 8 Elite Gen 5 platform using the same deployment procedure as our method for a fair comparison. We evaluate Neodragon with its first-frame generation and video diffusion stages, excluding super-resolution, at 512 × 320 × 49 resolution. The results are shown below:
As shown, our model performs V2V generation, whereas Neodragon performs T2V generation. Our task requires processing twice as many visual tokens, resulting in longer inference latency. However, at comparable visual token sequence lengths, our model achieves lower latency than Neodragon, indicating a lower per-token computational cost enabled by aggressive model compression.
This evaluation on the same hardware platform demonstrates that the higher latency of our model primarily stems from the greater computational demands of the V2V task rather than limitations of our method's design.
We sincerely thank you for your valuable comment.
We would like to emphasize that the core motivation of this work is to explore whether computationally intensive video generation models can be deployed on resource-constrained mobile devices solely through aggressive model compression. To this end, our objective is to develop a unified framework based on functional-space compression sensitivity assessment to select appropriate compression strategies for different components of video generation models.
Based on this motivation and objective, we explain our choice of V2V as the baseline in the Appendix C.1, Model Selection of the original paper. Specifically, at the same generation resolution and frame count, V2V processes nearly twice as many visual tokens as T2V and I2V, substantially increasing computational and memory costs. Thus, V2V imposes greater resource demands on mobile devices, better aligning with our motivation of enabling on-device deployment through aggressive model compression.
Moreover, V2V involves text, image, and video encoders, providing more diverse heterogeneous conditioning components than T2V and I2V. This allows us to systematically investigate the compression characteristics of different encoders within a single model and establish a unified functional-space compression sensitivity assessment framework, better aligning with our research objective.