- Rating
- 3
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper presents SANA-Video 2.0, an efficient video generation model that combines linear attention, full attention, and attention residuals. The backbone uses mostly linear-attention layers, with one full-attention layer in every four layers. The paper also includes several training and inference optimizations. The results show competitive video quality and fast inference.
Critical strengths
-
The speed improvement is impressive. Generating a 720p video in about 13 seconds on a single H100 is a strong practical result.
-
The paper is very detailed thus solid. It covers the model design, data processing, training recipe, and inference optimizations, giving readers a clear picture of the full system.
-
The work has clear value to the community. An efficient video generation model, together with these detailed recipes, could be useful for both further research and practical applications.
Critical weaknesses
-
Limited novelty compared with SANA-Video 1.0 and existing work. Most main components follow existing ideas, including linear attention, hybrid attention, and attention residuals. The main contribution is combining and adapting these components for video generation.
-
The ablations could better show the benefits for final video quality. The paper includes useful attention-ratio experiments and detailed AttnRes studies in the appendix. However, the ratio comparison mainly uses validation loss after short training runs at 256p. The late-stage AttnRes comparison also gives nearly the same loss with and without the module, as the authors acknowledge. These results help explain the design choices, but leave their effect on final video quality unclear. A controlled comparison using video-quality metrics or human evaluation would make the benefits of hybrid attention and AttnRes more convincing.
-
The quality performance is not as strong as claimed. In the 81-frame comparison, the total VBench score improves only slightly over SANA-Video 1.0, from 84.17 to 84.30, while the semantic score drops from 81.46 to 79.05. The total gain is driven by the higher Dynamic Degree score, with the other dimensions together contributing negatively. More motion does not necessarily mean better video quality. These results do not show a clear overall improvement over the first version.
Questions for authors
-
Which improvements over SANA-Video 1.0 remain when model size, training budget, and inference settings are controlled?
-
How does the comparison change when Dynamic Degree is held fixed or removed from the total score? A human evaluation of motion quality and prompt following would also help explain the results.
3 comments
Thank you for the clarification and additional evaluation. I acknowledge that model size is part of the upgrade and effectiveness of the dynamic degree. However, my concerns about the novelty compared with SANA 1.0 is not fully addressed. Given the increase from 2B to 5B parameters, some performance improvement is expected from model scaling alone, making it difficult to assess the contribution of the architectural changes. I therefore maintain my rating of 3 (weak accept).
Thank you for the follow-up and your support. We would like to highlight the controlled pure-linear versus hybrid comparison in Section 5.3.1 and Figure 4, which helps distinguish the attention-design effect from the 2B-to-5B model upgrade.
All variants use 28 layers and a hidden width of 3,072, and are trained from scratch at 256p/81 frames for 10,000 steps with the same data, optimizer settings, seed and training recipe. Validation uses 200 held-out videos. Selected configurations from this sweep are:
| Attention layout | Softmax fraction | Validation MSE |
|---|---|---|
| Pure linear (SANA-Video 1.0) | 0% | 0.955 |
| Hybrid (Ours) | 25% | 0.905 |
At these fixed backbone dimensions, the 25% hybrid reduces validation MSE by approximately 5.2% relative to pure linear attention. This provides evidence for the attention-layout choice at the proxy scale, independently of the 2B-to-5B production-model comparison. We select 25% as a practical quality-efficiency tradeoff in the full ratio sweep.
Then, we try to use AttnRes to help later linear-attention layers reuse features enriched by the softmax anchors. It retains block summaries and learns how to combine them across depth. A later layer can therefore access shallow block features together with more recent, deeper representations, including softmax-anchor updates. Our early qualitative visualizations and feature analyses motivated this feature-reuse design.
We have not yet completed a full end-to-end comparison of the architectural variants at matched model scale and training budget. Our production pretraining uses 64 H100 GPUs, and the additional training runs exceed our current compute budget. We leave this controlled comparison, using video-quality metrics and human preference evaluation under matched inference settings, to future work.
Our architectural contribution concerns how to allocate softmax computation and reuse its features within a predominantly linear video-diffusion backbone. The controlled ratio study, early visualization results and state analysis support the allocation choice, while the final 5B model demonstrates the resulting complete system. We hope this makes the architectural evidence and its role in the contribution clearer.
Thank you for recognizing the practical speed and the value of the detailed training recipe. We have clarified the contribution beyond SANA-Video 1.0 and added a direct perceptual comparison to better characterize the quality differences.
Q1. What improves over SANA-Video 1.0, and which factors are controlled?
SANA-Video 2.0 advances the complete generator through model scaling, architecture and training. We scale the backbone from 2B to 5B, introduce periodic softmax anchors and cross-depth feature reuse, and upgrade shot segmentation, captioning, quality/motion filtering, the training curriculum and post-training. Our contribution is the resulting efficient video generator together with the video-specific design findings and documented training recipe. These findings include the proxy-based softmax allocation and a shared-query routing design for reusing softmax-containing block features in bidirectional video diffusion.
The architectural choices draw on the controlled proxy sweeps and early visual and feature analyses. AttnRes gives later linear layers access to softmax-enriched block summaries and combines shallow with deeper representations. Its S=8 design probe adds 3.1% latency and 2.1% memory. These observations and the cost of pretraining on 64 H100s guided the selected design, as clarified in Section 5.3.2.
Model size and training recipe are part of the upgraded system. The architecture-search studies control backbone dimensions and training settings to examine the softmax allocation, while the production comparison evaluates the combined upgrades. For the complete-system comparison, we now control the inference conditions and report direct human preferences:
We evaluated 30 prompts fixed before generation, with ten prompts each for detail/stability, motion/anatomy and semantics/composition. One author rated model-anonymized A/B video pairs, with randomized side assignment and ties allowed. Both models use matched prompts, seeds and sampling settings at 704 x 1280, 81 frames, 16 fps and 50 steps, with their native VAEs. SANA-Video 2.0 uses the ReFL-trained model.
Percentages use all 30 pairs, including ties in the denominator. The 180 criterion judgments come from one evaluator on 30 video pairs. These preferences describe the combined improvements to the complete system on the evaluated prompts.
The observed preference is substantial for overall quality (29/30, 96.67%), local detail (29/30), stability and fewer artifacts (27/30 each), and anatomical naturalness (26/30). This assesses the practical benefit of the full upgrade, including model size, architecture, data and training. Table 13 in the revised manuscript reports the same evidence.
Q2. What happens when Dynamic Degree is removed, and what does human evaluation show?
We directly assess motion quality through human judgments of stability and artifacts. We also recomputed the original rounded dimension scores after removing Dynamic Degree and renormalizing the remaining Quality weights, keeping the standard 4:1 Quality-Semantic weighting for Total:
The reweighted Quality scores are close. This sensitivity calculation and the human preferences provide complementary views: the latter directly assess the observed gains in detail and visual stability, together with prompt alignment and ties.
In the model-anonymized 30-pair assessment above, the author evaluator prefers 2.0 in 29 pairs overall, with one preference for 1.0 and no overall ties. For temporal stability and fewer artifacts, the counts are 27 preferences for 2.0, one for 1.0 and two ties each. Prompt alignment is more balanced: 16 preferences for 2.0, two for 1.0 and 12 ties. This distinction explains why a small VBench aggregate difference can coexist with a large observed preference for detail and visual stability in this assessment. We report all ties and the evaluator count, and include the Dynamic Degree sensitivity calculation in Appendix L.2.