- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper identifies a structured magnitude hierarchy of MAs unique to video DiTs. It further proposes STAS, a training-free method that specifies what to steer, where to steer, how to steer, and when to intervene to improve T2V video quality and temporal coherence. The discovery of position-dependent MAs, the proposed STAS intervention, and the reported quality improvement make it a useful contribution to inference-time control of generative models.
Critical strengths
The paper identifies a structured magnitude hierarchy of MAs unique to video DiTs. Proposed a lightweight training-free, self-guidance technique that steers MAs without rerunning the backbone model and improves video quality and temporal coherence. It modifies activations inline during the standard forward pass, yielding minimum computational overhead. Comprehensive performance analysis comparing proposed scheme with 4 popular baseline models conducted.
Critical weaknesses
The paper provides a math definition of STAS. It can be significantly strengthened if the steering coefficient is a quantity derived from an optimization objective. Certain method, when improving temporal consistency, may suppress valid motion and reduce motion dynamics. The authors explicitly pointed out in the paper that there’s a reduction in dynamic degree score. Since “temporal smoothing" is a known 'limitation', some discussions and justifications on the trade-off is encouraged.
Questions for authors
Would some equally strong but spatially or temporally randomized intervention produce similar gains and why? Is the proposed solution sensitive to different VAE architectures, different temporal attention mechanisms, ……? Does it work for I2V as well? What happens in the case of long video generation? How much of the improvement comes from the underlying principle and how much depends on model specific tuning?
3 comments
Rebuttal Part 2
5. Image-to-video generation
Generalization to I2V. We apply STAS to Wan2.2-5B I2V on VBench-I2V, using the same hyperparameters as T2V:
| Method | Sub. | BG. | Smooth. | Dyn. | Aes. | Img. | I2V Sub. | I2V BG. | Quality | I2V | Total |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Wan2.2-5B | 96.09 | 95.42 | 97.61 | 45.35 | 59.35 | 70.83 | 97.58 | 98.18 | 79.05 | 97.35 | 88.20 |
| +STAS | 96.26 | 95.49 | 97.67 | 44.90 | 59.47 | 71.10 | 97.73 | 98.22 | 79.16 | 97.47 | 88.32 |
STAS consistently improves temporal consistency and visual quality in the I2V setting.
6. Long video generation
Long video generation. We focus on standard short-video generation. Many long-video methods build on short-video models and convert them into causal autoregressive generators, which changes the token structure. We leave the effect of MAs in this setting to our future work.
7. Principle vs. model-specific tuning
Principle vs. model-specific tuning. The improvement mainly stems from the principle, which fixes the core design: MA dimensions are identified by a single profiling pass, target tokens follow the VAE structure (single-frame latents and spatial boundaries), and steering is applied during high-noise steps. Model-specific tuning only adjusts the magnitude and depth, following simple heuristics: steering at 1/4–1/3 of the network depth, with smaller for larger models.
[1] Sangwon Jang, Taekyung Ki, Jaehyeong Jo, Saining Xie, Jaehong Yoon, and Sung Ju Hwang. Self-refining video sampling. In ICML, 2026
Thank the authors for taking the time to conduct the additional experiments and for addressing my concerns and questions. Appreciate your efforts. I have no additional concerns or questions.
Rebuttal Part 1
We thank the reviewer for the constructive feedback. Below we address each point and all revisions are highlighted in blue in the revised version.
1. Optimization-derived steering coefficient
On optimization-derived coefficients. Our goal is to leverage the MA findings to improve generation quality with negligible overhead. Deriving the coefficient from an optimization objective would typically require per-step gradients or extra forward passes, increasing inference cost. We agree it is a promising direction and leave it for our future work.
2. Trade-off between temporal smoothing and motion
Dynamic degree drop discussions. We agree that STAS may slightly attenuate subtle motion, and we provide more discussion of this trade-off in Appendix I of the revised paper. However, a Dynamic Degree drop does not necessarily indicate visible motion loss: the metric is threshold-based and can count artifacts such as flickering or object reappearance as motion. To quantify this, we run STAS on Dynamic-bench [1], a benchmark of high-motion prompts, and conduct a blind user study on the flip cases where Dynamic Degree changes from True (baseline) to False (STAS): 12 raters judged 33 pairs from Wan2.2-5B, Wan2.1-14B, and MiniMax-H3 (396 judgements). For each pair, raters answered two questions in order. Q1: Which video has more movement overall? Q2: Which video shows more natural and physically plausible motion?
Q1: Which video moves more?
Q2: Which video is more plausible? (grouped by the Q1 answer)
Despite the Dynamic Degree flips, raters perceive similar motion in most judgements (242/396), and in these cases STAS is judged more plausible about twice as often as the baseline (45 vs. 22). Visible motion attenuation occurs only in a minority of cases (105/396), where the baseline is preferred; we have added this discussion to the Limitations.
3. Randomized interventions
On randomized interventions. We include this control in Table 5, replacing boundary tokens with an equal number of random interior tokens under otherwise identical settings (Wan2.1-1.3B):
Random interior tokens yield only a marginal gain, well below boundary tokens. This is because the model itself assigns larger MAs to the first-frame and boundary tokens, which carry less information under the same token budget, and applies stronger rescaling of residual writing to them. STAS is inspired by this learned behavior and reinforces it, leading to better results.
4. Sensitivity to VAEs and temporal attention
Sensitivity to VAEs and temporal attention. STAS is not tied to a specific VAE or attention design. Across different backbones with diverse VAE architectures (Wan2.1, Wan2.2, CogVideoX, LTX-2, MiniMax-H3), elevated MAs consistently appear at single-frame latents and spatial boundaries. For example, while other VAEs encode only the first latent from a single frame, where MAs peak, MiniMax-H3 encodes every 17 frames into 5 latents (1-4-4-4-4), and MAs peak periodically at each single-frame latent. All use full spatiotemporal attention with 3D RoPE, and STAS improves performance on all of them.