- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies structured compression and efficient inference for single-stream audio-video diffusion transformers, with DaVinci-MagiHuman as the target model. The proposed method, CROWN, operates in two stages. It first converts the 32 shared FFNs in DaVinci-MagiHuman into three-expert Top-1 SparseMoE layers. It then applies Elastic Expert Neuron Pruning (EENP), which estimates neuron contributions separately for video, audio, and text tokens and uses these estimates to construct nested Quality and Fast widths. However, dense-to-MoE conversion and sparse MoE have all been explored in prior work. The main contribution of CROWN is therefore modality-wise normalization and fusion with fixed 3:1:1 weights, which seems like an engineering trick.
Critical strengths
-
Measured reduction in denoising latency: The experiments indicate that CROWN reduces DiT denoising latency from 26.83s to 20.92s at a 60% pruning ratio.
-
Large parameter reduction at comparable CLIPScore: In the generalization experiment on MAGI-2 Preview, the method reduces the parameter count from 114B to 48.8B while retaining comparable CLIPScore.
Critical weaknesses
Major weaknesses
W1. Incremental novelty: Dense-to-MoE conversion and sparse MoE have all been explored in prior work. The main contribution of CROWN is modality-wise normalization and fusion with fixed 3:1:1 weights, which seems like an engineering trick.
W2. The pruning evaluation is not comprehensive: The evaluation of the proposed pruning focuses mainly on video. It reports no audio results and no video-audio alignment results for the pruned model, both of which are also important in video-audio joint generation.
W3. No user study: The submission contains no user study.
W4. No playable video samples: No generated videos are available in the supplementary material. Without playable samples, the quality of the video and therefore the performance of the proposed method are hard to evaluate independently of the reported scores.
Minor weaknesses
W5. Limited improvement over Wanda: Table 7 in the supplementary material indicates that the proposed EENP has limited improvement over Wanda (0.4791 vs. 0.4737).
W6. Choice of the 3:1:1 setting: It remains unclear why the fusion weights are set to 3:1:1 rather than, for example, 2:1:1 or 2:2:1. Absent a comparison against such intermediate settings, the choice reads as an engineering trick.
W7. Figures not cited in the main text: Several figures are not cited in the main text, including Figures 1, 4, and 6.
Questions for authors
See Weaknesses.