- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper proposes an approach for causal distillation of video generation model. The main components of the method include distilling a teacher model into a causal student using Distribution Matching Distillation and CausVid. The method attempts to resolve issues such as poor lip alignment with what is referred to as monotonic audio-latent alignment. Quantitative experiments are carried out in comparison with several other approaches, but favour these latter approaches mostly.
Critical strengths
The problem discussed in the paper is a key, and timely, issue in the field of causal video generation.
Critical weaknesses
1/ I found the paper very poorly written and unclear. Many of the sentences' meanings are not at all explicit, and it is left to the reader to fill in the holes. Techniques, concepts and acronyms are not introduced or explained, among other things:
- Line 38: "Wan" Wan is not explained, no reference given ?
- Line 39: "DMD ..." acronym not explained
- Line 40: "Yin et al, 2024b;a" weird citation formatting
- Line 42: "The preliminary results show why trajectory intialization alone is not a sufficient research claim". This sentence does not make sense. "Trajectory intialization alone" cannot be a "resarch claim".
- Line 47: "The key observation is that OmniAvatar (Gan et al., 2025) does not inject audio through an audio K/V cross-attention stream. Its audio path uses a Wav2Vec encoder (Schneider et al., 2019), temporal AudioPack, linear projection, and additive injection into selected DiT blocks." Impossible to understand, because nothing is introduced. What is an "AudioPack"
- Line 183: "The student is optimized with the CausVid DMD framework". Sentence is unclear, CausVid and DMD are two different papers.
- Line 189: "Let be the ..." This notation is not used anywhere else in the paper. Why introduce it ?
- Line 260: "BAII CS-Dialogue": put the reference again.
- Line 308: "Figure 1 reports the engineering benchmark that has already been recorded, but it is not directly interchangeable with the FPS column in Table". What does this mean ? Not clear. Not the same conditions? If so, what changes?
2/ There are very few visual comparisons with other methods. The only examples are with AvatarForcing and "Direct Causal DMD", and it is impossible to see anything because the images are so squashed. There are no results in any supplementary material (there is no supplementary material), and no link to any video results. Thus, it is almost impossible to correctly evaluate the results visually.
3/ The quantitative results are heavily in favour of other methods, with only speed being better for the proposed method. All quantitative quality metrics favour competing methods. This, in conjunction with the fact that no video results are shown (no supplementary material), calls into question the
4/ The visual presentation of the results is extremely poor. Figure 2 shows images which are compressed in the axis, and no effort has been made to put them into the original aspect ratio. In this same Figure, the box in green has text ("Keys/values visible ...") which is partially hidden by other text. In Figure 3, it is even worse, the images are completely flattened. I really feel you need to re-read this paper in its entirety, it gives the impression that it was done extremely quickly, with no re-reading.
Questions for authors
1/ Line 206: "The alignment can first be evaluated by a grid search and then learned with a monotonic regularizer". What is this monotonic regularizer ? (equation 3) is not used anywhere else in the manuscript.
2/ Line 212: "Let be a detected mouth region and a local feature map". Detected with what ? How are these defined? There are no details!
2/ Line 199: What is an "audio center" ?
2/ Why is Section 2.4 in the related work? It should be at the beginning of the results, since it explains your metrics. The current organisation makes things difficult to read.
"Values marked with † are proportional projections used only to complete the planned comparison and are not measured results. They must be replaced by matched-protocol measurements before submission."
#7 of https://academiahome.wordpress.com/wp-admin/post.php?post=420&action=edit