- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper conditions Gaussian geometry offsets on global foreground/depth features and local multi-scale motion features extracted from video. An audio-input student is illustrated in Appendix C as learning video-derived teacher features. Reported comparisons show improved rendering quality, lip synchronization, and structural stability.
Critical strengths
- Distinguishing foreground–background interactions from local facial motion addresses a meaningful source of boundary and structural artifacts.
- The reported appearance, synchronization, and landmark gains support practical value; the audio-student distillation diagram also supplies a plausible route for using video-derived supervision at inference.
Critical weaknesses
- The audio-conditioned mechanism needs more specification. Appendix C, Figure 7, does show audio entering a student and frames entering a teacher. However, it does not define the audio encoding or how student features replace frame-dependent inputs to the eight modules. How this route relates to the full versus lightweight models in the results is also unclear. This is an incomplete specification, not an absence of any proposed audio-to-feature route.
- The geometric meaning of depth remains underjustified. Equations 7, 10, and 12 constrain temporal changes and smoothness, but do not identify a geometric depth target or prior. Constant depth/weights can satisfy the first two regularizers. Qualitative depth comparisons in Figure 4 are encouraging, yet the manuscript should explain what anchors depth rather than a generic useful latent feature. This does not establish actual training collapse.
- Area stability provides weaker geometric coordination than the framing suggests. Equation 21 compares only total binary-mask areas: displaced or differently shaped masks can incur zero loss. The construction and gradient path of generated-frame masks also require clarification.
Questions for authors
- What is the complete audio-student computation, how are its outputs connected to Gaussian offsets, and which inference route is used for the main full-model results?
- What geometric supervision/prior anchors depth, and how are generated-frame motion masks differentiated when optimizing Eq. 21?