- Rating
- 2
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper presents a well-developed system with reasonably comprehensive experiments, and the proposed components are technically plausible. However, my main concern is the limited methodological novelty and the significance of the resulting contribution. FlowTalker largely builds on established techniques in talking-head animation, including quantized motion representations, autoregressive generation, motion-history conditioning, and continuous latent refinement. Its main additions—spatially factorized token streams, directed cross-stream attention, and selective rectified-flow refinement—form a sensible integration, but the paper does not yet establish a sufficiently substantial advance over closely related approaches.
The experiments support the effectiveness of the complete system, while leaving the distinctive benefits of these design choices insufficiently isolated. Stronger comparisons under matched causal training and latency constraints, together with capacity-matched representation and refinement controls, would help establish their significance. Despite the paper’s good overall execution, I currently lean toward a weak rejection since there is no borderline option.
Critical strengths
Relevant problem and coherent system design. Generating expressive head animation under streaming constraints is practically meaningful. The factorized representation, structured autoregressive drafting, and selective continuous refinement form a coherent pipeline, with reasonable motivations for the individual components.
Good experimental coverage. The paper evaluates short and long sequences, cross-dataset transfer, and photorealistic avatar driving. The appendix provides useful analyses of window length, update stride, token specialization, directed attention, training–inference mismatch, and loss components. These experiments support the effectiveness of the complete system.
Useful implementation and evaluation details. The reported steady-state inference time includes audio and emotion encoding as well as motion generation. The photorealistic evaluation fixes the avatar, camera, and renderer, helping isolate differences in motion quality. The blinded and randomized user study provides additional perceptual evidence.
Critical weaknesses
Limited methodological novelty and contribution. The main contribution appears to be the integration of established modeling choices: quantized motion representations, autoregressive generation, structured conditioning, and continuous latent refinement. Spatial factorization, directed cross-stream attention, and selective rectified-flow refinement are sensible additions, but their combination does not yet establish a sufficiently substantial advance over closely related talking-head approaches. The paper would benefit from a clearer account of the new modeling insight and its broader significance. Integration with an existing avatar reconstruction system primarily demonstrates applicability.
The distinctive benefits of the proposed components are insufficiently isolated. The ablations show improvements within the proposed pipeline, but leave important alternative explanations unresolved. It is unclear whether the unfactorized representation matches the factorized model’s latent capacity and token budget. Similarly, removing the flow refiner does not establish its advantage over a comparable deterministic residual refiner. These controls are particularly important because the contribution depends on the significance of these architectural choices.
The causal robustness comparison mixes architecture and training conditions. FlowTalker is trained under the causal sliding-window protocol, whereas the baseline causal-gap evaluation restricts checkpoints trained under their original protocols. This provides useful deployment evidence, but does not isolate architectural robustness to limited context. Training the strongest baselines under the same causal constraints would provide a more convincing assessment of the proposed streaming contribution.
Some broader claims exceed the evaluation provided. The principal quantitative metrics remove global head pose, leaving the claimed benefits for full-head motion insufficiently evaluated. Several improvements over strong baselines are relatively modest, without uncertainty estimates or significance analysis. The latency discussion would also benefit from a clearer distinction between the 3.2-second initialization, steady-state chunk availability, and actual frame display latency.
Questions for authors
How does rectified-flow refinement compare with a deterministic residual MLP of comparable capacity? What quality–runtime trade-off is obtained with different integration steps and noise levels?
Can the strongest baselines be trained and evaluated under the same causal window, update stride, and conditioning constraints as FlowTalker?
How is the initial 3.2-second motion window emitted and played? Are initialization frames included in the reported causal metrics, and what is the actual audio-to-display latency during startup and steady-state operation?
Equation (8) applies a linear projection to flattened window-level audio features. How does this fixed-dimensional projection accommodate the full-utterance evaluation with longer windows? Are the same parameters used for both settings?