- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This article addresses the limitations of traditional conversational agent alternating interaction: AI remains silent when the user speaks, lacking real-time emotional feedback. It proposes a new task of multimodal continuous full duplex emotional interaction, which requires the agent to synchronously complete perception and multimodal feedback output.
Critical strengths
1.The article constructs a time-series aligned dataset called ContinuEI. 2.Based on Qwen3-Omni, an FuSE framework is proposed, which adds an Actor module and utilizes dual stream conditional modeling and spatiotemporal attention to achieve low latency joint generation of text, speech, and facial animations. 3.Experiments have shown that FuSE improves interaction naturalness and reduces response delay compared to cascaded baselines.
Critical weaknesses
1.The characteristics of the dataset proposed in the article are not obvious, and compared with multiple existing head datasets, there are more head data related to emotions. The citation of the article is also incomplete, lacking many related head motion datasets. 2.The method of the article lacks innovation and does not have a special design based on the characteristics of the data.
Questions for authors
1.The characteristics of the dataset proposed in the article are not obvious, and compared with multiple existing head datasets, there are more head data related to emotions. The citation of the article is also incomplete, lacking many related head motion datasets. 2.The method of the article lacks innovation and does not have a special design based on the characteristics of the data. 3.As a head motion related job, there is almost no display of dynamic effects. This kind of work cannot be accepted. 4.The experimental comparison method is too limited, and many well-known open-source methods have not added comparisons.