- Rating
- 3
- Confidence
- 1
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes the Intentional Agent framework to address the lack of explicit internal-state modelling and continued state evolution during conversational silence in Facial Reaction Generation. Specifically, the framework uses Inner Thought Flow to integrate memory, affect, thought, and expectation, enabling the listener‘s internal state to update even when no new external event arrives. It further combines a VAD-to-Action Unit mapping with a Diffusion Transformer to translate internal affective states into facial reactions and generate fine-grained facial dynamics. Experiments and human evaluation on REACT 2025, together with adaptation experiments on Seamless Interaction, demonstrate the effectiveness of the proposed approach.
Critical strengths
- This paper formulates facial reaction generation as an explicit internal-state-mediated process and considers state evolution during conversational silence. This provides a valuable modelling perspective for listener reactions with history dependence and temporal continuity.
- The evaluation includes standard facial reaction metrics, blinded human ratings, and internal-state ablations. This paper also validates the agreement between its Reaction Quality Scorer and human judgements.
Critical weaknesses
- The key comparison changes both ITF updates and the update strategy during silence, making it difficult to determine whether the improvements arise from explicit ITF or simply from continued state updates. Moreover, the internal-state ablations primarily assess action-trigger rate, expectation error, and memory retention, without sufficiently establishing how these changes affect the quality of the generated facial reactions. Consequently, the necessity and additional benefits of ITF over simpler alternatives remain unclear.
- The method achieves favourable FRDist and diversity scores, but its FRCorr is substantially lower than that of several baselines, and its FRSyn is not the best. The human evaluation does not include competitive existing MAFRG methods, leaving it unclear whether these metric trade-offs correspond to more natural and context-appropriate facial reactions. Although reliance on automatic metrics is common in this field, the pronounced disagreement among the reported metrics warrants further investigation.
Questions for authors
- Under the same update frequency and a comparable computational budget, would replacing ITF with a history summary or state updates without thought text significantly reduce performance? Could such controls distinguish the contribution of explicit inner thoughts from that of continued updates?
- Given that Full has a substantially lower FRCorr than several baselines, how do the authors determine whether this reflects valid one-to-many reactions rather than insufficient contextual alignment? Could blinded human comparisons with representative competitive baselines clarify the trade-offs among the metrics?
- How is "zero external input" defined in the silence experiments? Are visual signals still provided when the speaker is silent? If so, how are the effects of internal-state evolution distinguished from those of continued visual input?
- How do errors in the text-to-VAD mapping affect the generated facial reactions? Given the relatively weak correlations with human annotations for Arousal and Dominance, could the authors assess this interface by replacing the affect estimator or using human-annotated VAD values?