- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
MNCFR proposes a diffusion framework for facial reaction generation inspired by embodied simulation. RFM maps the speaker's multimodal behavior and the listener’s past reactions into listener-side conditioning representations, with auxiliary EEG supervision, while MAR uses short-term memory and diffusion-timestep gating to improve temporal continuity. The method achieves high reaction appropriateness on MARS (offline FRCorr: 0.802; online FRCorr: 0.715), but some baseline values are inconsistent with the cited sources, and its diversity and synchrony scores are not the best. The main concerns are that the core speaker-to-listener transformation lacks an explicit mathematical definition, and that the correlation between EEG prediction performance and generation quality does not establish that the model implements embodied simulation. The mechanistic interpretation therefore appears somewhat overstated.
Critical strengths
-
The framework separates current reaction formation (RFM) from historical context modulation (MAR) and incorporates auxiliary EEG supervision, providing a clear modeling approach for multimodal facial reaction generation.
-
The paper includes offline and online evaluations, component ablations, temporal smoothness analysis, and subjective perceptual evaluation. Multiple metrics demonstrate the method's potential advantages in reaction appropriateness and temporal continuity.
Critical weaknesses
-
The motivation for explicitly modeling the transition from perception to reaction is not sufficiently clear. The paper does not establish which aspects of this transient process existing methods fail to capture, how substantial these limitations are, or how they affect the quality of generated reactions.
-
The caption of Table 1 states, "Published baseline values follow the REACT 2025 report." However, several reported baseline values appear inconsistent with the sources. For example, the original REGN paper reports an FRDist of 141.93, whereas Table 1 reports 155.49. The benchmark version is also insufficiently specified. REACT 2025 introduced the MARS dataset, while REACT 2026 extended the tasks to include EEG prediction and personalized generation. The paper does not clearly identify the exact official results used or reconcile the numerical discrepancies across sources. These ambiguities make the reliability and comparability of the reported results difficult to assess.
-
The function in Eq. (7), which represents the central speaker-to-listener transformation, is not explicitly defined. In particular, the mathematical correspondence between and components such as the Mirror Mapper and FiLM Generator is unclear. This leaves the computation underlying the method’s central transformation insufficiently specified.
-
Eq. (11) defines the gating coefficient as . If encodes only the diffusion timestep and receives no additional sample-specific inputs, samples at the same timestep share the same gating coefficient. The coefficient is therefore not explicitly conditioned on the current speaker behavior, listener identity, or memory content. Although the modulated representation can still differ across samples, the gate itself appears to implement diffusion-timestep-conditioned context scaling.
Questions for authors
-
What evidence supports the need to explicitly model the perception-to-reaction transition? Which specific aspects of this brief transition are inadequately captured by existing methods, and to what extent does this limitation affect generation quality? What experimental evidence isolates the benefit of explicitly modeling this transition?
-
Could you clarify and reconcile the sources of the baseline results in Table 1? Which REACT edition, task, and official result source does each baseline value correspond to? In particular, why is REGN's FRDist reported as 155.49 rather than the 141.93 reported in its original paper? Were all compared results obtained using the same dataset splits, task settings, and evaluation protocols?
-
Could you explicitly define in Eq. (7)? Please specify its inputs, outputs, and computation, and explain precisely how the Mirror Mapper and FiLM Generator correspond to this mapping.
-
Does the gate in Eq. (11) receive any sample-specific information beyond the diffusion timestep embedding? If not, how should its role in adapting memory importance to the current context be understood, given that samples at the same diffusion timestep share the same coefficient? Please distinguish the adaptivity provided by the gate from that already present in the modulated representation .