- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces EmoTrace-Bench, a diagnostic benchmark for emotional expression in text-to-video generation. It contains 448 controlled prompts covering eight emotions, two intensity levels, and multiple affective cue conditions, and evaluates 5,376 videos generated by twelve models. Using automated evaluation validated against human annotations, the authors separately assess target-emotion presence, perceived intensity, and ten audiovisual cue dimensions. The results suggest that explicit character reactions are generally more effective than scene- or event-only descriptions, while adding affective cues does not consistently improve performance.
Critical strengths
The problem has practical significance. Emotional generation can fail through an incorrect emotion category, inadequate intensity control, or an inappropriate mode of expression. A single video–text similarity score cannot readily distinguish these failures. Evaluating these aspects separately is a well-motivated and valuable research direction.
Critical weaknesses
W1: The referent of the target emotion is insufficiently specified. The benchmark jointly evaluates character expressions and behaviors, scene atmosphere, and audiovisual form. However, emotion can refer to the affective state of a character, the affective tone of the environment, or the emotion we experience while watching the video. It remains unclear whether the shared target-emotion label conflates these objectives and whether this ambiguity affects model performance.
W2: The central motivation that aggregate metrics overlook localized failures lacks direct experimental validation. The paper argues that holistic video–text alignment metrics cannot distinguish failures in emotion category, intensity, and affective cue realization. However, the experiments primarily report results from the proposed evaluation framework without directly comparing it with representative aggregate metrics.
Questions for authors
See weaknesses.