- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper proposes a framework for generating human motion corresponding to theatrical lines by leveraging theatrical priors, such as play scripts.
The framework consists of three components: Acting Mind, which extracts structured information from the script; Acting Morph, which retrieves relevant examples from a theatrical motion database based on this information; and Acting Creation, which generates the corresponding human motion. Specifically, Acting Mind uses an LLM to extract emotional cues and contextual information about the characters from the script. Acting Morph then performs semantic and emotional similarity-based retrieval over a database of theatrical examples, combining the retrieved information into an acting mode matrix that characterizes the intended performance. Finally, Acting Creation leverages the outputs of the two preceding components to condition a human motion diffusion model.
To support this framework, the authors introduce TheaterAct, a dataset comprising human motions extracted from theatrical videos using off-the-shelf 3D human pose estimation methods, along with annotations describing the plays, characters, and corresponding lines.
Finally, the authors evaluate their approach against baseline methods using human preference studies, standard quantitative metrics, and newly introduced metrics designed to assess the intensity and emotional expressiveness of the generated motions.
Critical strengths
-
The paper addresses a highly relevant and new problem: theatrical human performance generation. This setting offers an interesting setup to investigate the relationship between emotion and human motion in a nuanced and naturalistic context, beyond conventional synthetic scenarios.
-
The proposed dataset is a valuable contribution to the field and provides a useful resource for future research on theatrical performance and expressive human motion generation.
Critical weaknesses
-
The paper is difficult to follow, and several aspects of the proposed approach would benefit from clearer explanations and a more structured presentation.
-
The evaluation protocol appears relatively limited and provides insufficient insight into the effectiveness of the proposed method. In particular, comparing against pretrained models trained on HumanML3D and prompted with theatrical lines may not provide a sufficiently strong baseline, as these inputs are likely to be out of distribution. Stronger baselines should be considered, such as straightforward fine-tuning of existing pretrained checkpoints on the proposed TheaterAct dataset, to better isolate the benefits of the proposed framework.
-
Similarly, the user study is biased and does not capture the subjective nature of theatrical performance and emotional expression. A more fine-grained evaluation would be valuable, for example, by asking participants to identify the emotions conveyed by the generated motions. Given the inherently subjective nature of the task, a carefully designed user study should be a central component of the evaluation.
-
The qualitative results are not entirely convincing. For instance, in the example "Frailty, thy name is woman" with increased anger intensity, the generated motion exhibits artifacts, including discontinuous movements. Moreover, the increased anger intensity appears to be expressed primarily through more vigorous arm and leg movements, rather than through a more nuanced and realistic portrayal of anger.
-
Further ablation studies would strengthen the evaluation. In particular, the contribution of each loss component should be investigated individually, rather than focusing primarily on the emotion loss, to better understand the role of each component in the overall framework.
Questions for authors
-
Is the selection of emotions considered in this work grounded in an established psychological framework or prior study? Clarifying the rationale behind the choice of emotions would strengthen the methodological foundation of the work.
-
Have the authors considered evaluating their approach against larger-scale pretrained motion generation models, such as HY-Motion (Tencent, 2025) or KIMODO (Rempe et al., 2026), which are trained on substantially larger datasets and may therefore support a broader range of prompts?