- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper presents PersonaAct, a dataset and benchmark for generating conversational body motion from speech audio, motion descriptions, and natural-language persona profiles.
The dataset contains 15.3 hours of performances across 302 personas, with synchronized speech, body, hand, and facial motion. The current benchmark focuses on body motion. The authors adapt existing generation models and introduce a learned persona–motion evaluator to measure how well motions match persona profiles.
Critical strengths
- The dataset addresses a useful problem: generating conversational motion that reflects a natural-language persona. Capturing hands and faces alongside body motion also makes the data useful beyond the current benchmark.
- The supplementary examples show a useful range of performances, from restrained gestures to large, expressive movements.
- The conditioning ablations across different baselines are informative.
Critical weaknesses
- Could the authors clarify whether any motion smoothing or artifact correction was applied beyond the temporal processing described in Appendix A? If videos of the original performances were recorded, will they also be released?
- Do method rankings under P-M agree with human judgments? Could the authors also report the proportion of uncertain responses and inter-rater agreement?
Questions for authors
Please refer to the weaknesses above.
Response to reviewer DE8d
We thank the reviewer for the positive assessment and helpful feedback, and for recognizing the value of PersonaAct and our conditioning ablations. We address your questions below.
W1: Motion processing and availability of original recordings
Thank you for requesting clarification. Beyond the temporal processing described in Appendix A, we applied motion smoothing to improve temporal continuity. We recorded synchronized videos of the original performances, but these will not be publicly released to protect performers’ privacy. Researchers with a specific need may contact the authors to request access under strict restrictions. We will clarify these details in the revised paper.
W2: Agreement between the P-M evaluator and human judgments
Thank you for this suggestion. We evaluated 6 methods, with 30 clips per method and 10 ratings per clip (1,800 responses in total). Human scores are the percentage of all ratings selecting the target persona. P-M scores were computed on the same motion–persona pairs.The results are summarized below.
Thank you again for recognizing the value of PersonaAct and for your helpful suggestions. We will incorporate the additional processing details and human-evaluation results into the revision to make our documentation and evaluation more complete.