- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper develops a latent flow-matching based diffusion transformer model SocialDiT to generate paired human motion sequence conditioned on the text prompts, the personality of two person and the paired familiarity. They modify the cross-attention modules by including gating mechanism to adaptively inject the personality information and familiarity information for motion sequence generation, which is referred as Social-awareness cross-attention in the paper. They train and test their model on Inter-X dataset, proving their advantages through multiple perspectives.
Critical strengths
- The paper clearly describe their objective and their methods, making it easy to understand.
- The proposed social-awareness cross-attention mechanism is intuitive and well-motivated.
- The proposed method demonstrates clear improvements over existing baselines on the Inter-X dataset.
Critical weaknesses
- The evaluation is relatively limited, as both training and testing are conducted on a single Inter-X dataset. The analysis is also insufficient to fully demonstrate the effectiveness and generalizability of the proposed method.
- The rationality of the task setting requires further justification. It would be great to provide empirical evidence demonstrating that Big Five personality traits and paired familiarity significantly influence human interaction motion patterns.
- The improvement seems to be from the combination of flow-matching losses, gating mechanism and the data augmentation, which looks too engineering and lacks deep analysis to provide new insights to this field.
- The generalization to unseen action categories is not discussed.
Questions for authors
- What is the number of parameters for your SocialDiT in comaprison with InterGen and InterMask. How do you initialize SocialDiT?
- Figure 4 is too small to distinguish the difference between your methods with other methods.