- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper focuses on camera-aware text-to-motion generation, aiming to generate articulated 3D human motions that align with textual descriptions under prescribed camera trajectories. Essentially, the task seeks to control how human motions are perceived from specific camera viewpoints. To address this task, the authors propose a unified framework for motion generation conditioned on both text and camera trajectories. They also construct CAT-Motion, a dataset containing over 100K paired human motion and camera trajectory samples. Experimental results demonstrate that the proposed method outperforms existing baselines, generating human motions with accurate semantic alignment and geometric consistency.
Critical strengths
- The paper addresses a meaningful and practical task by enabling simultaneous control over camera viewpoints and human motion dynamics through textual prompts.
- The authors identify an important limitation of existing datasets, which typically focus either on text-motion pairs or camera trajectories, while largely lacking textual annotations that describe the spatial relationships between humans and cameras. The proposed CAT-Motion dataset fills this gap and provides a valuable resource for future research.
- The paper provides comprehensive experiments to validate the effectiveness of the proposed method. Additionally, the paper is well-organized, with a clear and easy-to-follow presentation.
Critical weaknesses
- The multimodal evaluator used to compute Bi-R@k, MMDist, and FD_motion is trained by the authors on CAT-Motion, and its motion-side representation is the camera-gauged D147 representation. This means that the evaluated models and the evaluator share the same representational priors. However, several baselines use different representations, such as Pulp199 for MoMask-Cam and PulpMotion-Cond, and their own VAE representation for MotionGPT3-Cam. What justifies directly using this evaluator to compare methods based on different motion representations?
- I have some concerns about the practical use cases of this task and the inference process. Specifically, what inputs are required at inference time? Does the model require a textual description, a camera-to-world pose sequence, and camera intrinsics? Requiring users to provide a camera-to-world pose sequence themselves seems impractical in many real-world scenarios.
- As shown in Tables 1 and 9, MotionGPT3-Cam slightly outperforms MLD-Cam on Bi-R@1, while MLD-Cam achieves a higher LLM Score than MotionGPT3-Cam. However, the human pairwise comparison results show that CAT2M wins against MotionGPT3-Cam by a substantially larger margin than it does against MLD-Cam. This discrepancy across evaluation metrics seems to warrant further discussion.
Questions for authors
- The user study appears relatively small in scale, with two raters each assessing 15 pairs per comparator (60 pairs per rater in total). This limited sample size seems insufficient to strongly support the claim in the conclusion that “Human evaluation further supports” the effectiveness of the proposed method.
3 comments
Thank you for the responses and clarifications. Most of my concerns have been addressed. The relevant clarifications and any necessary changes could be incorporated into the revised manuscript in a future revision. At this stage, I will maintain my original rating.
Thank you for the response! We will revise our paper accordingly.
Thank you for your constructive review. The authors have posted their rebuttal. Could you please review their response to see if you have any remaining questions?