- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes an image-compatible framework for text-conditioned 3D human motion generation across datasets with different skeletal layouts. It separates motion into global root dynamics and root-centered joint trajectories, organizing the latter into fixed-resolution joint–time images based on kinematic topology. A two-stream autoencoder encodes both motion components, with root-conditioned image decoding. A text-conditioned Scalable Interpolant Transformer (SiT) jointly generates their latents through flow matching, with additional supervision on decoded 3D joint positions. The framework also enables shared training on HumanML3D and KIT-ML using dataset conditioning and dataset-specific motion recovery, without skeleton retargeting or joint padding. Experiments compare dataset-specific and shared models against existing methods, alongside component ablations.
Critical strengths
- The paper presents a coherent framework that incorporates motion-specific structures into image-based generation through topology-informed joint ordering, root-conditioned decoding, and 3D position supervision. Ablation studies support several key components, demonstrating the effectiveness of adapting image-based architectures to structured human motion.
- The method achieves strong results on HumanML3D and KIT-ML, with the shared model obtaining the best reported performance across all six metrics on both datasets. Its improvements over dataset-specific models, without requiring skeleton retargeting, demonstrate the practical value of shared modeling across skeletal layouts.
Critical weaknesses
- The contribution of the image-compatible representation is not sufficiently isolated. The paper lacks controlled comparisons with alternative motion representations and an ablation on topology-informed joint ordering. Therefore, it remains unclear how much of the performance improvement comes from the proposed representation rather than other design choices, weakening the evidence for its central methodological contribution.
- The methodological novelty relative to prior work is not fully established. Motion Patches (CVPR 2024) explored image-compatible motion representations, while SALAD (CVPR 2025) combined skeleton-temporal latent modeling with diffusion-based motion generation. Although this paper introduces distinct components and shared modeling, its advances over these related approaches are not clearly distinguished, making its specific novelty difficult to assess.
Questions for authors
- Can the authors provide evidence isolating the benefits of the image-compatible representation from other architectural and training choices? In particular, how does it compare with non-image motion representations under controlled settings, and how sensitive is performance to topology-informed joint ordering?
- How does the proposed framework differ from Motion Patches (CVPR 2024) and SALAD (CVPR 2025) in terms of its core methodological contributions? Clarifying these distinctions would help assess the novelty and significance of the proposed approach.