- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents a part-aware latent diffusion framework for language-conditioned humanoid motion generation. It introduces anatomically masked attention to learn a shared whole-body motion representation, and combines autoregressive motion generation with forward-kinematics supervision and frame-level endpoint prediction. Experiments on HumanML3D-G1 evaluate motion quality, while simulation and real-world demonstrations on the Unitree G1 examine the executability of generated motions.
Critical strengths
The paper evaluates generated motions in simulation and demonstrates their execution on a real Unitree G1 robot, providing practical evidence of the proposed framework's applicability.
Critical weaknesses
I have significant concerns about the novelty and contributions of this paper. Humanoid motion generation is closely related to human motion generation. On the one hand, this paper directly uses existing human motion generation models followed by retargeting as baselines. On the other hand, the conversion from human motion to humanoid motion mainly relies on established methods.
Given that the proposed architecture does not appear to be inherently restricted to humanoid robots, I believe it should also be evaluated on standard text-to-motion benchmarks such as HumanML3D. Furthermore, the lack of comparisons with more recent and competitive text-to-motion methods makes it difficult to assess the novelty and performance advantages of the proposed approach over existing work.
Questions for authors
- There are already many part-wise motion generation methods in the T2M literature. I suggest including more of these in the Related Work section and providing a clearer discussion of how the proposed approach differs from them.
- Were the TextOp results obtained using a model retrained on HumanML3D-G1, or using its original pretrained checkpoint? Similarly, which training datasets and checkpoints were used for DART, MDM, and AttT2M? Please clarify these in the paper.
- I suggest including more recent and closely related text-to-motion methods in the experimental comparisons.
- It seems that the existing baselines use pretrained checkpoints rather than being retrained on HumanML3D-G1. I understand that retraining all baselines would be time-consuming, but evaluating two or three representative methods trained directly on HumanML3D-G1, alongside their original human-domain models followed by retargeting, would help assess the fairness of the comparison. Alternatively, the authors could train their proposed method directly on HumanML3D and report its performance both in the original human motion domain and after retargeting to G1.
2 comments
Thank you for the response and additional experiments. Overall, I appreciate the real-robot validation, but two concerns remain:
- The response identifies design differences from prior work, but does not sufficiently explain which specific limitations these changes address. The ablations also do not adequately establish the incremental value over the closest existing methods. Targeting G1 execution alone also does not establish methodological novelty.
- I share MH8F’s concerns about the additional comparisons, particularly whether the DART-G1 adaptation was sufficiently validated and whether the results establish a clear advantage over ARDY-G1. I will not repeat those points here.
My main concerns therefore remain unresolved, and I maintain my original rating.
Response to Reviewer BX8s:Relation to Prior Part-Based Methods and Direct G1-Domain Evaluation
We thank the reviewer for requesting a clearer account of the relationship to prior part-based methods, checkpoint provenance, and recent comparisons.
Q1. Relationship to prior part-based generation. Several prior works use body-part structure, but they target different interfaces and representations. AttT2M (ICCV 2023) inserts a body-part spatio-temporal encoder into a VQ-VAE and uses global-local text attention, producing human motion in a discrete latent space. SINC (ICCV 2023) composes separately generated motions by selecting body-part trajectories at test time, while STMC (CVPRW 2024) extends spatial composition with multi-track timeline conditioning and denoising-time aggregation. TextIM (2024) uses an LLM to identify interacting parts, decoupled conditional diffusion, and a part-graph spatial-coherence module for interactive human motion. KinMo (ICCV 2025) represents six kinematic groups and uses hierarchical global/action/group descriptions with part-level generation and editing. FineMoGen (NeurIPS 2023) models fine-grained spatio-temporal composition with a mixture-of-experts attention module and dedicated annotations. FrankenMotion (2026) adds temporally aligned part captions and hierarchical part/action/sequence conditioning, which we evaluate below.
PartiGen differs along three axes. First, it takes sequence-level language without part-level text annotations. Second, anatomical masks are applied to G1 joint features before the attention projections, while all body regions remain in one shared whole-body latent; the model does not stitch independently generated part trajectories or require part-specific textual controls. Third, it is trained directly in G1 joint space with forward-kinematics supervision and evaluated for robot execution through a frozen G1 controller. The cited human-domain methods primarily report human-motion quality or controllability on SMPL/HumanML3D-style benchmarks; they do not target executable G1 references. PartiGen additionally evaluates controller tracking in MuJoCo, where 409/500 generated references pass the posture screen, and physical G1 execution, where 26/27 manually selected trials are judged successful. Thus, these works study fine-grained human-motion control through part-level prompts, annotations, or test-time composition, whereas PartiGen studies anatomical structure as an internal representation for executable robot motion.
Q2. Training data and checkpoints. TextOp was trained on the same HumanML3D-G1 split as PartiGen. The original DART, MDM, and AttT2M rows use their released human-domain checkpoints followed by GMR. FrankenMotion+GMR uses the released Coral79/frankenmotion generation checkpoint. For ARDY, we use
nvidia/ARDY-G1-RP-25FPS-Horizon52. Its native G1 outputs are mapped to the shared 23-DOF representation and resampled from 25 to 30 fps before applying the same feature extraction and evaluator as PartiGen.Q3. Recent comparisons. We evaluated the additional methods on the common HumanML3D-G1 test split:
PartiGen's values are the original multi-run results, while the new baselines are single-run evaluations. PartiGen has higher R@1 and R@3 and a 10.1% lower FID than FrankenMotion+GMR. Against ARDY-G1, PartiGen achieves 96.2% and 92.9% of its R@1 and R@3 scores, respectively, while obtaining a 5.7% lower FID. ARDY-G1 uses the 700-hour Bones Rigplay corpus, consisting of 630 hours for training and 70 hours held out for testing. HumanML3D contains 28.59 hours of distinct source motion before mirroring, and PartiGen uses its training split.
Q4. Same-domain comparison. We additionally trained DART-G1 directly on the same HumanML3D-G1 split. Its encoder and decoder architecture was retained while its motion input and output were adapted to G1. We removed the SMPL-dependent consistency loss and used the same G1 FK loss definition and coefficient as PartiGen; the remaining loss weights and original VAE/diffusion settings were retained. The resulting DART-G1 baseline is evaluated without post-generation retargeting. Together, TextOp and DART-G1 provide two directly trained G1-domain baselines under the shared dataset and evaluation protocol.