- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates the issue of geometric modeling in the representation and generation of human motion. The authors point out that existing methods typically employ representations in Euclidean space that contain redundant information, failing to fully exploit the intrinsic geometric structure of human movement. To address this, the paper proposes "Riemannian Motion Generation" (RMG), which decomposes motion into global translation and joint rotations, and generates motion via Riemannian flow matching on a product manifold. The framework integrates geodesic interpolation, supervision of velocities in the tangent space, and ODE integration that preserves manifold constraints, resulting in a unified training and sampling process.
On the HumanML3D dataset, this method achieves an FID of 0.043; on MotionMillion, it attains an FID of 5.6 and an R@1 of 0.86. Ablation studies further demonstrate that using a compact representation—consisting solely of translation and rotation—outperforms configurations that incorporate additional positional or temporal difference terms, both in terms of generation quality and guidance stability.
Critical strengths
-
Unified and compact geometric modeling of motion. The paper organizes global translations and joint rotations into a product manifold and integrates this with Riemannian Flow Matching, ensuring a consistent geometric foundation for both motion representation and the generation process. This design reduces redundancy in the representation; ablation studies further demonstrate that this compact representation of translation and rotation leads to superior generation quality and improved guidance stability.
-
Strong experimental performance with adaptability to varying data scales. On the HumanML3D dataset, RMG achieves an FID of 0.043—slightly outperforming the 0.045 reported for MoMask—while maintaining competitive results in terms of text-motion alignment and diversity. On the MotionMillion dataset, RMG attains an FID of 5.6, significantly surpassing the 10.3 achieved by the strongest baseline. These results underscore the framework's effectiveness across different data scales.
Critical weaknesses
-
Lack of direct validation for the core geometric contribution. While the paper posits that modeling on a Riemannian manifold enhances human motion generation, the existing ablation studies primarily compare different representation components. There is no direct comparison against standard Euclidean Flow Matching—using the same translation/rotation representations, network architecture, and training budget—to isolate whether performance gains stem from the compact representation or the Riemannian generation process itself. This represents a significant evidentiary gap regarding the paper’s central claim and complicates the assessment of the method's true innovation.
-
Insufficient validation of the practical benefits of geometric modeling. The paper employs unit quaternions to represent rotations; however, it remains unclear how sign-convention consistency is maintained during prior sampling, geodesic interpolation, and inference. Furthermore, while manifold constraints ensure the validity of rotation representations, they do not inherently guarantee that the generated human motions adhere to physical constraints, such as joint range-of-motion limits or contact constraints. The current experiments lack direct metrics—such as foot-sliding, violations of joint constraints, or temporal continuity—making it difficult to determine whether the geometric modeling approach actually improves these specific aspects of motion quality.
Questions for authors
Q1. Regarding the contribution of the core methodology: Could the authors compare Euclidean Flow Matching with Riemannian Flow Matching while keeping the representation of translation and rotation, the network architecture, and the training budget constant? This experiment would be crucial for assessing the independent contribution of the geometric modeling approach.
Q2. Regarding the handling of quaternions: How do the authors consistently account for the equivalence between and across training data, prior sampling, geodesic interpolation, and ODE integration? Specifically, are there any issues with discontinuities or numerical instability, particularly for rotations approaching ?
Q3. Regarding ablation studies and motion quality: Since different motion representations require distinct conversion pipelines to be evaluated within a unified format, how do the authors ensure that errors introduced during these conversions do not confound the ablation results? Furthermore, are there metrics—such as foot sliding or joint range-of-motion—that could directly substantiate the claim that the geometric modeling approach improves the plausibility of the generated motion?
I appreciate your careful response, which has addressed most of my concerns. I will keep my score unchanged, and I am happy to leave the final decision to the AC / co-reviewers.