- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1(−1)
Read review
Paper summary
This paper introduces Möbius, a new motion-language model that unifies four tasks: motion understanding, generation, completion, and editing. Instead of existing partial motion-language integration, this model unifies motion understanding and denoising process in two seperate channels within the same latent space without VAE. It introduces two-stage training (first understanding, then generation) to effectively retain performance, with scaling to 1.7B parameters on 1,700 hours of motion data.
Critical strengths
The proposed simple yet effective architecture unifies understanding and generation within the same representation space, avoiding the burdens of training VAEs, while achieving strong results both in quantitative and qualitative experiments.
Critical weaknesses
- This work shows some examples in the qualitative study part, but is in lack of systematic human evaluation that can better support subjective visual quality
- The quantitative results in the tables do not report the multi-round 95% confidence intervals, which is the common practice for this field. Results might vary largely in different rounds.
Questions for authors
- Could you add a human preference evaluation to better show subjective visual quality?
- Are the current results from single-round evaluation runs? Could you report the results for multi-round 95% confidence intervals?
- Most existing text-to-motion evaluations use the established 263-dimensional evaluators from HumanML3D. For fairer comparison, could you also show the text-to-motion evaluation results by using the 263-style evaluators?
5 comments
Response to Reviewer CLtQ (Part2)
Q3: Text-to-motion evaluation using the established 263-dimensional HumanML3D evaluator
Thank you for this constructive suggestion. Following your advice, we converted our native 30-FPS SMPL-22 outputs to the traditional 263-dimensional format and ran an additional 20-round evaluation (with 95% confidence intervals) under the original 263-dimensional HumanML3D evaluator, alongside ground-truth test motions passed through the exact same conversion pipeline (GT 272→263, Appendix C.2, Table S10). The results show that even after cross-representation conversion, both Möbius-0.6B and Möbius-1.7B surpass real motion in R-Precision and MMDist and outperform most established baselines under the 263-dimensional evaluator:
Table S10: Text-to-motion results on HumanML3D with the original 263-dimensional evaluator. (Part of experiments.)
\hline \text{Method} & \text{R@1}\uparrow & \text{R@3}\uparrow & \text{FID}\downarrow & \text{MMDist}\downarrow & \text{MModality}\uparrow \\\\ \hline \text{Real motion} & 0.523 & 0.798 & 0.001 & 2.977 & \text{--} \\\\ \text{GT } 272\to263 & 0.486 & 0.780 & 0.381 & 3.126 & \text{--} \\\\ \hline \text{T2M-GPT} & 0.492^{\pm .003} & 0.775^{\pm .002} & 0.141^{\pm .005} & 3.121^{\pm .009} & 1.831^{\pm .048} \\\\ \text{MoMask} & 0.521^{\pm .002} & 0.807^{\pm .002} & 0.045^{\pm .002} & 2.958^{\pm .008} & 1.241^{\pm .040} \\\\ \text{MoGenTS} & 0.529^{\pm .003} & 0.812^{\pm .002} & 0.033^{\pm .001} & 2.867^{\pm .006} & 0.808^{\pm .036} \\\\ \text{MoMask++} & 0.517^{\pm .002} & 0.803^{\pm .002} & 0.069^{\pm .003} & 2.948^{\pm .007} & 1.192^{\pm .053} \\\\ \text{MoScale} & 0.540^{\pm .002} & 0.817^{\pm .002} & 0.046^{\pm .002} & 2.830^{\pm .005} & 0.873^{\pm .044} \\\\ \hline \textbf{Ours (0.6B)} & \mathbf{0.554}^{\pm .003} & \mathbf{0.843}^{\pm .002} & 0.342^{\pm .012} & \mathbf{2.740}^{\pm .008} & 1.146^{\pm .051} \\\\ \textbf{Ours (1.7B)} & 0.549^{\pm .004} & 0.837^{\pm .003} & 0.399^{\pm .019} & 2.800^{\pm .010} & \mathbf{1.715}^{\pm .060} \\\\ \hline \end{array}$$ * **Retrieval and multimodal distance:** Both Möbius-0.6B and Möbius-1.7B exceed real motion and outperform most prior methods on every R-Precision and MMDist metric (**Table S10**). * **Effect of representation conversion on FID:** Passing ground-truth test motions through the 30-FPS SMPL-22 to 263-dim conversion (*GT 272→263* in **Table S10**) already yields an FID of 0.381, while Möbius-0.6B achieves an even lower FID of 0.342 ± 0.012, showing that the cross-representation conversion itself sets a floor on 263-dim FID. Please see **Appendix C.2** (**Table S10**, referenced in **Table 1**, with MModality defined in **Appendix B.3**, **Table S8**) for the complete comparison. Thank you once again for your constructive feedback, which has substantially strengthened our empirical evaluation!We sincerely appreciate the time and effort you have dedicated to reviewing our manuscript. We have tried our best to provide responses to all of your questions and we hope our responses would address your concerns.
As the discussion period nears its conclusion, we would be grateful for any final feedback you may have. Please don't hesitate to let us know if further clarifications would be helpful - we remain ready to provide additional details as needed.
Thank you again for your valuable insights and constructive feedback throughout this process.
Response to Reviewer CLtQ (Part1)
Thank you for your valuable comments. We have addressed your concerns through a double-blind user study, 20-round confidence interval evaluations, and evaluation under the 263-dimensional HumanML3D protocol.
W1 & Q1: Adding a systematic human preference evaluation
Thank you for this suggestion. Following your feedback, we conducted a new randomized, double-blind pairwise user study with 30 independent participants rating 90 motion pairs across two fixed prompt sets (30 randomly sampled HumanML3D prompts and 30 practical user prompts written by professional animation artists, with attention checks), yielding 360 pairwise judgments (Section 4.2, Table 4; Appendix B.2, Table S7). The results show that human raters consistently prefer Möbius-1.7B over both Möbius-0.6B and the large-scale baseline HY-Motion (1B), confirming the visual quality and instruction adherence of our generated motions:
Table 4: User study on text-to-motion generation (wins / ties / losses for Möbius-1.7B out of 120 ratings per row).
\hline \text{Compared model} & \text{Prompts} & \text{Semantics} & \text{Quality} & \text{Expressiveness} & \text{Overall} & \textbf{Score} \\\\ \hline \text{Möbius-0.6B} & \text{HumanML3D} & 12\\,/\\,98\\,/\\,10 & 40\\,/\\,61\\,/\\,19 & \text{--} & \mathbf{36\\,/\\,69\\,/\\,15} & \mathbf{58.8} \\\\ \text{Möbius-0.6B} & \text{User} & 109\\,/\\,11\\,/\\,0 & 42\\,/\\,67\\,/\\,11 & 111\\,/\\,7\\,/\\,2 & \mathbf{112\\,/\\,8\\,/\\,0} & \mathbf{96.7} \\\\ \hline \text{HY-Motion (1B)} & \text{User} & 49\\,/\\,39\\,/\\,32 & 33\\,/\\,47\\,/\\,40 & 49\\,/\\,41\\,/\\,30 & \mathbf{46\\,/\\,40\\,/\\,34} & \mathbf{55.0} \\\\ \hline \end{array}$$ * **Möbius-1.7B vs. Möbius-0.6B:** Raters prefer the 1.7B model on both HumanML3D prompts and practical artist prompts (**Table 4**). * **Möbius-1.7B vs. HY-Motion (1B):** On practical artist prompts (**Table 4**), raters prefer Möbius-1.7B overall (score 55.0), driven by clear advantages in semantic alignment and expressiveness, while HY-Motion holds a slight edge in raw motion quality. Please see **Section 4.2** (**Table 4**), **Appendix B.2** (**Table S7**), the **Ethics statement**, and the **supplementary material** (for rendered user-study cases) for the full results and protocol. ### W2 & Q2: Single-round vs. multi-round evaluation and 95% confidence intervals Thank you for highlighting this standard practice. While our initial **Table 1** followed MotionStreamer's single-run MS-272 protocol, we followed your suggestion and ran 20 independent evaluation rounds with different random seeds for our models and the strongest baselines to report 95% confidence intervals (**Appendix C.1**, **Table S9**). Across all 20 runs, the resulting 95% confidence intervals are very narrow on every metric and the means closely match our single-run numbers, confirming that our improvements over prior methods are statistically stable: **Table S9: Text-to-motion results on HumanML3D with 95% confidence intervals (MS-272 evaluator, 20 runs).** (Part of experiments.) $$\begin{array}{lcccc} \hline \text{Method} & \text{R@1}\uparrow & \text{R@3}\uparrow & \text{FID}\downarrow & \text{MMDist}\downarrow \\\\ \hline \text{GT} & 0.7703 & 0.9442 & 0.0000 & 14.8785 \\\\ \hline \text{MotionStreamer} & 0.6304^{\pm .004} & 0.8497^{\pm .003} & 12.2108^{\pm .078} & 16.5812^{\pm .017} \\\\ \text{MotionGPT3} & 0.6711^{\pm .003} & 0.8816^{\pm .001} & 20.9911^{\pm .067} & 17.5660^{\pm .015} \\\\ \text{HY-Motion (1B)} & 0.7898^{\pm .004} & 0.9517^{\pm .002} & 13.5197^{\pm .081} & 14.7750^{\pm .019} \\\\ \hline \textbf{Ours (0.6B)} & \mathbf{0.8208}^{\pm .003} & \mathbf{0.9671}^{\pm .003} & \mathbf{6.1289}^{\pm .051} & \mathbf{13.9977}^{\pm .017} \\\\ \textbf{Ours (1.7B)} & 0.7969^{\pm .004} & 0.9525^{\pm .003} & 10.6640^{\pm .070} & 14.7439^{\pm .019} \\\\ \hline \end{array}$$ Please see **Table 1** (caption) and **Appendix C.1** (**Table S9**) for the full 20-round confidence interval results.