- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper investigates text-driven human motion editing. Given 3D human motion and a text prompt, the model produces a final motion that preserves the original motion as much as possible while satisfying the text prompt. The paper identifies detail attenuation that happens during denoising as part of the problem that washes away motion details in the unedited part. It proposes SuperMotion to temporally align the source motion at each denoising step using a learned blending gate. Experiments on MotionFix and STANCE Adjustment show improvement over the baselines.
Critical strengths
- The paper nicely illustrates why existing diffusion editors look overly smooth by showing the second-order temporal difference ratio across denoising steps, which provides a clear motivation for this work.
- The methods demonstrate better performance compared to the baseline on both datasets.
- The paper also provides a clear motivation and ablation for each design, e.g., why the blending should be done in x_0 space rather than the velocity space.
Critical weaknesses
- At its core, the model is a minor modification of SimMotionEdit, using the pre-trained SimMotionEdit weights with an additional head to predict soft gating.
- The paper is framed around the fact that blending between the source and target motion is necessary at every step. However, from the Preservation strength ablation, setting the blending strength to 0 already produces 33.0% FR@1, almost similar to the full model with blending, which achieves 33.20%. Combined with Table 3, the model fine-tuned to predict v already achieves 31.03 FR@1. This suggests that most of the gain comes from fine-tuning the model to predict v and using the additional losses, rather than the blending itself.
- Overall, the papers report marginal gains over SOTA OmniME. Comparing the qualitative results, they are almost indistinguishable from OmniME, with the proposed method sometimes showing more skating, possibly due to the blending of the source motion when the global positions are different.
Questions for authors
-
What happens to the detail ratio when /gamma = 0? Since /gamma=0 in Figure 5 already achieves 33.0% FR@1 (vs. 33.20% at /gamma=1), what is the median detail ratio at /gamma=0, and what is the detail ratio of the "w/o gate" ablation in Table 3? Also, how does the "w/o gate" baseline perform if you apply L_hf directly to x0 during training?
-
Why does FR@1 drop so much on STANCE Adjustment? Can you explain why SuperMotion falls behind both OmniME (18.37% vs. 22.45%) and SimMotionEdit (20.92%) on STANCE FR@1 and FR@2 in Table 2?