- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper introduces Metric Attribute Guidance (MAG), a sampling-time method for controlling numerical motion attributes in a frozen text-to-motion diffusion model. MAG recovers world-space joints from the diffusion posterior mean, computes differentiable attribute proxies, and applies gradient updates with temporal DCT projection, gradient clipping, and delayed guidance. The interface exposes eight attributes, seven of which are actively guided; tempo is excluded from guidance. Experiments on independently trained MDM models using HumanML3D, KIT-ML, and an internal Basketball dataset show improved correlations between commanded and realized attributes, with centimetre-level errors for some vertical attributes. The central contribution is an interface that expresses motion requirements as measurable numerical targets. The results support useful numerical steering of selected attributes. However, they do not yet establish a broadly applicable interface that achieves accurate physical commands while preserving valid human motion.
Critical strengths
-
The problem formulation is practically meaningful. Specifying jump height, average speed, or path length directly provides an intuitive complement to language and spatial constraints. These quantities also make control outcomes explicitly measurable.
-
The method addresses a concrete failure mode. Gradients of extremum-based attributes can concentrate on individual frames and produce temporal spikes. The DCT projection has a clear motivation and supporting evidence: Table 15 shows that removing it increases reach Peak Jerk from 221 to 3518.
-
The experiments include useful comparisons and diagnostics. The paper evaluates numerical prompting, attribute-conditioned training, OmniControl, and DNO using the proposed attribute objective. The appendices additionally examine attribute leakage, joint commands, retrieval under permuted commands, and skeletal deformation. These analyses expose important limitations rather than hiding them.
Critical weaknesses
-
The attribute definitions do not adequately support the claimed universal physical semantics. Jump height and crouch depth use the median root height of the entire clip as their baseline. Appendix A explicitly acknowledges that a person who remains crouched for most of a clip and briefly stands up can receive a positive jump-height measurement and approximately zero crouch depth, even when the feet never leave the ground. This affects the meaning of the interface itself. A command to “jump 0.3 m” may be satisfied by raising the root 0.3 m relative to the clip’s median height, without performing the intended jump. Likewise, sustained crouching may not receive the expected crouch-depth measurement. Calibration on clips dominated by a neutral stance does not establish validity for these other motion categories. The evidence therefore supports control of particular trajectory descriptors more strongly than universally meaningful jump and crouch commands.
-
Accurate attribute measurements can be achieved through invalid body deformation, and the motion-quality evidence remains incomplete. Using the same analytical function to define and evaluate a target is reasonable. The concern is that this function cannot distinguish legitimate motion from deformation. Appendix J provides a direct example: the eighth HumanML3D reach command has only 0.020 m error while the arm chain elongates by 17.9% on average. Although the authors classify these upper commands as stress conditions, Table 15 also shows a substantial quality trade-off for jump commands within the stated feasible range. MAG has a Foot Skate ratio of 0.57, compared with 0.25 for Unguided, and Peak Jerk of 5866, compared with 2578. Comparisons at matched realized jump heights are needed to distinguish effects of motion amplitude from artifacts introduced by guidance. Consequently, low attribute error and preserved text retrieval do not establish successful execution of a physical command. The central claim requires evidence that the same generated samples jointly satisfy numerical accuracy, skeletal consistency, contact plausibility, and caption semantics.
-
High correlation does not establish accurate numerical control, and the main control evaluation has limited coverage. In Table 2, MAG’s response slopes for path length and net displacement are only 0.42 and 0.52, with median absolute errors of 1.34 m and 0.60 m, respectively. Speed error is 0.49 m/s, and facing-change error is 45.6°. These results demonstrate responsiveness to commands, but substantial response compression and numerical error remain. Facing control deteriorates further on KIT-ML, where the median error reaches 95.8°. Moreover, the main control curves largely rely on one fixed caption per attribute, with nine command levels and eight samples per level. Appendix F reports that the central speed-command range spans approximately 0.44 m/s, while the realized spread at individual levels is approximately 0.2–0.6 m/s. A high correlation across a much wider range, including extreme commands, therefore does not demonstrate reliable fine-grained control within the normal operating range. Retrieval experiments over the full test split broaden the assessment of text alignment, but do not establish command accuracy across diverse captions and action categories.
Questions for authors
Refer to Critical Weaknesses
2 comments
W3 — correlation vs. accuracy, compression, single caption.
- The compression came mostly from evaluating the attribute objective over the padded sampling tensor rather than the clip's valid frames, which the revision corrects (original protocol; α / ρ / P50):
| submitted | revised | |
|---|---|---|
| Speed | 0.79 / 0.92 / 0.49 m/s | 0.85 / 0.93 / 0.29 m/s |
| Path | 0.42 / 0.97 / 1.34 m | 0.97 / 1.00 / 0.12 m |
| Net disp. | 0.52 / 0.97 / 0.60 m | 0.99 / 1.00 / 0.07 m |
| Facing | 0.40 / 0.63 / 45.6° | — / 1.00 / 5.3° |
| Jump | 0.58 / 0.76 / 3.7 cm | 0.99 / 1.00 / 1.7 cm |
| Crouch | 0.49 / 0.54 / 10.2 cm | 1.03 / 0.99 / 1.9 cm |
| Reach | 0.89 / 0.98 / 1.8 cm | 0.90 / 0.99 / 2.7 cm |
Where: §4.3, Table 2.
-
The submitted levels came from whole-clip statistics (2–10 s) while clips are generated at 3 s, so the top path command (24 m in 3 s) was unattainable. We add a duration-matched protocol with levels from 3-s windows, and report per-level errors. Speed is weak on the fixed jogging caption: guidance cannot slow it below about 0.7 m/s. Where: Appendix B, Table 5; Appendix G, Table 18; Appendix K.1.
-
Over 20 natural HumanML3D test captions per attribute (5 in-range levels × 2 seeds), in-range median errors are 0.02 m/s, 0.12 m, 0.07 m, 5.3°, and 1.3, 1.5, 2.4 cm (speed, path, disp., facing, jump, crouch, reach). Where: Appendix B, Table 9.
-
KIT-ML facing: with joints recovered in their native units before conversion to metres (recovery integrates the root's angular velocity, so the earlier scale also rescaled the heading), it reaches ρ 1.00, median error 4.0° (95.8° submitted). Where: §4.4, Table 3.
We thank you for the most precise diagnosis of the paper's weaknesses; each point led to a revision or a new measurement. The revised PDF is uploaded with every change highlighted in yellow, and the numbers below refer to it.
W1 — jump and crouch semantics. Agreed. With a clip-median baseline these are root-displacement descriptors. The evaluation now counts a jump only if a flight phase is detected (all four foot joints ≥ 6 cm above rest for ≥ 2 frames with the hip above standing height; on ground truth it fires on 89% of jump clips and 1% of arm-raise clips). The height is also realized in that flight: in 78% of in-range MAG samples the hip height within the flight phase is within 5 cm of the command (85% with kinematic terms). Measured from the fixed standing height instead of the clip median, jump still follows the command (ρ 0.87, median error 3.1 cm), but crouch does not (ρ 0.11): the caption already produces a sustained crouch, and the command sets the additional dip below it. Your reading is correct for crouch, and the revision states that crouch depth is a relative descriptor. Where: §3.1; Table 2 caption; Appendices A–B.
W2 — deformation, contact, matched height. Your example (eighth reach level: 0.02 m error, arm +17.9%) was real: guidance could move feature channels that are constant in the training data, such as the pelvis offset. Holding them fixed lowers the in-range torso deviation on jump from 9.7% to 1.4% and the leg deviation on reach from 18.8% to 0.8%; on reach the median error rises from 1.1 to 4.0 cm, which we report. Where: Appendix B.
We adopted your criterion as joint success on the same sample: a clip passes only if it is accurate (5 cm for heights, 0.25 m for path and displacement, 0.1 m/s, 15°), its five bone chains and its foot contact are no worse than the unguided backbone's against the fixed dataset skeleton and real-data references, and, for jumps, it shows a flight phase. In-range commands, one fixed caption per attribute (Table 6):
"+kin." adds bone-length and ground-penetration terms to the objective; they help DPS as much as MAG. Over 20 natural captions per attribute, MAG + kin. passes on 0.49–0.83 against 0.09–0.23 unguided (Table 9). With fixed real-data thresholds instead (Table 7), pass rates fall for every method and the backbone itself rarely passes; MAG's main remaining failure is foot skating on locomotion commands, which the kinematic terms do not target, and a contact term is the direct next step. Caption semantics is assessed at the set level rather than per sample: R@1 is unchanged under commands (Table 1), also with commands taken from unrelated clips (Table 17). Where: Appendix B, Tables 6–7, 9; Appendix G.
On the jump trade-off you cite (foot skate 0.57 for MAG vs. 0.25 unguided): that unguided column is numeric-prompt sampling with a different caption. With the same jump caption, unguided sampling skates 0.57 and MAG 0.59. Binned by realized jump height, MAG shows no extra degradation over the unguided backbone (skate 0.49–0.58 vs. 0.55–0.56 between 0.2 and 0.4 m); the bins hold 4 to 29 samples, so this does not exclude a contribution from the update. Where: Appendix B, Table 8.
What remains: at the two stress levels the error stays small but the motion is not physical (reach stretches the arm chain by 44% and 93%; jump sinks the body), and the reach→jump coupling (ρ 0.91) comes only from those levels. Where: Appendix E, Table 12; Appendices G, K.2; supplementary
fig_operating_range.