- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper addresses the computational efficiency challenge in scene-aware human motion synthesis by proposing SceShortcut, a framework based on shortcut modeling that enables one-step or few-step sampling. The key innovation is a global-to-local two-stage architecture: the global stage predicts coarse root transport velocity to guide spatial movement, while the local stage performs geometry-informed queries to generate full-body motion sequences conditioned on local scene geometry. Experiments on TRUMANS and HUMANISE datasets demonstrate 50-100× speedup compared to diffusion-based methods while maintaining comparable motion-scene alignment quality. The paper includes comprehensive ablation studies validating each architectural component and demonstrates the framework's extensibility to multi-step sampling for quality-efficiency trade-offs.
Critical strengths
1.The 50-100× speedup over diffusion baselines enables one-step or few-step scene-aware motion synthesis, transforming the task from computationally prohibitive to real-time viable for VR and robotics applications.
2.The global-to-local design effectively decouples coarse spatial navigation (root transport velocity) from fine-grained motion generation, reducing computational dimensionality while preserving geometric guidance—ablation studies convincingly validate each component's contribution.
3.Evaluation on two distinct datasets (TRUMANS, HUMANISE) demonstrates generalization across motion tasks, with appropriate motion quality and scene alignment metrics, complemented by thorough comparisons to relevant baselines.
4.The method supports flexible sampling steps from 1 to 4 and can be extended to downstream control tasks such as motion inbetweening and endpoint control.
Critical weaknesses
1.A well-known trade-off in shortcut and consistency-based generative models is the potential sacrifice of motion diversity for inference speed, as they compress complex multi-step trajectories into direct mappings. While the paper highlights a 50–100× speedup, it lacks a comprehensive quantitative evaluation of motion diversity (e.g., diversity scores or variance across different stochastic realizations for the same text-scene pair). It remains unclear whether 1-step shortcut generation produces over-deterministic or averaged motions compared with multi-step diffusion baselines.
2.The proposed global-to-local architecture relies on predicting an estimated end-root state within a single step to query local scene geometry. However, real motion trajectories evolve dynamically over both space and time. Using fixed spatial conditions derived from to guide the full motion sequence introduces spatio-temporal asymmetry. The paper lacks in-depth analysis of whether this static geometry conditioning induces subtle foot-sliding or trajectory drift, especially for motions with long spatial transitions.
3.While the limitations of extreme 1-step generation (e.g., jitter, penetration) are acknowledged, the paper lacks a systematic quantitative breakdown (such as failure frequencies or error distributions across the test set).
Questions for authors
1.The global-to-local architecture queries local geometry based on a single-step estimated end-root state . How does this static spatial conditioning handle long-range or complex spatial transitions? Specifically, did the authors observe or measure any trajectory drift or foot-sliding in intermediate frames before reaching ?
2.Since shortcut and consistency models compress multi-step trajectories into direct 1-step mappings, how does the model's generative diversity compare against multi-step diffusion baselines? Could the authors provide diversity scores or variance metrics across different stochastic realizations under the same text-scene condition?
3.While Appendix E acknowledges minor artifacts (e.g., jitter and penetration) under extreme 1-step generation, could the authors provide a systematic quantitative breakdown over the full test set? What are the exact collision/penetration rates or error distributions when reducing sampling steps from 4-step down to extreme 1-step inference?
24 comments
Q1. Evaluation of Motion Diversity
Comparison of motion diversity. We agree that maintaining motion diversity is important for one-step and few-step generation. Our original submission already reports motion diversity on TRUMANS and HUMANISE in Tables 1 and 2, using the Diversity (Div.) and Average Pairwise Distance (APD) metrics, respectively. These metrics are computed using the official evaluation code provided by SceMoS and Afford@2, respectively. For clarity, we summarize these previously reported results in Table 1 of this rebuttal, covering our method under different sampling budgets and existing baselines.
Table 1: Comparison of motion diversity across different sampling budgets and baseline methods on TRUMANS and HUMANISE. With the exception of the GT diversity score on TRUMANS, all results are summarized from Tables 1 and 2 of our original submission. Div. and APD are the respective diversity metrics for the two datasets and are not directly comparable.
| Dataset | Method | Div. | APD |
|---|---|---|---|
| TRUMANS | GT | 2.81 | / |
| TRUMANS | 2.71 | / | |
| TeSMo | 2.02 | / | |
| SceMoS (Officially reported) | 2.67 | / | |
| SceMoS (Our evaluation) | 2.59 | / | |
| SceShortcut-1step (Ours) | 2.69 | / | |
| SceShortcut-2step (Ours) | 2.72 | / | |
| SceShortcut-4step (Ours) | 2.70 | / | |
| HUMANISE | GT | / | / |
| HUMANISE | / | 6.271 | |
| Afford@2 | / | 2.625 | |
| MoST | / | 2.108 | |
| SceShortcut-1step (Ours) | / | 2.356 | |
| SceShortcut-2step (Ours) | / | 2.275 | |
| SceShortcut-4step (Ours) | / | 2.301 |
As shown in Table 1, on TRUMANS, our one-step model achieves a diversity score of 2.69, only slightly lower than that of the GT (2.81), and comparable to our 2-step (2.72) and 4-step (2.70) variants, as well as existing baselines such as TRUMANS (2.71) and SceMoS (2.67). On HUMANISE, our one-step model achieves an APD of 2.356, comparable to our multi-step variants and other baselines such as Afford@2 (2.625) and MoST (2.108). These results suggest that reducing the sampling budget from four steps to one does not substantially compromise the dataset-level motion diversity of our method. Moreover, apart from the HUMANISE baseline, which exhibits a substantially higher APD, our one-step model achieves broadly comparable dataset-level motion diversity to the other evaluated baselines, including diffusion-based and autoregressive methods.
Diversity under identical text-scene conditions. Following the reviewer's suggestion, we further evaluate motion diversity across different stochastic realizations under identical text-scene conditions on the TRUMANS dataset. Specifically, for each fixed text-scene condition, we generate 10 motion sequences using stochastic sampling while keeping all other conditioning inputs unchanged. We then measure their diversity using mean pairwise distance and motion variance, as reported in Table 2.
Table 2 Evaluation of conditional motion diversity under identical text-scene conditions on TRUMANS. For each condition, 10 motion sequences are generated using independent stochastic samples. We report the mean pairwise distance and motion variance across the generated sequences.
| Method | Pairwise Distance | Motion Variance |
|---|---|---|
| TRUMANS | 13.45 | 0.0041 |
| SceMoS | 10.01 | 0.0031 |
| SceShortcut-1step (Ours) | 15.04 | 0.0050 |
| SceShortcut-2step (Ours) | 15.49 | 0.0052 |
| SceShortcut-4step (Ours) | 15.87 | 0.0054 |
As shown in Table 2, increasing the number of sampling steps leads to a modest improvement in conditional motion diversity. Specifically, compared with one-step generation, four-step generation increases the mean pairwise distance by approximately 5.5% and motion variance by 8.0%. These results indicate that reducing the number of generation steps from four to one preserves most of the conditional motion diversity, with only a limited reduction in stochastic variation.
Furthermore, our one-step model achieves higher pairwise distance and motion variance than both TRUMANS and SceMoS under identical text-scene conditions. The relatively low conditional diversity of SceMoS may be related to its autoregressive token prediction process, which could produce more concentrated motion samples under fixed conditions. Meanwhile, TRUMANS requires additional conditioning on motion history, target pelvis positions, and action labels, which may further constrain the variability of generated motions.
Q2. Spatio-Temporal Geometry Conditioning, Trajectory Drift, and Foot Sliding
As described in Section 3.3 and Eq. (5), our global stage predicts a coarse clean root trajectory covering the entire motion sequence, rather than a single terminal root position. Based on this trajectory, we query local heightmap patches at different spatial locations along the motion sequence. Therefore, although the coarse trajectory is estimated within a single sampling step, the queried local geometry varies spatially along the predicted motion trajectory rather than remaining fixed at a single location.
Furthermore, within the same sampling step, our local stage incorporates the queried geometry to predict full-body motion and a residual correction to the coarse root trajectory. The additional root supervision and root residual regularization are designed to improve coarse root estimation and limit discrepancies between the queried geometry and the final generated trajectory. For multi-step inference, the coarse root trajectory and corresponding local geometry conditions are recomputed at every sampling step.
To investigate potential trajectory drift and foot sliding associated with within-step geometry conditioning during long-range motion generation, we evaluate the final root-trajectory accuracy, coarse-to-final trajectory consistency, and foot sliding across different spatial transition lengths on TRUMANS. Specifically, we rank all test motions according to the cumulative horizontal travel distance of their ground-truth root trajectories and divide them into three approximately equal-sized groups: Short (bottom 33.3%), Medium (33.3%–66.7%), and Long (top 33.3%).
We evaluate four root-trajectory metrics:
-
FTE (Final Root Translation Error) and FRE (Final Root Rotation Error): Measure the translation and rotation errors between the final generated root trajectory and the ground-truth root trajectory, respectively.
-
CF-TE (Coarse-to-Final Root Translation Error) and CF-RE (Coarse-to-Final Root Rotation Error): Measure the translation and rotation discrepancies between the coarse root-trajectory estimate and the final generated root trajectory, respectively.
Translation errors are measured in meters, while rotation errors are measured in degrees. We additionally evaluate the foot-sliding rate, defined as the percentage of foot-contact frames exhibiting horizontal foot displacement.
To analyze potential trajectory drift over time, we divide each motion sequence into two equal temporal halves and compute these metrics separately for the first and second halves. In particular, changes in FTE and FRE between the two halves allow us to assess whether trajectory deviations relative to ground truth become more pronounced in later frames, providing an indication of potential drift-related error growth. Meanwhile, CF-TE and CF-RE characterize the consistency between the queried coarse root trajectory and the final generated trajectory. We also examine whether trajectory drift-related errors and foot sliding become more pronounced as spatial transition length increases. The corresponding results are reported in Table 3.
Table 3 Analysis of potential trajectory drift, coarse-to-final root-trajectory consistency, and foot sliding across different spatial transition lengths on TRUMANS. All metrics are evaluated separately for the first and second halves of each motion sequence.
| Spatial Transition Length | Temporal Half | FTE ↓ | FRE ↓ | CF-TE ↓ | CF-RE ↓ | Foot-Sliding Rate ↓ |
|---|---|---|---|---|---|---|
| GT | / | / | / | / | / | 0.14 |
| Short | First half | 0.16 | 13.4 | 0.02 | 1.84 | 0.15 |
| Second half | 0.20 | 14.6 | 0.03 | 1.93 | 0.16 | |
| Medium | First half | 0.27 | 18.5 | 0.03 | 1.92 | 0.16 |
| Second half | 0.33 | 21.9 | 0.04 | 1.87 | 0.17 | |
| Long | First half | 0.35 | 27.4 | 0.03 | 1.86 | 0.16 |
| Second half | 0.43 | 34.3 | 0.03 | 1.92 | 0.16 |
As shown in Table 3, FTE and FRE increase with spatial transition length and are consistently higher in the second half of each motion sequence. In particular, for long-range motions, FTE increases from 0.35 to 0.43 m and FRE from 27.4° to 34.3°, indicating larger trajectory deviations in later frames and suggesting potential drift-related error growth. However, the coarse-to-final trajectory discrepancies remain small and relatively stable across different spatial transition lengths and temporal halves, with CF-TE ranging from 0.02 to 0.04 m and CF-RE from 1.84° to 1.93°. Furthermore, the foot-sliding rates remain close to the ground-truth reference (0.14), ranging from 0.15 to 0.17, without a clear increasing trend for longer spatial transitions. These results suggest that, although longer motions exhibit greater trajectory drift-related errors, our method maintains reasonable coarse-to-final trajectory consistency and foot stability, demonstrating a degree of robustness during long-range motion generation.
Response to Reviewer 7W6o
We sincerely thank the reviewer for recognizing the significance of efficient scene-aware motion synthesis, the effectiveness of our global-to-local architecture, and the substantial inference speedups achieved by our method. We also appreciate the constructive feedback regarding motion diversity under different sampling budgets and stochastic realizations, potential trajectory drift and foot sliding associated with within-step geometry conditioning during long-range motion generation, and motion artifact frequencies and error distributions under different sampling budgets. To address these concerns, we provide additional experimental analyses and clarifications below.