- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
X-Dancers formulates music-driven group choreography as masked completion of a continuous group motion tensor that combines individual motion representations with explicit root states. Its ChoreoGraph Transformer interleaves temporal attention with formation-grounded spatial attention, using descriptors computed from currently visible dancer positions. Spatial-temporal-channel masking enables one model to support choreography synthesis, continuation, cast extension, and trajectory control without task-specific retraining. Experiments on AIOZ-GDANCE, component ablations, and a user study demonstrate promising motion quality and group coordination under the reported trajectory-conditioned evaluation protocol.
Critical strengths
- Unified formulation. Combining motion and root states in one tensor enables synthesis, continuation, cast extension, and trajectory control through different masks without task-specific retraining.
- Formation-aware attention. Spatial attention uses the currently visible formation and updates as generation proceeds, providing a suitable mechanism for reasoning about evolving group geometry.
- Targeted ablation support. Removing formation descriptors while retaining explicit root states increases GC-FID from 7.64 to 13.72, supporting their contribution beyond raw position information.
- Strong experimental results. Under the trajectory-conditioned protocol, SC-FID improves from 16.21 to 7.25 over TCDiff++. Five-seed results and a 20-participant user study provide additional support.
Critical weaknesses
- Limited evaluation of autonomous formation generation. Quantitative comparisons provide ground-truth root trajectories, so they primarily demonstrate trajectory-conditioned motion quality. How does the method perform in fully masked composition without these trajectories?
- Confounded masking ablation. Spatial-only and temporal-only variants also remove channel masking, which directly matches the evaluation setting. Could the authors retain channel masking while independently removing spatial or temporal masks to isolate their contributions?
- Incomplete positioning within music-driven dance generation. Beyond the cited approaches, relevant work includes autoregressive models such as Transflower and MEGADance, flow-based methods such as DisCoRD and FlowerDance, and retrieval-guided systems such as ChoreoMaster, MotionRAG-Diff, and CustomDance. Discussing their relationship to the proposed framework would better clarify its contributions to fidelity, long-duration generation, and editing/control.
Questions for authors
See Weaknesses. I will raise my score if my concerns are adequately addressed.
4 comments
Response to Reviewer j9T1: W2
W2: Confounded masking ablation. Spatial-only and temporal-only variants also remove channel masking, which directly matches the evaluation setting. Could the authors retain channel masking while independently removing spatial or temporal masks to isolate their contributions?
Thank you for this suggestion, which removes a confound from our masking ablation. Following it, we have trained the two requested variants. The conclusion of the masking ablation holds with channel masking retained. Each mask family still contributes on its own, and the gain of STC-Mask comes from combining spatial and temporal completion and not from a match between channel masking and the evaluation setting. The updated study is presented Table 2 of the revised paper and is attached below as Table R2.
Table R2. Ablation study in fully masked composition (Table 2 of the revised paper). Mean ± std over five seeds. Best in bold, second best underlined.
| Method | SC-FID ↓ | BAS ↑ | Div ↑ | FSD (mm) ↓ | GC-FID ↓ | Coll. (%) ↓ |
|---|---|---|---|---|---|---|
| A1: VQVAE-based masked transformer | ||||||
| A2: Diffusion transformer | ||||||
| B1: Spatial-only masking | ||||||
| B2: Temporal-only masking | ||||||
| B3: Spatial + channel masking (new) | ||||||
| B4: Temporal + channel masking (new) | ||||||
| C1: Graph attention | ||||||
| C2: w/o formation descriptors | ||||||
| Ours (full STC-Mask) |
B3 keeps the spatial and channel masks and removes the temporal masks, and B4 keeps the temporal and channel masks and removes the spatial masks, with channel masking at its original probability in both. In addition, the entire ablation study is now evaluated in fully masked composition, where no root state is visible at the start of sampling, and channel masking therefore no longer matches the evaluation setting of any variant. As shown in Table R2, removing either family still degrades every metric relative to the full strategy, and the two families contribute different abilities. Without temporal masks (B3), individual motion suffers most, with the higher SC-FID and the lower diversity of the two variants, as the model is never trained to complete time steps from their temporal context. Without spatial masks (B4), group quality suffers most, with the higher GC-FID and collision rate, as the model is never trained to complete a dancer from the other dancers. Channel masking is beneficial in itself, as B3 and B4 improve on B1 and B2 in SC-FID, FSD, GC-FID and collision rate at a slightly lower diversity, yet both variants remain far from the full strategy, with a GC-FID of 31.65 and 36.20 against 18.97. Section 4.2 and Appendix B of the revised paper define B3 and B4 and include this discussion.
Response to Reviewer j9T1: W3 & Ending
W3: Incomplete positioning within music-driven dance generation. Beyond the cited approaches, relevant work includes autoregressive models such as Transflower and MEGADance, flow-based methods such as DisCoRD and FlowerDance, and retrieval-guided systems such as ChoreoMaster, MotionRAG-Diff, and CustomDance. Discussing their relationship to the proposed framework would better clarify its contributions to fidelity, long-duration generation, and editing/control.
Thank you for pointing us to these works. We agree that discussing them clarifies the positioning of the paper, and we have added the discussion to Section 2.2 and Appendix J of the revised paper. All seven comparison works address single-dancer generation, and our proposed X-Dancers differs from them in modeling the motion and the placement of all dancers jointly and in unifying composition, continuation, cast extension and trajectory control as conditioning masks of one model. Their relationship to X-Dancers in the three aspects that the reviewer names is summarized below.
For long-duration generation, the autoregressive models reach long sequences through causal prediction. Transflower predicts a distribution over the next poses with a normalizing flow conditioned on past poses and music through a multimodal transformer, and MEGADance predicts quantized dance codes with genre-routed mixtures of autoregressive experts and a sliding window for long sequences. X-Dancers obtains continuation from a temporal prefix mask within bidirectional masked generation, and the same model thereby also conditions on future and cross-dancer context, which a causal factorization does not expose.
For fidelity, the flow-based methods improve the quality or the efficiency of single-dancer motion in a continuous space. DisCoRD decodes discrete motion tokens into continuous motion with rectified flow, and FlowerDance generates an entire sequence in a few steps with MeanFlow and a BiMamba backbone. X-Dancers shares the continuous formulation, as each cell is sampled by a diffusion head trained with a velocity objective, but it generates continuous tokens directly instead of decoding discrete ones, and each cell couples the motion token with the root state.
For editing and control, the retrieval-guided systems derive their fidelity and control from an external motion library and from phrase-level user choices. ChoreoMaster synthesizes dance along a motion graph built from a dance motion library under a choreomusical embedding, MotionRAG-Diff refines segments retrieved from such a graph with a diffusion model for long-term music, and CustomDance lets users select retrieved phrases that a music-conditioned diffusion model connects by inpainting. X-Dancers is library-free and exposes control through the conditioning mask over dancers, time steps and root channels, which the model learns to follow under STC-Mask. The two forms of control are complementary, as retrieved or user-selected phrases could be supplied to X-Dancers as visible cells.
We thank the reviewer again for the careful review and the constructive suggestions, which have aligned the evaluation with the joint-generation claim and clarified the positioning of the paper. We hope that our responses address the concerns, and we would be glad to provide any further clarification.
Dear Reviewer j9T1,
As the discussion period is closing, we would like to kindly ask whether our response has addressed your concerns. If any point remains unclear, we would be glad to clarify it before the deadline. We sincerely thank you for the time and the constructive feedback.
Best,
Paper 50089 Authors
Response to Reviewer j9T1: W1
W1: Limited evaluation of autonomous formation generation. Quantitative comparisons provide ground-truth root trajectories, so they primarily demonstrate trajectory-conditioned motion quality. How does the method perform in fully masked composition without these trajectories?
We agree with the reviewer that a comparison under ground-truth root trajectories primarily demonstrates trajectory-conditioned motion quality and leaves autonomous formation generation unevaluated. To answer how the method performs without these trajectories, we have re-evaluated all methods and ablations in fully masked composition, where no root state is supplied and every method generates the formation together with the motions from the music and the cast size alone. X-Dancers attains the best formation quality among all methods in this setting, and it remains the best method on five of the six metrics. The ablations attribute the result to the joint progressive generation of root state and motion token and to formation-frame attention. The previous protocol is retained as a trajectory control experiment, in which the same model follows prescribed root paths most closely. The updated results are reported as the mean and standard deviation over five sampling seeds.
Table R1. Baseline comparison in fully masked composition (Table 1 of the revised paper). Mean ± std over five seeds. Best in bold, second best underlined.
X-Dancers remains the state-of-the-art method when the formation is generated autonomously. As no root trajectory is supplied, GC-FID and the collision rate now measure the formation that each method generates, and X-Dancers attains the best GC-FID and the collision rate closest to that of the ground truth. It also achieves the best SC-FID, BAS and FSD, and the autonomous formation is therefore not obtained at the cost of the motion quality of each dancer. TCDiff++ is the strongest baseline and generates trajectories and motions in one stage, yet it distinguishes dancers by identity encodings without conditioning their poses on the formation, which yields a higher diversity at a lower fidelity of the generated choreography. Our method instead makes motion synthesis aware of the formation by coupling a continuous motion token with an explicit root state in every cell, and by grounding inter-dancer attention in the evolving formation through the formation-frame descriptors computed from the root states. As the dance motions are correlated and refined together with the evolving formation, the model learns to generate casts with natural spacing and coherent formations while keeping the motion fidelity of each dancer, although no formation or root trajectory is provided in advance.
The ablations in fully masked composition trace the formation quality to the design choices. The ablation study is re-evaluated under the same setting and is given as Table R2 in our response to W2. Removing the formation descriptors while keeping the explicit root state in every cell (C2) raises GC-FID from 18.97 to 27.91 and the collision rate from 0.974% to 1.105%. Replacing formation-frame attention with graph attention (C1) raises them further to 32.42 and 1.427%. The root states alone therefore do not make the attention across dancers aware of the formation, and it is the formation frame built from them that does. The effect of the descriptor ablation, which the reviewer lists among the strengths, thus persists when the formation itself is generated.