- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper introduces ChoreoStudio, a structured choreography planning framework for music-driven group dance generation, aiming to improve formation evolution and inter-dancer coordination. The key idea is to explicitly decompose group choreography into three planning decisions, including formation geometry (what), transition timing (when), and dancer mobility (who), before generating the detailed body motions. A multi-scale music encoder extracts segment-level structural information used for director planning and frame-level rhythmic features for generating detailed motion. A Director is introduced to predict relative formation coordinates, dancer relations, transition timing, and mobility to construct a group choreography plan. The group plan is then encoded into dancer-specific conditioning features and cross-dancer attention biases to guide a diffusion-based motion generator. Additionally, a verifier evaluates the generated motion and provides feedback for iterative replanning. Experiments on AIOZ-GDance show that the proposed framework improves group-motion realism, coordination, and formation dynamics over existing baselines.
Critical strengths
-
This paper addresses a meaningful limitation of existing music-driven group dance generation methods, which often focus on local motion synchronization and coordination but lack coherent formation across different music intervals. Explicitly modeling group-level choreography is well-motivated and important for generating more natural and structured group dance performances.
-
The proposed idea of decomposing group choreography into formation geometry (what), transition timing (when), and dancer mobility (who) is interesting and meaningful for the problem. Jointly modeling these aspects is a promising direction for incorporating high-level choreography planning into the motion generator, rather than relying entirely on implicit coordination within the dance generator.
Critical weaknesses
- Although the proposed what-when-who decomposition is interesting, I think the technical framework is not sufficiently justified to support this key claim of explicit choreography planning and guidance. Despite the elaborate formulation of formation geometry, dancer relations, transition timing, and mobility, these variables are mainly encoded into conditioning features or attention bias, and serve as inputs for the diffusion motion generator, rather than explicitly enforcing their constraints during denoising. Although the intervention experiments show some response to plan changes, it remains unclear whether the generator can reliably follow these choreography decisions or simply treats them as additional conditioning information.
- The overall framework seems overly complicated relative to the actual improvements. The system introduces multiple conditioning features, planning variables, and a likely expensive verification and replanning process. However, the gains over some baselines (e.g., TCDiff++) are relatively modest, while removing the Director or Verifier even results in worse performance than this baseline (Tables 1 and 3). The paper lacks sufficient justification for why such a complex design is necessary, and computational efficiency is also not investigated. In turn, this also makes the methodology quite difficult to follow. Several important variables, such as the group state , the feedback , group representation , and state change is not clearly defined or explained in the main text.
Questions for authors
-
Could the authors clarify how the proposed plan-to-motion interface provides explicit choreography guidance beyond conventional feature conditioning? How can we verify that the generated motion faithfully follows each choreography decision, particularly transition timing and dancer mobility, rather than simply responding to changes in conditioning features?
-
Could the authors further justify the necessity of the proposed what-when-who decomposition? What are the specific advantages of modeling these variables separately rather than using simpler spatial or trajectory-based conditioning?
-
Given the complexity of the entire framework, could the authors clarify the performance gains over simpler baselines such as TCDiff++ ( which jointly generates group dance through a more straightforward diffusion process without iterative verification and replanning)? Could the authors also provide a performance-efficiency analysis to better justify the complexity?
-
Could the authors analyse the computational overhead introduced by the Director, multimodal conditioning and iterative verification and replanning, compared with existing baselines?
3 comments
Dear Authors,
Thank you for the clarifications, which have mostly addressed my concerns. I would remain positive about the paper. However, I still believe the paper could further benefit from additional analysis and experiments by comparing with simpler spatial or trajectory-conditioning baselines, which can potentially highlight the effectiveness of the proposed what-when-who decomposition.
Best
Thank You for Your Feedback
Dear Reviewer,
Thank you for your positive assessment and for acknowledging our clarifications. We agree that a comparison with simpler spatial or trajectory-conditioning baselines would help clarify the contribution of the what–when–who decomposition.
A controlled comparison would require implementing and retraining these alternatives under the same generator architecture and evaluation protocol. As this goes beyond the experiments completed for the current response, we will consider it in future work.
Best regards,
The Authors
Clarifications on Explicit Planning and Efficiency
Thank you for the thoughtful comments. We have clarified the plan-to-motion interface and its limitations, expanded the explanation of the planning variables, and added a performance–efficiency analysis.
1. Explicit guidance and plan realization. We agree that the plan does not impose hard constraints at every denoising step. It guides the diffusion generator through frame-aligned instructions and relation-aware attention biases. Its explicitness lies in the intermediate decisions: formation, transition timing, and dancer mobility have defined meanings, are supervised using targets extracted from motion, and can be inspected and edited before generation. We have clarified this distinction in the method section.
To test whether these decisions affect the intended motion properties, Table 4 reports paired interventions that edit one plan component at a time while fixing the music, initial state, actor seeds, and diffusion noise. Dependent quantities are recomputed as required after each edit. These experiments use a single generation cycle without Verifier replanning or candidate selection. Formation, timing, and mobility edits reduce their respective errors toward the edited targets by 40%, 37%, and 29%; the generated motion changes in the requested direction in 78.54%, 74.85%, and 68.68% of cases, respectively.
To facilitate qualitative inspection, our supplementary demos also show the generated semantic descriptions alongside the corresponding motions, allowing readers to compare the intended high-level choreography with the visual result. Together with the controlled interventions, these examples make the guidance and its realization observable, although they do not guarantee faithful realization for every sample.
2. Why what–when–who? A target formation alone does not determine when a transition occurs or which dancers perform the movement: the same spatial change can be executed at different musical times or with different mobility allocations. We therefore represent formation, timing, and mobility as distinct but coupled decisions, with timing and mobility conditioned on the planned geometric change. This makes the alternatives separately editable while preserving their dependency. The component ablations in Table 3 show that removing transition timing, role assignment, or the relation graph degrades performance; the interventions further test whether edits to each decision produce the intended response. We have added this motivation to Section 3.3. We do not claim that these experiments establish superiority over every possible trajectory-only conditioning design.
3. Benefit relative to TCDiff++ and component ablations. Under our revised common 150-frame evaluation, three-dancer ChoreoStudio obtains GMR/GMC/TIF of 10.32 ± 0.36 / 83.31 ± 0.38 / 0.07 ± 0.01, compared with 11.42 ± 0.46 / 82.37 ± 0.37 / 0.10 ± 0.01 for our TCDiff++ reproduction. These results are scoped to the models evaluated under our protocol. We agree that removing the Director or Verifier can yield worse results than this baseline. The ablations indicate that these components contribute to the full system. Table 3 reports single-run ablations, whereas Table 1 reports ten-run means; we have clarified their different statistical settings.
4. Efficiency and overhead. We added an efficiency comparison for three-dancer, 150-frame generation and latency measurements for refinement configurations. Training uses two RTX 4090 GPUs, and inference is measured on one RTX 4090. With precomputed semantic descriptions, text embeddings, and music features, ChoreoStudio takes 17 s per sample under the measured configuration, compared with 11 s for TCDiff++. Preparation time for these conditions is excluded. We acknowledge the additional inference cost.
The measured ChoreoStudio components contain 64.24M parameters: 48.45M for the generator, 9.63M for the Director, and 6.16M for the music disentangler. This excludes the frozen omni-modal model and text encoder. A single 50-step cycle provides a lower-latency option at 9 s, compared with 18 s for two 50-step feedback cycles, with GMR/GMC of 15.43/79.32 versus 10.36/83.20. At the same 100-denoising-evaluation budget, two feedback cycles improve GMR/GMC over a single 100-step cycle (10.36/83.20 vs. 14.74/80.94; both 18 s). These results show the quality–latency trade-off. 5. Clarity. We expanded the main-text explanations of the group state and Verifier feedback, described their use in replanning, and clarified the intermediate plan. We also added a limitations section discussing inference cost and the fact that plan realization is guided rather than strictly enforced.