- Rating
- 4
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
CueDance combines music-conditioned dance generation with selective motion retrieval. Its choreographic world model predicts motion hypotheses and uses explanatory gain to select anchor timing. Retrieved motions are incorporated midway through flow sampling, allowing retrieval and generation to proceed in parallel. Experiments on FineDance and AIST++, component ablations, and a user study support the approach.
Critical strengths
-
A meaningful formulation of selective choreographic memory. The paper treats retrieval as a joint decision about motion content and temporal placement, moving beyond content similarity alone. This provides a useful perspective on when external motion references can complement music-conditioned generation.
-
A coherent integration of retrieval and continuous generation. CueDance combines sparse motion references with ongoing flow sampling in a single generation process. This connects memory-based guidance with flexible synthesis while reducing dependence on sequential draft generation and refinement.
-
A promising balance of quality, efficiency, and long-form consistency. The approach improves kinetic motion fidelity while maintaining high throughput and mitigating degradation during extended generation. These complementary benefits make the framework relevant to practical choreography synthesis.
Critical weaknesses
-
Explanatory gain is not directly validated as anchor utility. It measures improvement in predicting the next music representation rather than the actual benefit of inserting a retrieved motion. Although timing ablations support its overall effectiveness, how well does the score correlate with generation improvements across candidate positions?
-
The anchor-count comparison is affected by training mismatch. SAC trains with one to three anchors, whereas evaluation compares one, four, and eight. Testing two and three anchors, or training with matched larger budgets, would better establish whether single-anchor selection is preferable.
-
The NNR comparison changes several factors simultaneously. Query source, retrieval space and distance, and sampling/refinement budget differ between NNR and 3A. Matched comparisons would help distinguish the benefits of music-driven queries from those of the retrieval representation and generation pipeline.
-
Related-work positioning could be more systematic. Building on the cited literature, the paper could better connect retrieval-guided choreography (ChoreoMaster, MotionRAG-Diff, CustomDance), alternative music-to-dance backbones (Bailando, Transflower, TokenDance), and reference-conditioned motion modeling (ReMoDiffuse, TANGO, and the original, subsequently withdrawn PersonaGesture preprint). A focused comparison of reference selection, temporal placement, and integration into generation would clarify the contribution, while acknowledging differences in task settings.
Questions for authors
See weakness.
Response to Reviewer 5gEU
Thank you for the constructive review. We have addressed all four points in the revised PDF.
W1. Does explanatory gain track anchor utility?
Appendix C.9 of the revised PDF evaluates anchor utility across gain ranks in Table C.11 and reports the selected-position distribution in Table C.12.
We place one anchor at different ranks in descending explanatory gain within each window, keeping the content rule, checkpoint, motion memory, MAI, and paired initial noise fixed.
Both FIDs increase across the tested descending gain ranks, while BAS decreases from 0.235 to 0.207. Anchors at the 75% rank and lowest-gain position perform worse than generation without anchors. These results support explanatory gain as a criterion for allocating sparse references. Each FID is evaluated over the complete test set, so this analysis measures the relationship between gain rank and downstream generation quality at the set level.
Table C.12 additionally summarizes 336 selections per rank across 84 test sequences. Each third of the valid target region accounts for 30.95%–36.61% of selections, showing that the selected positions cover the window. Figure C.2 in Appendix C.9 provides a visual example, accompanied by the 8-s MP4 Explanatory Gain for Motion Reference Selection in the supplementary materials.
W2. Two and three anchors
Appendix C.2 and Table C.3 in the revised PDF include two- and three-anchor configurations, both within the SAC training range.
One anchor achieves the lowest FID-k and FID-g among all tested counts, including the configurations within the training range. Three anchors achieve the highest DIV-k of 9.20, while one anchor achieves the highest DIV-g and BAS.
SAC samples one, two, and three anchors with probabilities of 70%, 20%, and 10%, respectively, as documented in Appendices A.4 and C.2. The results therefore describe the preference under this training distribution.
W3. Matched NNR comparison
Appendix C.12 of the revised PDF examines query source, retrieval representation, and sampling budget, with the comparison in Table C.15.
Every configuration places one anchor at the same 3A-selected position. NNR uses a generated draft and L1 distance between FK joint coordinates. NNR-latent uses the same draft with cosine similarity in the motion latent space.
With retrieval space, distance, anchor position, and total evaluation budget matched, 3A achieves lower FID-k and FID-g than budget-matched NNR-latent. The generation schedules differ. NNR-latent allocates 10 evaluations to draft generation and 10 to refinement, while 3A derives its query directly from music during a single 20-evaluation sampling pass.
W4. Related-work positioning
Sec. 2 of the revised PDF incorporates the suggested works into the discussion of generative backbones, retrieval, planning, and reference conditioning.
Bailando and Transflower are discussed as autoregressive backbones, and TokenDance as a non-autoregressive backbone. ChoreoMaster and MotionRAG-Diff are connected to external retrieval, CustomDance to motion planning, ReMoDiffuse to text-driven reference conditioning, and TANGO and the original, subsequently withdrawn PersonaGesture preprint to co-speech animation.
The revised discussion relates these approaches through reference matching, temporal placement, and integration into generation, while identifying their different task settings. It then explains how CueDance selects sparse reference moments through explanatory gain, retrieves from music alone in parallel with sampling, and incorporates the reference through MAI within the same generation pass.