- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
EntroKine3D generates alternative 3D camera trajectories from synchronized music and dance when each training performance has one authored camera. E-KPM supplements latent distillation with shared continuous kinetic distributions, condition-dependent state occupancy, temporal transitions, and reference-entropy calibration. A four-step student is evaluated on DCM through matched supervision controls, same-condition sampling, independent cinematography measures, and human studies.
Critical strengths
- Sharing camera dynamics across performances is well motivated.
- The provided generation result quality looks good.
- Matched ablations and human evaluations support improved quality and useful variation
Critical weaknesses
-
There are only one video demo shown, which is not sufficient. And there's no video demo or visual comparison for comparing with baseline methods.
-
At population level, reference replay matches the kinetic targets yet gives no same-input diversity (Section 3.3). It needs further explanation of the mechanism or assumptions connecting these targets to unseen alternatives.
-
E-KPM's contribution to shot-scale/viewpoint diversity is not isolated from kinetic variation (Equation 2). Characterize same dance camera choices alongside the perceived-diversity scores would help.
Questions for authors
-
Stationary close-ups and wide shots can share the same kinetic descriptor. How does E-KPM expand useful shot-scale/viewpoint choices for one dance?
-
How does kinetic-profile supervision preserve intentional cuts while suppressing within-shot jitter?
Response to Reviewer QaFz
A1: Thanks for your valuable advice.. We have added additional video demos and visual comparisons with baseline methods to the supplementary material, providing a more comprehensive visual evaluation of EntroKine3D.
A2:
(1) Mechanism of same-input generation. The mechanism is that performances sharing an input-only state share transferable kinetic patterns. E-KPM constrains their Train-only support, occupancy, transitions, and uncertainty without fixing a unique trajectory. The full music–dance sequence conditions the generator, while different latent draws produce multiple alternatives for the same input.
(2) Same-input diversity evaluation. DCM provides one reference trajectory per dance, so same-input alternatives are unobserved in the reference data. Resampled replay varies population-reference selection rather than generating alternatives conditioned on the complete dance. Table R5 (Table 36 in the revised manuscript) evaluates the resulting same-input diversity and consistency. Full achieves higher condition consistency and effective diversity than temporal-only and tuned entropy-free, while naturalness remains inconclusive, supporting useful condition-aligned variation rather than arbitrary differences.
Table R5: Blinded same-condition method scores and paired Full-minus-control contrasts.
A3: Thanks for your helpful suggestion. We have addressed this concern by isolating E-KPM's contribution from kinetic variation and directly characterizing same dance camera choices alongside the perceived-diversity scores. We added a same-dance analysis on 18 disjoint test dances, fixing the complete music–dance input and using three sampling streams to measure SC-FS/SC-VS, FCD/AVD, NS, and perceived diversity. In Table R6, Full achieves the highest framing/viewpoint spread, lowest FCD/AVD, and best effective diversity and condition consistency. Full performs better because E-KPM preserves multiple Train-supported camera behaviors and calibrates their occupancy and conditional use for each dance, expanding framing/viewpoint choices while keeping their frequencies and viewpoints aligned with real camera distributions.
Table R6: Same-dance framing/viewpoint diversity and distribution alignment.
A4: The same-dance analysis in Q3 and Table R6 addresses this question. It evaluates 18 disjoint test dances with the complete music–dance input fixed and three sampling streams varied, measuring SC-FS/SC-VS, FCD/AVD, NS, and perceived diversity. In Table R6, Full achieves the highest framing/viewpoint spread, lowest FCD/AVD, and best effective diversity and condition consistency. Full performs better because E-KPM preserves multiple Train-supported camera behaviors and calibrates their occupancy and conditional use for each dance, expanding framing/viewpoint choices while keeping their frequencies and viewpoints aligned with real camera distributions.
A5: Kinetic-profile supervision preserves intentional cuts while suppressing within-shot jitter by separating population-level transition patterns from frame-to-frame smoothness. The multi-lag profile retains cut-like transitions represented in the Train reference statistics rather than forcing every camera trajectory to be smooth or constant, while the local acceleration/jerk term penalizes rapid oscillations within otherwise continuous shots. Thus, intentional cuts remain available as Train-supported transitions, whereas high-frequency within-shot jitter is discouraged.