- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper introduces Intent-in-the-Loop (IITL) for synthesizing 3D camera trajectories from music and dance. A planner predicts shot-level cinematographic intent, then generates a camera trajectory in a coarse-to-fine manner, and a pretrained, frozen aligner provides intent supervision during training. Experiments on DCM evaluate trajectory quality, intent fidelity, and user preferences, with ablations of the alignment losses and model components.
Critical strengths
-
Well-motivated problem formulation and method. Explicitly representing framing scale, visual focus, motion primitives, and motion energy makes camera trajectory generation inspectable, while recovering the attributes from generated trajectories provides a training objective for intent consistency. This formulation addresses a relevant limitation of direct trajectory synthesis and offers a coherent connection between high-level shot planning and camera motion generation.
-
Evidence of practical effectiveness. On DCM, IITL achieves the lowest kinetic and shot-feature FIDs among the compared methods. The experiment results support the method's practical value through improvements in trajectory distributions, perceived quality, and dancer visibility.
Critical weaknesses
-
The construction of intent labels is insufficiently specified. Section 4.1 and Appendix A.1 describe fixed geometry- and motion-based rules. However, they do not fully specify the rules and thresholds for framing scale, visual focus, and motion primitives, or the computation and normalization of motion energy. A complete specification is central to understanding and reproducing the method.
-
Limited methodological novelty. Several central mechanisms have close precedents, the contribution is mainly a shot-intent planning and alignment pipeline, with task-specific coarse trajectory construction and residual gating. I believe the novelty does not fit the standards of ICLR.
Questions for authors
- Clarification of intent-label construction. Could the authors provide the rules , including the measured quantities, thresholds, normalization, and aggregation within shots for each intent attribute? Please identify which rules are inherited unchanged from the cited methods and which are introduced or modified here.
- Clarification of the baseline configurations. How were the Table 2 backbones adapted to the intent tasks? The user study for TemMEGA seems to be missing, making it hard to evaluate proposed method gain over this baseline. The details are needed to attribute the observed differences to the proposed components.
Thank you for the constructive feedback.
(Weakness 1) Reproducibility of Intent Labels. For the fixed rules Q, we adopted the numerical settings from the studies cited below without modification. The fixed rules Q use camera discontinuities at shot starts to identify hard cuts, drawing on the distinction between continuous shots and abrupt switches in (Wang et al., 2024b). Scale and focus use camera–dancer geometry, informed by prior work on shot framing and joint visibility (Jiang et al., 2024 and Wang et al., 2024a). Motion primitives and normalized energy are derived from within-shot camera motion, drawing on geometric movement and velocity descriptors (Jiang et al., 2024). To support reproducibility, we will release the implementation of Q and the trajectory refinement code upon publication.
(Weakness 2) Methodological Contribution. To our knowledge, IITL is the first framework for music and dance driven 3D camera synthesis to use explicit shot-level cinematographic intent both as a generation condition and as a training target for intent recovered from the generated trajectory. This closes the loop by training the generator to realize the same intent it was given. The principle can extend to other conditional generation tasks where the requested attributes can be recovered from the output and used as a training signal. Our quantitative and qualitative evaluations support the effectiveness of this closed-loop formulation in translating explicit cinematographic intent into camera motion.
(Question 1) Intent-Label Construction. Please see weakness 1.
(Question 2) Baseline Configurations and TemMEGA. Table 2 evaluates intent planning and recovery separately from end-to-end camera synthesis. In Table 2(a), we preserve the input modalities listed in the table. We only attach new frame-level intent prediction heads to the output features of each adapted backbone. The heads use the same design across baselines and predict shot boundaries, framing scale, visual focus, camera motion primitives, and camera motion energy. AtomicDance also retains a token output for auxiliary DCM intent-token denoising, while the UniMuMo adaptation reimplements its joint attention for continuous music and dance features. We train each adapted backbone jointly with its new heads on DCM intent labels. In Table 2(b), ASFormer and MS-TCN++ take camera parameters and dancer-relative composition features as input. We replace their action segmentation outputs at each stage with frame-level intent heads, train the backbones and heads jointly on DCM, dataset and evaluate the final-stage predictions. These comparisons assess the adapted backbones on the two intent tasks; they do not isolate the effect of any single IITL component on camera synthesis.
Table 1 reports the published offline TemMEGA scores (Xu et al., 2025, Table 2), obtained using the same DCM dataset and quantitative evaluation protocol. TemMEGA's code was unavailable at the time of our study, so we could not generate trajectories for the user study.