- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper proposes PhysIKDance, a music-driven dance generation framework designed to mitigate error accumulation along the kinematic chain. Instead of directly generating joint rotations, the method first generates motion in Joint Coordinate Space, including root translation, joint coordinates, axial twist, and foot-interaction states, which enables direct geometric supervision of foot-ground interactions. A music-conditioned two-stage invertible inverse-kinematics module then reconstructs SMPL-compatible rotations in Joint Rotation Space, with cross-space consistency supervision connecting the two representations. Experiments on AIST++ and FineDance demonstrate improvements in motion quality and foot-ground consistency.
Critical strengths
Strengths
-
The paper identifies an important limitation of directly predicting continuous 6D joint rotations: local rotational errors can accumulate along the kinematic chain and cause substantial positional errors at distal joints such as the feet. The proposed dual-space representation directly targets this issue by separating geometric generation from rotation reconstruction.
-
The dual-space design is intuitive and effective. Direct supervision in Joint Coordinate Space provides a natural way to regulate foot-ground interactions, while the inverse-kinematics stage restores animation-ready SMPL rotations. The effectiveness of this design is supported by improvements on most core quality and physical-consistency metrics.
-
The paper is motivated by a practical problem and is clearly illustrated. Figures 1 and 2 are particularly helpful in explaining why rotation-space errors propagate and how the proposed coordinate-space generation and rotation-space recovery interact.
Critical weaknesses
Weaknesses
-
Although the demo generally shows better foot-ground consistency for PhysIKDance, some examples appear to exhibit unnatural upper-arm deformation or squeezing. Since axial twist is generated explicitly and then used during rotation reconstruction, it is unclear whether these artifacts are related to inaccurate twist estimation or to the inverse-kinematics recovery stage. This raises the question of whether improved foot-ground consistency may occasionally come at the cost of upper-body rotational realism.
-
The video does not provide qualitative ablations for the core variants in Table 3. In particular, visual comparisons with direct/global rotation prediction, removing IK, or removing twist would help clarify what types of artifacts are specifically addressed by the dual-space design. Table 3 quantitatively shows large differences among these variants, but the perceptual effects are difficult to infer from metrics alone.
-
The terminology around “physical reasoning” appears somewhat overstated. The proposed physical supervision is primarily kinematic: it constrains foot positions, displacements, support states, and penetration, but does not model contact forces, torques, friction, dynamic balance, or physical executability. The paper itself acknowledges this limitation in the appendix. I therefore suggest using more precise terms such as kinematic physical supervision, contact-aware geometric supervision, or kinematic physical plausibility when describing this component, while reserving stronger “physical reasoning” claims for methods that explicitly model dynamic interactions or physical feasibility.
Questions for authors
Questions
-
Some demo examples appear to show unnatural upper-arm deformation or squeezing. Are these artifacts related to inaccurate axial-twist prediction, the IK recovery stage, or inconsistency between generated joint coordinates and recovered rotations? Have the authors evaluated upper-body rotation or mesh deformation quality separately from foot-ground metrics?
-
Could the authors provide qualitative ablations for the main variants in Table 3, especially direct/global rotation prediction, w/o IK, and w/o twist? These comparisons would help illustrate how the dual-space design changes both foot-ground behavior and whole-body motion quality.
-
Since the method explicitly predicts axial twist as a separate component, how sensitive is final motion quality to twist errors? A quantitative or qualitative analysis of twist prediction error versus downstream mesh or rotation artifacts would help clarify the robustness of the reconstruction stage.
3 comments
Dear Authors,
Thank you for your detailed response and clarifications.
The experiments on upper-arm deformation and qualitative ablations have addressed my concerns. I maintain my original score and lean towards acceptance.
Thank you for your time and thoughtful feedback. We are pleased that the upper-arm deformation experiments and qualitative ablations have addressed your concerns. We sincerely appreciate your positive assessment and support for our work.
We thank the reviewer for recognizing the motivation and effectiveness of the dual-space design. We supplement the manuscript’s ablations and limitations with upper-arm diagnostics, controlled twist comparisons, and synchronized visualizations.
W1 and Q1: What causes upper-arm deformation, and has upper-body quality been evaluated separately from foot-ground metrics?
Response: We added upper-arm intersection, mesh-deformation, and rotation-recovery evaluations independent of foot-ground metrics. Using the same SMPL model and body shape, we evaluate the same 100 FineDance clips from 18 sequences:
Intersection detection excludes shared-vertex face pairs and a fixed shoulder-connection region. Edge strain measures local edge-length changes relative to the same-shaped rest mesh.
Relative to direct rotation, PhysIKDance reduces the intersection-frame percentage by 11.29 percentage points and the intersecting-face percentage by 35.2%, with mean edge strain also closer to GT. After excluding boundary-only contact, the intersection advantage persists across all tested geometric crossing margins from 0 to 2 mm.
We additionally hold GT geometry, music, and IK weights fixed and change only the input twist:
Correct twist reduces upper-arm PVE by 53.7%, demonstrating its importance for local reconstruction. Together, these evaluations support improved upper-arm metrics relative to direct rotation and the value of twist information for recovery; they do not rule out twist-prediction errors as a contributor to residual squeezing. As §3.3 and Appendix A.10 explain, inconsistency between generated geometry and the fixed skeleton, together with IK recovery, may also contribute.
W2 and Q2: Qualitative comparisons of the core components.
Response: We supplement Table 3, Fig. 3, and Appendix A.9 with synchronized component-level videos. The videos use shared cameras and body shape, with full-body and enlarged upper-body views. They compare PhysIKDance with direct rotation + FK, Stage-1 skeletons with final meshes, and predicted with zero twist using identical generated joints and IK weights. The direct-generation comparison differs from Table 3’s global-versus-local rotation-recovery ablation. The latter two comparisons visualize the pre-IK representation and a controlled twist-input intervention, rather than independently retrained w/o IK and w/o twist models.
Video: https://openreview.net/attachment?id=bSMYqzbdST&name=supplementary_material W3: Precision of the physical terminology.
Response: We agree that “contact-aware geometric supervision” is more precise and will use it consistently. Appendix A.10 already identifies the supervision as kinematic and excludes forces, torques, friction cones, dynamic balance, and biomechanical feasibility; §2 likewise distinguishes kinematic constraints from simulation-based methods. Equations (5) and (41) constrain geometric quantities, not dynamic executability. This terminology aligns the broader wording with the method’s stated scope: improved foot-ground kinematic consistency and motion quality, with residual upper-body artifacts acknowledged.