- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes a physics-based framework for reconstructing climbing motions from monocular videos. Its key idea is to first learn a motion policy fully supported by residual forces, use the learned forces to derive contact-force and joint-torque guidance, and gradually transfer the support to physical contacts. Experiments in Isaac Sim show improvements over DeepMimic and an unguided variant in motion tracking, contact loading, penetration, and training completion on several climbing motions.
Critical strengths
The submission addresses the difficult exploration landscape in physics-based climbing control with an intuitive key idea: leveraging residual forces as a source of dynamics supervision rather than conventional temporary scaffolding. The experimental setup is solid, offering meaningful ablation studies and demonstrating that the resulting policies operate with zero residual force at test time, thereby confirming full physical plausibility and contact reliance.
Critical weaknesses
-
The evaluation is narrow, as the method relies on accurate wall geometry and trains a separate policy for each motion, without demonstrating generalization beyond individual motions.
-
The baseline comparisons are insufficient to establish the method’s contribution. Comparisons with DeepMimic and a variant without dynamics guidance do not clarify whether the gains stem specifically from the learned intermediate dynamics reference or could be achieved by existing assistance-based curricula or contact-aware control methods.
-
The comparison with JOSH focuses on kinematic reconstruction under different scene-geometry assumptions and does not address the lack of strong baselines for physics-based control.
-
The submitted paper does not provide an accompanying demonstration video, making it difficult to assess the temporal quality, contact transitions, and stability of the reconstructed motions.
Questions for authors
-
Can the authors compare their method against existing assistance-based curricula or contact-aware control methods under the same environment, reference motions, and zero-residual-force test conditions?
-
Can the authors isolate the contribution of learning the fully assisted intermediate policy from that of the subsequent force-derived dynamics guidance? In particular, could simpler alternatives achieve comparable performance?
-
Can the authors provide a demonstration video showing complete motions and baseline comparisons to better assess motion quality, contact transitions, and stability?
I appreciate the authors' feedback. While I recognize the solid engineering implementation and impressive demo results, the current experiments remain somewhat limited in scope. Given its strengths, this work might be a better fit for a computer graphics (CG) conference.