- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
Sign data collection is costly and teleoperation scales poorly, making the reuse of large video corpora an attractive alternative. However, enabling humanoid signing requires converting video-derived human motion into robot trajectories while preserving linguistic motion cues, and errors introduced by fitting, human-motion repair, retargeting, robot geometry repair, and control are hard to distinguish from the final trajectory alone. To address this, the authors introduce HumanoidCSL 20K, a dataset and benchmark of 20,648 sentence-level Chinese Sign Language sequences, each paired with four aligned versions: the source, the repaired human motion, the direct robot reference, and the geometry-repaired robot reference. Observation-supported local human-motion repair, full-robot geometry repair, and cross-representation provenance make each transformation traceable, while paired evaluations separately assess human-motion continuity and content preservation, robot reference feasibility, and physical execution. In addition, a sign-specific kinematic-reference protocol scores hand shape, location, palm orientation, and inter-hand relation over the full planned motion.
Critical strengths
- I think the application perspective of this paper is relatively novel, as sign language is indeed a domain rich in finger and wrist information.
- The benchmark effectively demonstrates that the retargeting method proposed in the paper achieves relatively small errors.
- The paper is clearly written and easy to read.
Critical weaknesses
- As a benchmark, it does not compare the performance of other retargeting methods.
- The positioning of this benchmark is rather ambiguous; it is unclear whether it is intended to evaluate imitation policies or to assess the quality of retargeting methods.
- Sign language is related to facial expressions, yet this issue has not been taken into consideration.
Questions for authors
- Can the benchmark evaluate the performance of other retargeting methods?
- How much better is the performance of a policy trained on data processed by the proposed method compared with one trained on data not processed by the proposed method?
- How is the issue that sign language also involves facial expressions taken into account?
- Can it be adapted to dexterous hands of different sizes?
Thank you for your constructive review. The authors have posted their rebuttal. Could you please review their response to see if you have any remaining questions?