- Rating
- 1(−1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper compares human-derived, dynamics-derived, and learned action representations on a 78-muscle bimanual typing platform, and adds a per-key template-imitation reward. Separating the roles of structural priors and objectives in human-like control is scientifically interesting. The present evidence, however, supports complementary effects of representations and objectives more than the central claim that human-likeness arises from the objective rather than from the action representation.
Critical strengths
-
A valuable fine-motor-control platform. Section 3 combines a 78-muscle bimanual model, a contact-capable keyboard, and GPU-parallel training, providing an interesting testbed for detailed dexterous-control questions.
-
Broad coverage of action representations. Tables 1 and 5 compare linear, predictive, and generative representations and also report approaches that did not deliver the expected gains. This is useful empirical coverage for action-representation research.
-
Useful tests beyond aggregate success. Sections 4.3-4.4 study keyboard changes and individualized templates, raising transfer and individual-style questions that are relevant in addition to success rate.
Critical weaknesses
-
The construction and evaluation of human-likeness are not independent. The minimum-effort inverse-dynamics activations in Section 3.3 generate the action prior, the imitation reward, and the human-likeness metric. Better template matching therefore does not establish recovery of real human muscle control without independent behavioral or physiological validation.
-
The central claim is stronger than the reported comparisons support. Without imitation reward, the human and JoSE spaces already raise m@press from 0.07 to 0.60 and 0.61, while raw plus reward reaches only 0.53. With reward, human and JEPA reach 0.64 and 0.65 in Table 5. These results do not support a simple conclusion that the objective, rather than the representation, is the primary source of human-likeness.
-
JoSE is not a complete no-human-data condition as claimed. Appendix B states that the latent scales for all synergy directions come from human per-key templates, and the dynamics basis that lacks an embedded mean still uses a human-template mean. An ablation without the human mean and scales is needed.
-
The main training comparisons are not replicated. Section 4.1 and Appendix A use only seed 0 for all principal conditions, so apparent differences among representation sources, individualization failures, and reward weights cannot be separated reliably from training stochasticity.
Questions for authors
-
Can the authors evaluate the reward-driven improvement using human data not involved in template construction, with independent kinematic, contact-timing, or feasible EMG-based measures?
-
Can the conclusion be reformulated in terms of sufficient and complementary effects of action priors and objectives, and can the apparent contradiction between the above-0.60 results in Table 5 and the statement that all conditions remain below that limit be resolved?
-
After replacing the human-derived mean and latent scales with quantities independent of the human data, does JoSE still support the claim that it does not require human data?
-
Can the key representation-by-reward conditions be repeated across multiple random seeds, with paired effects and uncertainty intervals?
-
Can the paper report how often coordinate-wise clipping is active and the residual of activations to the original affine synergy space, so that the practical validity of the low-dimensional-subspace interpretation can be assessed?
I keep my final decision.