- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper studies how human hand-motion priors can improve exploration for dexterous manipulation. It compares direct joint-space control, reduced PCA action spaces, and joint-plus-eigen action representations to investigate whether gains arise from action parameterization or coordinated exploration. Based on these comparisons, it proposes EigenDEXplore, which combines independent joint noise with perturbations along human-derived PCA directions while retaining full joint-space actions. The eigenbasis is fixed during training and is unnecessary for deterministic policy deployment.
The main contribution is a simple exploration mechanism and an empirical study suggesting that human coordination priors are more useful for structuring exploration than constraining action representations. Validation spans reinforcement learning and sampling-based trajectory optimization across four frameworks and six robot hands, with hardware experiments for tool manipulation and in-hand reorientation. Ablations examine source datasets, retained PCA dimensionality, and human-derived versus random directions. Improvements are generally largest for higher-dimensional hands and settings with less reward shaping or curriculum guidance.
Critical strengths
-
A useful distinction between action representation and exploration. The paper shows that human-derived coordination patterns can improve learning without restricting the policy to a reduced action space or adding redundant action coordinates. EigenDEXplore preserves independent joint control while encouraging coordinated exploration. This provides a clear, practical insight into how to incorporate human priors, supported by comparisons against joint-space, eigen-space, and eigen-residual formulations.
-
Broad validation of a simple intervention. The evaluation spans reinforcement learning, trajectory optimization, six hand embodiments, and two real-world manipulation settings. The larger benefits on higher-dimensional hands and under reduced training guidance are consistent with the proposed exploration mechanism. This breadth strengthens the case that the method addresses a recurring difficulty in dexterous manipulation and can be useful beyond a single benchmark.
Critical weaknesses
The RL comparisons do not fully disentangle action parameterization from exploration noise. Crossing two expressive action representations (joint and joint-plus-eigen) with three noise choices (joint, eigen, and joint-plus-eigen) yields six combinations, but the paper evaluates only three of these; its fourth baseline uses eigen-only actions. The missing combinations would help isolate the effects of action representation, noise structure, and their interaction. Although trajectory-optimization ablations partially address this gap, the RL results establish the effectiveness of the proposed combination more clearly than they explain the contributions of its individual design choices.
Questions for authors
Could you clarify the choice of RL comparisons and, if available, share results for the remaining combinations of the two fully expressive action representations (joint and joint-plus-eigen) and three noise choices (joint, eigen, and mixed)? In particular, joint actions with eigen-only noise and joint-plus-eigen actions with joint-only noise would help clarify the individual contributions of action parameterization and exploration structure.
Response to Reviewer kzby
Q1) The full action × noise grid in RL
The paper compares the formulations that prior work uses. Eigen-Space makes the human prior the action space (Agarwal et al., 2023; Lum et al., 2024; Yuan et al., 2025), and Eigen-Residual adds eigen actions to joint actions (Gupta et al., 2026b). The remaining combinations are controls, and we have now trained them on DeXtreme. We follow the protocol of Fig. 4 and report consecutive successes at 2B frames as mean ± std across seeds.
Eigen-only noise uses the full set of human directions, one per hand joint, so it still spans the joint space. The new cells use 3 seeds.
With joint actions, exploration structure has a large effect. Mixed noise performs best and eigen noise alone performs worst (5.7). With joint-plus-eigen actions, the three noise choices perform similarly (9.7 to 10.6). Under mixed noise, joint actions outperform joint-plus-eigen actions (12.3 vs. 10.6). The full grid is in the revised paper (App. A.2, Fig. 11).