- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper studies human-to-robot transfer in dexterous manipulation, building on ManipTrans pipeline. It argues that two sources of variation are underexploited: prior reusability depends on the task–hand pair, and learner competence varies across trajectory phases. For the first problem, Static Compatibility combines hand-crafted morphology and interaction discrepancy measures into a scalar that sets the tolerance radius of an object-centric soft fingertip constraint. For the second problem, Dynamic Readiness estimates phase-wise look-ahead success online and redirects a fraction of episode resets to the identified learning frontier phase.
Experiments use seven OakInkV2 tasks spanning single-hand and bimanual manipulation, transferred to four heterogeneous dexterous hands (Inspire, Allegro, Shadow, and Artimano) in Isaac Gym, and evaluate frozen policies under a deterministic protocol with fixed start frames and contact-consistency checks. Compared against ManipTrans and an adapted DexMachina, the full method achieves the best average learning efficiency and final strict success rate, and ablations indicate that each component contributes on its own.
Critical strengths
Good problem decopmosition. The paper frames human-to-robot transfer along two intuitive axes: how much of the human interaction prior a given embodiment can reuse, and where along the trajectory the learner should concentrate training. The two components are cleanly separated and plug into a shared ManipTrans backbone, so each can be ablated in a controlled way.
Light-weight, drop-in design. Both components add no network branches, no extra policy inputs, and no additional simulation. The look-ahead success label is computed counterfactually from already-recorded tracking errors, and the soft interaction constraint is a single additive reward term. As a result, the method can be plugged into existing reference-guided transfer pipelines with minimal engineering overhead.
Critical weaknesses
Static Compatibility shifts tuning rather than removing it, and it remains unclear whether it identifies the optimal tolerance for each pair. The score is intended to replace per-pair tuning of the interaction tolerance, but computing it relies on a fair number of manually set constants, including morphology weights whose values are not reported. In addition, the fusion coefficient is selected based on experimental results, and the bound that the score is mapped to (Sec. 3.4.2) appear to be taken directly from the endpoints of the fixed-tolerance values tried in Sec. 4.2 (Fig. 5), rather than derived in a principled way. The calibration pairs used for this selection also overlap with the evaluation pairs. And there's no direct evidence that the score tracks the best tolerance for each pair other than comparison with baselines. Given the relatively small margin over a single tuned fixed tolerance, such evidence would help clarify how much signal the score provides.
The source and robustness of the empirical gains could be clarified. Table 2 compares Dynamic Readiness only against the original ManipTrans curriculum. However, the full curriculum comparison (Table 9) shows that simply training without any curriculum performs close to Dynamic Readiness and better than the ManipTrans curriculum. This suggests that part of the reported improvement may come from removing that curriculum rather than from the readiness-guided resets. Including the no-curriculum and fixed-schedule baselines in Table 2 would give readers a clearer picture. In addition, the per-pair results in Fig. 7 suggest that a large share of the overall improvement comes from the Rearrange task, while changes on many other pairs are modest or occasionally negative. More rigorous statistical significance measures would help support the reported improvements. Since the gains are not consistent across all tasks, it would also be helpful for the authors to explain why the method helps on some tasks but not others.
Questions for authors
Generalization to unseen tasks and hands. We understand that only the fusion coefficient is calibrated as a single global value, and that per-pair tolerances are then computed from the compatibility score. The method’s advantage over directly tuning the tolerance therefore depends on whether this coefficient transfers to unseen tasks and hands, yet the calibration pairs overlap with the evaluation pairs. Could the authors report results on held-out tasks and hands, compared against a per-pair tuned tolerance?
Choice of constants. The weights of the three morphology terms and the normalization constant in the mobility term do not appear to be reported. The remaining constants in the compatibility score are given in Appendix A but without justification. Could the authors report the missing values, explain how these constants were chosen, and discuss how sensitive the results are to them?
Source of the gains. Since training without any curriculum already outperforms the ManipTrans curriculum (Table 9), does adding readiness-guided resets on top of the no-curriculum setting still bring a clear improvement? In addition, could the authors explain why the gains are concentrated on Rearrange while many other pairs show little or no improvement?
7 comments
Update on Additional Experiment:
No-Curriculum + Readiness-Guided Resets(W2 & Q3)
- Following up on Question 3, we evaluated No-Curriculum + readiness-guided resets under the exact same strict evaluation protocol ( fixed from epoch 0, with all other settings unchanged). The results are summarized below:
| Task (Matched Pairs) | Pairs | No-Curriculum (S-AUC / S-SR$_{E1000}$, %) | No-Curriculum + Readiness Resets (S-AUC / S-SR, %) | DR-RMS (S-AUC / S-SR_{E1000}\, %) |
|---|---|---|---|---|
| Rearrange | 4 | 39.48 / 44.63 | 40.84 / 43.36 | 38.66 / 39.78 |
| Brush Whiteboard | 4 | 40.33 / 48.05 | 39.07 / 46.58 | 42.25 / 51.73 |
| Cap the Pen | 4 | 30.05 / 36.36 | 26.46 / 30.53 | 32.01 / 37.27 |
| Place Inside | 4 | 57.37 / 59.24 | 58.43 / 60.55 | 57.60 / 58.95 |
| Put off Alcohol Lamp | 4 | 46.21 / 56.05 | 41.84 / 53.16 | 47.27 / 60.06 |
| Uncap the Jar | 4 | 31.76 / 45.87 | 34.73 / 47.72 | 32.58 / 46.48 |
| Unscrew | 4 | 17.93 / 19.37 | 17.72 / 17.12 | 16.86 / 18.52 |
| All Completed Pairs | 28 | 37.59 / 44.22 | 37.01 / 42.72 | 38.18 / 44.68 |
- Across these 28 pairs, while adding readiness-guided resets directly on top of No-Curriculum improves tasks with gentler initial contact transitions (Rearrange, Uncap the Jar), enforcing from epoch 0 may trigger frequent premature terminations on contact-sensitive tasks (Cap the Pen, Put off Alcohol Lamp). Pairing readiness-guided resets with the progressive threshold schedule (DR-RMS: 38.18% / 44.68%) works complementarily, preventing premature early-stage failures while concentrating resets on the evolving frontier to achieve the strongest overall performance.
Update on Held-Out 16 Pairs: Comparison Against Per-Pair Tuned Tolerance (W1 & Q1)
-
Following up on Question 1, we are evaluating the full mm grid across all 16 held-out task-hand pairs (3 seeds each) to verify whether SC-SIC identifies an appropriate tolerance for unseen pairs without per-pair tuning.
-
Cost vs. Performance: Per-pair tuning across [10, 25, 40] mm requires 3x training runs per pair (9 seeded runs) and selects the best radius post hoc, whereas SC-SIC predicts offline before training and requires only 1x training run per pair (3 seeded runs).
-
The results on the 16 held-out pairs are summarized below: | Tolerance Strategy (16 Held-Out Pairs, seed=42/43/44) | S-AUC${1000}$ (%) | S-SR${E1000}$ (%) | | :--- | :---: | :---: | | Fixed Tolerance () | 34.66 | 38.68 | | Fixed Tolerance () | 36.49 | 42.72 | | Fixed Tolerance () | 37.77 | 42.53 | | SC-SIC () | 38.04 | 42.74 |
Thank you for recognizing our problem decomposition and lightweight design. We address your concerns below.
Held-Out Generalization: We added a separate analysis of the remaining 16 pairs (28 total − 12 calibration), covering three additional tasks and four new task–hand combinations. All four hand types were represented during calibration. | Method | S-AUC${1000}$ (%) | S-SR${E1000}$ (%) | | :--- | :---: | :---: | | Fixed-25mm | 36.5 | 42.7 | | SC-SIC | 38.0 | 43.0 |
Tracking Good Per-Pair Tolerances:
We apologize for omitting these details. Appendix A.3.2 now reports (ωsize,ωL,ωC)=(0.5,1,1) and Cref=6. The latter provides a reference scale for six-dimensional relative-pose capability. Unit weights apply to the normalized geometry and mobility terms, while the smaller size weight avoids premature saturation.
The 10–40 mm interval is an engineering choice. 10 mm defines a local, centimeter-scale interaction tolerance, while 40 mm is consistent with the thumb-tip tracking tolerance in our evaluation; 25 mm is the midpoint.
Because evaluating the training-performance effects of all constants would require substantial additional RL runs, our sensitivity analysis only examines α, which is the key parameter and central fusion coefficient controlling how task-specific interaction mismatch modifies morphology-based compatibility. For α=0.5/0.7/0.9, Table 7 reports calibration regrets of 2.021/1.825/2.149 pp, suggesting limited sensitivity around the selected value.
Curriculum Comparison: We moved the full comparison into Table 2. | Curriculum Variant | Average (S-AUC / S-SR) | | :--- | :---: | | ManipTrans Baseline | 36.3 / 41.0 | | No-Curriculum | 37.6 / 44.3 | | Fixed Schedule (F-TTS) | 36.9 / 42.1 | | DR-RMS | 38.2 / 44.7 |
Task-Dependent Gains: CARAT improves task-average S-SR E1000 across all 7/7 tasks and improves or ties on 20/28 pairs, including +15.3 pp on Alcohol Lamp/Inspire, +9.2/+8.0 pp on Cap the Pen/Artimano & Inspire, and +9.1 pp on Place Inside/Allegro. It also raises full-trajectory S-SR$_{t=0}$ from 16.4% to 23.2% and achieves strong statistical significance across all 28 pairs (N=84 runs, Wilcoxon p = 4.82e-6 / 0.0001 and paired t-test p = 3.07e-5 / 0.0003 for S-AUC1000 /S-SR E1000). Excluding Rearrange, CARAT still gains +2.58/+1.96 pp. The learning curves and reference diagnostics reveal three relevant patterns: