- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes DexLink, a framework for generating dexterous manipulation policies from sparse hand-object interaction templates and object-state waypoints. It uses object-aware retargeting to construct approximate reference trajectories, followed by residual reinforcement learning to obtain executable manipulation policies. Experiments demonstrate control over grasp types, task timing, and manipulation strategies, as well as template reuse across objects and preliminary sim-to-real transfer.
Critical strengths
-
Meaningful problem and intuitive formulation. The paper addresses the high cost of collecting dexterous manipulation demonstrations. Using reusable hand-object interaction templates provides a flexible and interpretable way to specify different manipulation behaviors.
-
Diverse simulation experiments. The authors evaluate multiple manipulation tasks, including grasp transitions, articulated-object manipulation, and bimanual interactions. The ablation studies provide useful evidence for the effectiveness of the proposed components.
Critical weaknesses
-
Unclear reduction in the overall data generation cost. Although DexLink reduces the need for dense demonstrations, it introduces additional manual effort in specifying object-state waypoints, selecting interaction templates, and designing task-specific trajectories. Moreover, each task still requires separate RL training. The paper does not quantify these costs or compare the overall effort against existing demonstration-based approaches. Therefore, the claimed scalability and cost advantages remain insufficiently justified.
-
Insufficient baseline comparisons. The quantitative comparison with existing dense reference-tracking methods mainly focuses on DexMachina. More comparisons with relevant dexterous manipulation and demonstration-generation approaches would strengthen the evaluation. It is currently difficult to determine whether the observed advantages come from the proposed interaction representation or established retargeting and residual RL techniques.
-
Limited real-world validation. The real-world experiments are restricted to grasp-and-lift tasks on four objects, which are considerably simpler than the complex manipulation tasks demonstrated in simulation. Although the paper provides static rollout images and mentions project videos, the presented evidence is insufficient to assess the reliability of dynamic contact-rich manipulation in real-world settings. This weakens the claim that DexLink can generate broadly deployable dexterous behaviors.
Questions for authors
Q1. How much manual effort is required to construct the task specifications, including waypoint design and interaction-template selection? Can the authors provide a comparison of total human effort and computational cost against dense demonstration-based methods?
Q2. Could the authors provide additional comparisons or clarify the differences from closely related retargeting and residual RL approaches?
Q3. Can the authors provide more detailed evaluation results for real-world deployment? In particular, can the framework transfer more complex behaviors, such as in-hand grasp transitions or bimanual manipulation, beyond simple grasp-and-lift tasks?
Thank you for recognizing the intuitive task formulation, the flexibility of reusable interaction templates, and the diverse simulation experiments. We have added measurements of task-authoring effort and further comparisons to address your questions on generation cost and the contribution of the proposed representation.
W1 / Q1. Manual effort and total cost, compared to dense baselines
The General Response comparison table, last column, summarizes the cost of generation for prior methods, including DexImit and ManipTrans, which require dense demonstrations. And the Task authoring study reports our measured human effort.
DexLink provides flexibility in task authoring: it can (re)use the demonstration-derived inputs without manual effort, or rely on an agentic harness to assemble tasks with minimal human effort (<1 min/task), providing flexibility when dense demos are not available. While dense demos, or videos, could be easier to collect, scaling collection to large object diversity becomes challenging. In contrast, DexLink can capture broad object diversity at a very low manual cost.
W2/Q2. differences from retargeting + residual RL
Conceptual clarification: DexLink employs the already established retargeting + RL recipe.
Retargeting Objective Ablations Please see the General response, “Isolating the relational retargeting objective.” With the downstream RL pipeline fixed, relational retargeting achieves higher task success (on 2/3 tasks and tied for 1/3). Also, the references constructed with relational retargeting are closer to the RL-grounded policies, which can explain improved learning efficiency.
Comparison with Scaffolder.
Compared to Scaffolder, we emphasize that DexLink results are across a broader and more complex task set (in simulation), specifically: bimanual tasks, sequential multi-object manipulation tasks, and diverse object geometries.
Both methods use RL, but provide different guidance for learning. Scaffolder only provides wrist guidance, while DexLink relies on constructed reference trajectories to add guidance for both wrist and finger motion.
We adapted Scaffolder (replacing Gemini with GPT-6.1 Sol planner) on two tasks that specifically require long-horizon interactions. Scaffolder results uses its own hand, simulation, and learning setup.
Additional baseline numbers for reference, reported by DexMachina. We update Figure 8 (Section 4.1), in the revised pdf, with additional baseline numbers.
W3 / Q3. Real-world validation
Thank you for emphasizing the importance of stronger real-world validation. Although DexLink demonstrates a diverse range of behaviors in simulation, we acknowledge that our hardware evidence remains limited to grasp-and-lift.
We are actively working to deploy more diverse tasks on hardware, addressing challenges around latency and occlusion in our deployment pipeline. As noted in original lines 462–463, we present the submitted hardware results as preliminary evidence of sim-to-real transfer.