acceptodds
Withdrawn from ICLR 2027

PaTRO-Grasp: Zero-Shot Cross-Embodiment Dexterous Grasping with Surface Patches

Withdrawn from ICLR 2027, so left out of the paper lists and the map.

12 views

Abstract

The growing diversity of dexterous hands calls for grasping policies that generalize to unseen hands. However, zero-shot transfer remains challenging due to substantial differences in action spaces across embodiments. To tackle this challenge, we propose PaTRO-Grasp, a universal policy built on surface-patch representations for arbitrary dexterous hands. PaTRO-Grasp adopts a two-stage training paradigm to establish cross-hand correspondence in a shared high-dimensional feature space, enabling zero-shot policy transfer to novel hand embodiments for grasp synthesis in cluttered environments. Across novel hands spanning three-finger grippers to four- and five-finger dexterous hands, PaTRO-Grasp achieves an average success rate of 84.3%, demonstrating strong zero-shot generalization across diverse hand morphologies.

Primary area:
applications to robotics, autonomy, planning
Keywords:
Cross-Embodiment Generalization, Zero-Shot Policy Transfer, Dexterous Grasping

Reviews

Among:
Shape:
1234this paper, Bottom 27%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 2.00 over 3 reviews, above 27% of the others.
Reviewer_FkraOpenReview ↗
Rating
2
Confidence
3
Informativeness
2
Presentation
2
Soundness
2
Read review
Paper summary

This paper presents PaTRO-Grasp, a framework for dexterous grasp generation on unseen robotic hands. Different embodiments are represented by a fixed number of surface-attached frames. A diffusion model pretrained on forward-kinematics samples learns hand-structure priors, which are incorporated into a scene-conditioned grasp generator through a dual-branch architecture. For a new hand, the shared networks remain frozen while its patch embeddings are optimized using kinematic data, without target-hand grasp annotations. Predicted patch poses are converted into executable configurations through inverse kinematics or a retargeting module. The paper reports simulation results on four unseen hands and real-world experiments on XHand.

Critical strengths
  1. An important problem with promising cross-hand transfer results. Transferring grasping capability without target-hand grasp annotations is practically valuable. The evaluation includes six training hands and four unseen test hands, spanning three-finger grippers to five-finger dexterous hands. The reported average simulation success rate of 84.3% on unseen hands demonstrates promising transfer capability.

  2. The two-stage decoupling has methodological value. The pretrained branch captures hand-specific geometry and kinematics, while the main branch learns shared grasping knowledge, with cross-branch attention integrating the two. Separating structural learning from task learning is a reasonable design that could also inform other cross-embodiment robotics tasks.

  3. The experiments cover a broad range of settings. The paper evaluates multiple hand morphologies, cluttered scenes, several baselines, and physical-robot execution. The real-world XHand experiments provide additional evidence of applicability beyond simulation.

Critical weaknesses
  1. Inconsistent evaluation protocols limit conclusions about relative performance. The main table combines isolated-object and cluttered-tabletop settings with different success criteria, preventing direct interpretation of the numerical gaps. Several baselines nearly fail completely on unseen hands, and the reproduced DexGrasp-Zero results are also very low. Further validation is needed to distinguish methodological limitations from implementation, training-configuration, or protocol-transfer effects.

  2. The independent contributions of the representation and framework are insufficiently isolated. The results establish the effectiveness of the complete system, but do not clarify whether the gains primarily arise from surface patches, kinematic pretraining, or dual-branch interaction. The ablations mainly concern XHand and lack comparisons against position-only points and link frames under the same architecture, as well as simpler structural-conditioning baselines.

  3. New-hand adaptation costs and stability are insufficiently quantified. New hands require patch-embedding optimization using kinematic samples, so “zero-shot” should be qualified as requiring no target-hand grasp annotations. Adaptation sample counts, optimization steps, and runtime are not adequately reported, nor is sensitivity to initialization and adaptation budget, making the claim of rapid, lightweight deployment difficult to assess.

  4. Surface-frame construction and the effects of retargeting errors require further validation. Patch orientations depend on surface normals and link principal axes, but orthogonalization, axis-sign conventions, and ambiguities from symmetric geometries are insufficiently specified. The approximately 1.39 cm mean IK reconstruction error for structural-model samples on unseen hands also motivates an analysis of retargeting errors in final grasp predictions and their effects on contact, collision, and success.

Questions for authors
  1. Can the main baselines be compared using the same objects, scenes, execution controller, and success criterion, with training embodiments, data, and adaptation budgets specified? For near-zero results, were the implementations verified to achieve reasonable performance under their original protocols?

  2. Under the same pretraining and grasping architecture, what is the independent benefit of surface frames over position-only points or link frames? How does dual-branch interaction compare with simpler conditioning, such as concatenating structural features?

  3. Was the ablation without the interaction module independently retrained? Do the main ablation conclusions hold on the other unseen hands?

  4. How are orthogonalization, axis signs, and ambiguities from symmetric geometries handled when constructing surface frames? How much does performance vary across patch samples, embedding initializations, and adaptation budgets?

  5. How many samples, optimization steps, and how much time does new-hand adaptation require? What are the reconstruction errors and failure rates after IK or retargeting of final grasp predictions, and do these errors correlate with grasp failures?

Reviewer_jbajOpenReview ↗
Rating
2
Confidence
2
Informativeness
2
Presentation
1
Soundness
2
Read review
Paper summary

The paper studies cross-embodiment generalization of 5-finger dexterous on object grasping. It proposes a novel method to use patch representation instead of other types of hand represetnation. The traininig pipeline involves hand-structure pre-training, dual-branch diffusion, and online adaptation for a new gripper.

Experiments show substatial improvement over baselines in the zero-shot crossembodiement generalization.

Critical strengths
  1. the represetation is novel and so as the model architecture
  2. the cross-embodiment generalization is significant.
Critical weaknesses
  1. The paper is not well-written, it is hard to understand each component and their contribution to the final results. I suggest reframe the method parts to make it easy to follow.
  2. It lacks comparison with other choices againgst patches, how about link SE(3) with basic geoemtry meshes
  3. I find it hard to understand how the patch transfer between different hands and on novel objects. Does the author want similar contact patches on the object across different hands?
  4. The real-world result shows mostly small toy object rather big daily objects, which limit the arguments to a certain type of objects that can be solved by the model.
  5. Given a new hand, it is also possible to train with on some new data. Thus it is important to show how the base model supports efficient finetuning. Here, I doubt a little on this as the whole model training is very complicated.
Questions for authors
  1. How is the real-world grasp execuated?
Reviewer_nTfAOpenReview ↗
Rating
2
Confidence
4
Informativeness
1
Presentation
3
Soundness
2
Read review
Paper summary

This paper presents PaTRO-Grasp, a cross-embodiment grasp synthesis method using surface-patch representations (sampled pc + se3 transform) and a two-stage diffusion model to transfer grasping prior to unseen robot hands.

Critical strengths
  • The paper explores an interesting representation for cross-embodiment grasping.
  • The simulation results are promising, and real-world experiments are included.
Critical weaknesses
  • Benchmark consistency. The paper changes the benchmark settings compared with previous works, including object datasets and evaluation protocols. Since D(R,O) Grasp, T(R,O) Grasp, and DexGrasp-Zero have released their evaluation code, I suggest evaluating on their original benchmarks with the same settings and success criteria to ensure a fair comparison.
  • Limited real-world validation. The real-world experiments focus on one-shot grasping and lifting. It would be more convincing to demonstrate continuous, closed-loop manipulation to show the practical value of the method.
Questions for authors
  • Can the authors report results on the original open-source benchmarks of previous methods, using exactly the same evaluation settings and success criteria?
  • Can the authors provide more continuous real-world manipulation experiments beyond one-shot grasping?

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Discussion (0)

Sign in to comment.