- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper does a relatively comprehensive examination of DexH2R safety concerns by introducing several adversarial scenarios. The authors conduct attacks against pre-trained policies. And experimental results show that their attacks seem to effectively reduce task success rates. My concerns are mainly about the physical grounding of propoesed threads and the generalization of the identified vulnerabilities.
Critical strengths
- This paper provides the relatively comprehensive empirical evaluations across multiple failure modes, where both grasp-pose and motion-generation vulnerabilities are studied. The authors also introduces task-specific attack metrics, and several ablations and evaluations, especially with a safety-oriented human-hand intersection test. All these results make the empirical study relatively broad and systematic. But I still have concerns on the nature and the generality of the underlying threat model as discussed in critical weaknesses.
Critical weaknesses
-
My primary concern is that the physical grounding of the proposed threat is unclear. Several attacks are optimized directly in the processed point-cloud space under white-box access, making it unclear whether the resulting perturbations correspond to realistic changes in the physical world or sensing pipeline. Under such a strong intervention space, high attack success rates may partly reflect the power of the attacker, but it cannot reveal the intrinsic robustness limitation of dexterous handover policies.
-
Another concern is that the identified vulnerabilities are more likely architecture-specific, while may not be policy-general. For example, CPA relies on PointNet critical points, while the grasp attack directly optimizes the cVAE output toward an artificially chosen fist configuration. Without stronger cross-policy transfer or robustness characterization, it is difficult to tell whether these attacks reveal general failure modes of dexterous handover or mainly vulnerabilities of the specific DexH2R pipeline.
Questions for authors
- Can the authors provide empirical evidence that the TCA/CPA perturbations fall within errors produced by a real 3D sensing pipeline? In particular, what sensing mechanism would selectively perturb the critical points used by CPA?
- For the Handover-Sim experiment, is the P3TA trigger learned on DexH2R applied directly, or re-optimized for the new policy? Can the authors report quantitative zero-shot transfer results?
- If the attacker can directly manipulate the processed point cloud with white-box access, what additional vulnerability is revealed beyond the general fragility of the victim model?
- In Table 3, are the attacks adaptively re-optimized against each defense, or are previously generated adversarial examples reused?