- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents Touch-HOI, a framework for tactile shape reconstruction and active grasp selection. It combines contact observations, valid non-contact observations, and posed-hand geometry to condition a latent flow model. Generated shape hypotheses support reconstruction and action selection through hypothetical Bayesian reweighting and geometric disagreement reduction.
Critical strengths
The paper shows that non-contact and hand-pose information can improve tactile reconstruction, with particularly clear benefits when contacts are sparse (Table 4). This is a useful finding for reconstruction from limited observations. The proposed grasp-selection strategy consistently improves reconstruction over the compared exploration policies (Table 3), without requiring additional policy training.
Critical weaknesses
The evaluation assumes a known object frame and does not test errors in hand pose or tactile registration. Since the method gains from spatially combining contact, non-contact, and hand geometry, it remains unclear how well these gains hold under imperfect alignment. This limits the evidence for use beyond the simulated benchmark.
Questions for authors
How sensitive are the gains from non-contact and hand-pose information to small registration errors? A modest perturbation test would help establish whether these cues remain beneficial under imperfect alignment.
Response to Reviewer mPmM
We sincerely thank the reviewer for recognizing that “non-contact and hand-pose information can improve tactile reconstruction” with “particularly clear benefits when contacts are sparse” and that the proposed method “consistently improves reconstruction without requiring additional policy training.” We also appreciate your constructive suggestion to assess whether these benefits persist under imperfect alignment.
W1. Robustness to imperfect hand–object alignment.
We recognize that accurate alignment cannot be taken for granted, particularly in real-world deployments. According to [1], the hand–object registration errors typically remain within 5 mm in translation and 5° in rotation, we therefore evaluate registration errors that jointly transform contact observations, non-contact observations, and posed-hand geometry. As summarized in the table below, the original model exhibits strong robustness at 1 mm/1° and relatively stable performance at 2.5 mm/2.5°. Under the extreme stress test of 5 mm/5° registration errors, a more pronounced degradation is observed. However, this degradation can be substantially mitigated through retraining with the same data augmentation. Furthermore, to account for tactile sensing imperfections, we evaluate our method's robustness by injecting 1 mm Gaussian noise into the contact positions. As shown in the table below, our method achieves a Chamfer Distance (CD) of 2.411 under 1 mm Gaussian noise (approximately 5.7% of the tactile sensor width), demonstrating robustness to potential tactile hardware noise.
Q1. Do non-contact and hand-pose cues remain beneficial under registration errors?
As shown in the table below, our model exhibits strong resilience under common 1 mm/1° registration errors and the larger 2.5 mm/2.5° registration errors, achieving Mean CD values of 2.400 and 2.577, respectively. Both values are lower than those of the models without hand proprioception (2.618) or non-contact evidence (3.202), even when these two models are evaluated without any registration errors. These results demonstrate the effectiveness of our method under registration errors.
Reference
[1] Nonnengießer et al. In-Hand Object Pose Estimation via Visual-Tactile Fusion. arXiv:2506.10787, 2025.