- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
KIPS estimates dense grasp pressure from hand trajectories recovered from egocentric video. It combines wrist and joint kinematics, learned acceleration prototypes, phase-structured temporal modeling, and anatomical pressure decoding, with optional RGB conditioning. Experiments on EgoTactile and OpenTouch show strong pressure-prediction results, with additional analyses of transfer, motion regimes, robustness, and limited-lookahead inference. The paper treats pressure recovery as conditional prediction and acknowledges that kinematics does not uniquely determine contact forces.
Critical strengths
-
KIPS-K reduces EgoTactile MAE from 3.400 to 2.639 on object-held-out evaluation and from 5.800 to 3.021 on subject-held-out evaluation relative to EgoPressureDiff (Table 1). OpenTouch and bare-hand transfer provide further evidence that recovered hand motion is useful for pressure estimation.
-
Table 4 controls for pressure magnitude and clip differences; Table 6 includes an RGB-only comparison on OpenTouch; Figure 5 studies derivatives and temporal modeling. These strengthen the empirical case beyond raw motion–error correlations. The paper also acknowledges limitations, including weaker zero-shot spatial overlap.
Critical weaknesses
-
Modality attribution remains incomplete on EgoTactile. The RGB-only KIPS comparison is reported only on OpenTouch. On EgoTactile, the principal comparisons involve different model families, so the gains cannot be cleanly attributed to the input modality rather than temporal modeling and decoding. Extending the existing RGB-only control to one representative EgoTactile split would directly strengthen the central claim. Figure 5 is helpful, but the precise scope of “w/o Vel. and Acc.” also needs clarification before interpreting it as a configuration-versus-dynamics comparison.
-
Baseline coverage and comparison details need clearer justification. HOPE (Jeon et al., 2026) is cited and directly relevant to video-and-pose pressure estimation, yet the OpenTouch comparison in Table 3 includes only an adapted HACO baseline. The relationship to this closer prior work deserves explanation. Section 4.1 also leaves the provenance of baseline numbers unclear, while Appendix A.3 does not define NRMSE or explain OpenTouch CoP in millimeters. These gaps limit assessment of both comparative performance and contribution.
Questions for authors
- Could you report the existing KIPS-RGB variant on the EgoTactile object-held-out split, matching temporal context and training settings, and explain the architectural changes needed to remove kinematic inputs?
- In Figure 5, does “w/o Vel. and Acc.” also remove wrist derivatives, Δv/Δa, acceleration-prototype assignments, and the acceleration-conditioned spatial prior? Please specify the retained inputs and report the absolute results of this existing ablation.
- Why is HOPE omitted from the OpenTouch comparison, and are its task and evaluation protocol compatible? An explanation of relevant differences is sufficient where direct comparison is inappropriate. Please also identify reproduced versus previously reported baseline numbers and clarify the CoP/NRMSE definitions used for the comparisons.
2 comments
change rating to weak acceptance
Thank the author for the timely and detailed response, which addressed my concerns and improved the manuscript's completeness. I would like to change my rating to weak acceptance.
We thank the reviewer for recognizing our extensive experimental results and thorough supporting analyses. We address the key concerns point by point below.
Q1. Comparison with HOPE
HOPE's code was unavailable at submission, preventing a direct comparison at that time. We adapt and retrain HOPE on our dataset splits, training its pressure-related modules. We retain HOPE's original window length and stride while matching KIPS' training epochs, valid evaluation locations, pressure units, and evaluator.
Table 1. Object held-out comparison.
Table 2. Subject held-out comparison.
Table 3. Bare-hand zero-shot transfer.
Table 4. Bare-hand fine-tuning.
Table 5. OpenTouch comparison.
HOPE achieves higher V-IoU and C-IoU under bare-hand zero-shot transfer. KIPS-K+RGB outperforms HOPE on other reported metrics and protocols.
Q2. Baseline and metric definitions
Hardware constraints prevented us from retraining EgoPressureDiff, so we report its published results under the same evaluation protocol. HACO is initialized from its released pretrained weights, augmented with a pressure prediction head, and fine-tuned on the corresponding training split.
For OpenTouch, NRMSE is RMSE divided by the mean ground-truth pressure over valid evaluation locations, multiplied by 100 when reported as a percentage.
CoP is computed separately within the five finger regions and the palm. We calculate pressure-weighted predicted and ground-truth centers, measure their Euclidean distance, and aggregate using the specified region and frame rules. OpenTouch uses metric coordinates from the same template mesh, converted to millimetres. EgoTactile follows the official sensor-grid coordinate units. We will identify the source of each baseline result and clarify these metric definitions in the revision.
Q3. Ablations
The velocity/acceleration ablation removes explicit wrist- and joint-level velocities and accelerations, together with the associated prototype dictionary and spatial prior.
We additionally provide finer-grained input ablations separating joint configuration θ, velocity, and acceleration. These keep the network parameter count unchanged, with unused input channels set to zero. The prototype dictionary modules remain. Without acceleration input, prototype retrieval becomes input-independent and yields a static learnable spatial prior. Explicit motion derivatives improve performance on both datasets.
Table 6. EgoTactile input ablations.
Table 7. OpenTouch input ablations.
Q4. RGB-only comparison
We add an RGB-only variant that removes kinematic inputs and their dedicated processing components, including the acceleration-conditioned spatial prior and the parts for explicit joint- and wrist-level velocities and accelerations. Phase states are predicted by RGB temporal features. Combining RGB and motion states improves most metrics. OpenTouch with lower trajectory noise enables more pronounced gains.
Table 8. RGB-only: gloved.
Table 9. RGB-only: bare-hand.