- Rating
- 2(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2(+1)
- Soundness
- 2
Read review
Paper summary
This paper investigates unsupervised temporal segmentation of hand-object interactions using second-order motion features. The authors propose a training-free geometric framework that maps 3D scene flow onto Grassmannian manifolds and detects action boundaries through manifold acceleration and direction changes. Fréchet smoothing and jump-diffusion improve noise robustness, while spatial signatures and hierarchical clustering group similar motion segments. The method is evaluated on OakInk2, HOT3D, and EPIC-KITCHENS, showing improvements over zero-order representations and other baselines. Additional experiments examine noise robustness, scene-flow quality, and component ablations.
Critical strengths
- The paper addresses unsupervised fine-grained HOI segmentation, an important problem in motion understanding. Exploring second-order motion features to distinguish subtle action transitions is a promising direction.
- The paper introduces a training-free framework using Grassmannian geometry, manifold acceleration, and direction-change features. Results across multiple datasets show improvements over zero-order and other baselines, suggesting the potential of this approach.
Critical weaknesses
- Table 1 shows limited improvements over the zero-order Grassmannian baseline, particularly on HOT3D. The comparisons suggest that much of the performance gain may come from the Grassmannian representation itself, rather than the proposed second-order features. Given that second-order motion representation is the core contribution, more targeted experiments are needed to demonstrate its necessity for distinguishing fine-grained motion transitions.
- Although the supplementary qualitative results show meaningful action boundaries, the role and practical value of the clustering stage remain unclear. The method assigns cluster IDs to motion segments, but its contribution to HOI understanding is not sufficiently demonstrated. Beyond ARI and NMI, evaluations of semantic interpretability or downstream tasks, such as action retrieval, procedural analysis, and annotation assistance, would strengthen the work. Additionally, reducing redundant descriptions in the main paper and including more intuitive figures and stronger experimental results would help better support the paper's central claims.
Questions for authors
- Grassmannian subspaces may discard motion direction and magnitude information, as (v) and (-v) span the same subspace. How does the proposed representation distinguish motion reversals such as tightening versus loosening? Can authors provide controlled experiments addressing this potential information loss?
- Algorithm 2 and Appendix A.2 use different temporal normalizations for manifold acceleration. Could authors clarify the relationship between the implemented discrete feature and continuous covariant acceleration, and provide a rigorous justification for the error bound in Theorem 3.1?
- Although Table 1 and Appendix Table 7 provide relevant comparisons, it remains unclear whether the improvements can be attributed specifically to second-order features, as some baselines use different detection procedures. Could authors clarify whether the zero-order baseline shares all other settings and provide more targeted evaluations of fine-grained motion transitions?