- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
-
The paper is generally well written and easy to follow. The hierarchical decomposition of object motion, hand motion, and full-body motion gives the overall framework a clear structure.
-
The experimental coverage is relatively comprehensive. The authors evaluate single-object, articulated-object, and multi-object interaction generation using GRAB, ARCTIC, and HIMO, and the method achieves strong quantitative results across these settings.
-
The paper pays explicit attention to interaction modeling rather than relying only on generic motion-generation objectives. The interaction-aware self-conditioning and interaction-informed loss are conceptually reasonable ways of introducing object-object and hand-object geometric information into diffusion models.
-
The multi-object setting is meaningful and relatively challenging. Predicting which hand interacts with which object and refining the corresponding contact provides a practical mechanism for handling interactions involving multiple objects.
-
The paper also considers out-of-distribution settings, including unseen object trajectories and unseen object categories, which is useful for studying generalization beyond standard in-distribution HOI generation.
-
Overall, the implementation appears technically solid, and the reported results suggest that the proposed combination of components is effective in practice.
Critical strengths
-
The paper is generally well written and easy to follow. The hierarchical decomposition of object motion, hand motion, and full-body motion gives the overall framework a clear structure.
-
The experimental coverage is relatively comprehensive. The authors evaluate single-object, articulated-object, and multi-object interaction generation using GRAB, ARCTIC, and HIMO, and the method achieves strong quantitative results across these settings.
-
The paper pays explicit attention to interaction modeling rather than relying only on generic motion-generation objectives. The interaction-aware self-conditioning and interaction-informed loss are conceptually reasonable ways of introducing object-object and hand-object geometric information into diffusion models.
-
The paper also considers out-of-distribution settings, including unseen object trajectories and unseen object categories, which is useful for studying generalization beyond standard in-distribution HOI generation.
-
Overall, the implementation appears technically solid, and the reported results suggest that the proposed combination of components is effective in practice.
Critical weaknesses
-
Limited methodological novelty. The overall technical contribution appears somewhat incremental. The hierarchical decomposition itself follows prior work, while self-conditioning, geometric interaction representations, diffusion-based generation, and test-time optimization are also established techniques. The main novelty is largely in combining these components and injecting interaction information into different stages of the pipeline. The paper would benefit from a clearer explanation of what fundamentally new modeling insight is introduced beyond this integration. In particular, the current ablation does not compare the proposed interaction-aware self-conditioning against standard self-conditioning, making it difficult to determine whether the gains come from the proposed interaction representation or simply from adding self-conditioning.
-
Limited diversity of full-body interaction dynamics. Although the paper claims generalizable full-body HOI generation, the evaluated interactions are predominantly localized object manipulation. There is relatively limited evidence for interactions involving substantial lower-body movement, long-range root translation, walking while carrying objects, approaching or leaving objects, or dynamic pushing/pulling behaviors. Therefore, the demonstrated generality is mainly over object configurations rather than over full-body interaction dynamics. Evaluation on more locomotion-rich HOI data, such as OMOMO and BEHAVE-style interaction scenarios, would substantially strengthen the claim.
-
The "unified" claim is somewhat overstated. The paper repeatedly emphasizes that OmniHOI provides a single framework across different interaction settings. However, the authors actually train one model per benchmark, rather than jointly training a single model across GRAB, ARCTIC, and HIMO. Therefore, the current results mainly demonstrate a unified architecture rather than a truly unified HOI model. This distinction should be made clearer, or joint cross-dataset training should be investigated.
-
The OOD trajectory experiment is not an end-to-end evaluation of trajectory generalization. For this experiment, the ground-truth object trajectories from the held-out test set directly replace the output of the object-motion generation stage. Therefore, this experiment evaluates whether the hand and body generators can follow externally provided unseen trajectories, rather than whether the complete OmniHOI framework can generate unseen object trajectories from text. The corresponding generalization claim should be stated more carefully.
-
Error propagation in the hierarchical pipeline is insufficiently studied. The object-motion, hand-motion, and full-body generators are trained separately, so errors from early stages can naturally propagate to downstream stages. However, the paper does not provide oracle-style experiments to quantify this effect. For example, comparisons using GT object motion versus generated object motion, or GT hand trajectories versus generated hand trajectories, would help reveal where the major errors originate and how robust the later stages are to imperfect intermediate predictions.
-
The physical plausibility analysis is not fully convincing. While OmniHOI improves several contact-related metrics, it does not consistently improve penetration. This suggests a possible trade-off between increasing contact and introducing excessive interpenetration. The paper should discuss this issue more carefully and ideally provide additional analysis showing whether improved contact accuracy actually corresponds to physically valid interaction.
Questions for authors
I would like to ask the author if they checked the performance on the OMOMO dataset, which involves more complex full-body locomotion and manipulations. For the other questions, please refer to the weaknesses.