- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This submission introduces InterAssembly, a training-free approach for long-horizon human-object interaction (HOI) generation. Unlike methods that typically rely on training generative models, InterAssembly assembles coherent, long-horizon, multi-object activities, which do not exist in the original dataset, by leveraging a library of short-duration human motion capture clips. This process is structured into four decoupled stages: LLM-based planning, retrieval, retargeting, and synthesis. The method was evaluated on 15 self-generated long-horizon sequences using both physical/kinematic metrics and a user study.
Critical strengths
-
A new paradigm for long-horizon human-object interaction (HOI) generation is proposed. Unlike other approaches that rely on training generative models, this method can generate long-horizon tasks without requiring the training of any new models.
-
The proposed method is modular and training-free. The four stages, planning, retrieval, redirection, and synthesis, are decoupled, allowing each component to be independently replaced or upgraded, while also avoiding the limitations imposed by a scarcity of long-duration training data.
-
Comprehensive evaluations were conducted using both user studies and physical/kinematic metrics (object jerk, human-object penetration, foot sliding, and human body jerk), with most metrics outperforming the baselines.
Critical weaknesses
-
Despite achieving impressive results in baseline comparisons, neither HOI-Diff nor CHOIS is designed for long-horizon human-object interaction. The lack of comparison against models for long-horizon task interactions, such as those presented in "Human-Object Interaction from Human-Level Instructions" (Wu et al., ICCV 2025), casts doubt on the performance of the proposed method.
-
A notable concern is that the authors did not conduct an ablation study, which makes it unclear how much each individual module contributes to the overall design. In Appendix D, the authors explain that this is due to strong data coupling between the various stages and removing any single stage would cause the entire pipeline to fail. However, the submission lacks comparative analyses within specific stages, such as using random selection or relying solely on structural similarity instead of an LLM-based selection during the retrieval stage. These ablation studies would not disrupt the overall pipeline and could be evaluated using downstream metrics, such as those related to penetration.
-
The results for the 15 sequences reported in Table 1 were selected from a pool of 60, using criteria that overlap with the reported performance metrics. This raises concerns regarding the method's performance.
-
The results shown at the end of the supplemental video have noticeable artifacts, like the pan flipping.
Questions for authors
-
Please compare the proposed method with methods such as ‘Human-Object Interaction from Human-Level Instructions’ (Wu et al., ICCV 2025), which also address long-horizon HOI.
-
Have the authors discussed and explained the advantages of the "retrieval-and-retargeting" paradigm over the "train-to-generate" paradigm?
-
Have the authors conducted an ablation study to analyze the contributions of the individual modules?