- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents BUMP, a text-driven multi-object HOI synthesis framework. It sequentially generates human and manipulated-object motions, while using physics simulation for the responses of other objects. The paper also introduces a heterogeneous data integration pipeline and outcome-conditioned interaction editing. Experiments evaluate generation quality and contact consistency on existing HOI benchmarks, with ablations on data supervision and qualitative editing demonstrations.
Critical strengths
-
Heterogeneous data integration. The integration of human-only, full-body HOI, and hand-centric manipulation datasets is a useful contribution, especially given the scarcity of full-body multi-object interaction data. The fitting and retargeting pipeline provides a practical way to leverage these heterogeneous sources, and the ablations demonstrate some benefits.
-
Outcome-conditioned interaction editing. I find this component more interesting than the main generation framework. Instead of directly specifying object trajectories, the method allows users to specify a desired physical outcome and adjusts the manipulated object's trajectory accordingly. The local correction and simulation-based verification offer a useful form of interaction controllability.
Critical weaknesses
Limited novelty of the main generation framework. My main concern is that the central design largely combines ideas already explored in HOI generation.
First, decomposing human and object motion generation is not new. For example, OMOMO adopts an object-to-hand-to-human generation pipeline, demonstrating that human–object coordination can be handled through sequential generation. Other methods, such as HOI-Diff, HIMO, and HOI-Dyn, have explored joint or coupled human–object generation. Therefore, BUMP's human-first, object-second formulation does not seem to offer a particularly new modeling perspective.
More importantly, InterDreamer has already explored separating human motion semantics from object dynamics, using a learned world model to predict physical object responses and iteratively refine the interaction. This is conceptually close to BUMP's principle of generating intentional motion while obtaining physical consequences separately. BUMP replaces learned dynamics with a conventional physics simulator, but its main pipeline lacks the iterative physical feedback present in InterDreamer.
The driver–responder decomposition is reasonable, but object roles are determined heuristically during training and provided at inference. Moreover, existing HOI generators could also be used to generate human and manipulated-object trajectories, with subsequent object responses obtained through the same physics simulator.
Overall, while the integration is practical, I find the methodological novelty of the main framework rather limited.
Questions for authors
-
How does BUMP fundamentally differ from existing approaches such as OMOMO and InterDreamer? In particular, InterDreamer already separates semantic human motion from physical object dynamics, with iterative interaction refinement. Beyond replacing learned dynamics with MuJoCo and introducing the driver–responder distinction, what is the key methodological advance?
-
Would existing sequential or joint HOI generators combined with the same physics simulator achieve comparable results? A controlled comparison using the same simulation setup would be particularly important for assessing the value of the proposed factorization.