- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper predicts how objects will move given the scene history and human’s future motion. It focuses on cases where similar human motions may lead to different object responses. The method combines paired action supervision, predictions in different coordinate frames, and candidate trajectory ranking. Experiments on recorded interactions, constructed action pairs, and physical simulation show improvements in object prediction.
Critical strengths
-
The problem is worth studying. The paper predicts the next world states, instead of just predicting the next frames. This focus on human–object interaction, which is helpful to building world models that can support interaction.
-
Combining interaction geometry with learned motion is a reasonable approach, and the adaptive transport results provide support for it. On BEHAVE, the method improves object prediction over baselines given the same human plan.
Critical weaknesses
-
The main results rely heavily on knowing human's precise future motion. In practice, it is difficult to provide clean human trajectories across different and diverse scenes, and planned motion may differ from the trained ones. I also worry that recorded human motion already reveals much of the object’s future, allowing the model to take a shortcut. The generated-plan results in the paper show much smaller gains, thus the practical benefit remains unclear.
-
The paper is hard to follow. There are many modules, assumptions, and experimental setups, making it easy to lose track of the main idea and which results support it. The authors need to signficantly polish the presentation and writting.
Questions for authors
-
In practice, where would the future human trajectories come from? How do you handle differences between these inputs and the motions used during training, such as measurement noise or errors in position, orientation, and timing? Does the method still outperform matched baselines under these conditions?
-
What does the paired loss add beyond ordinary state supervision? In which interactions does it clearly help, and when does it make little difference?