- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
When executing generated human motions in a physics simulator, physical constraints can make it challenging to faithfully reproduce the intended motions. This paper proposes DIGHT, a framework that encourages a human motion generator to produce motions that a humanoid tracking policy can execute while preserving the intended interactions.
Specifically, DIGHT fine-tunes the generator using direct preference optimization (DPO) to produce motions that are easier for the tracker to execute while maintaining interaction fidelity. The tracker is subsequently adapted to better follow the motions produced by the aligned generator. The authors claim that their approach generates more physically executable motions than the compared methods considered in the paper.
Critical strengths
The paper presents a framework for generating two-person interactions that can be more reliably tracked and executed in a physics simulator.
The proposed preference design explicitly considers contact occurrence, topology, duration, and force between two humanoids.
Critical weaknesses
- The novel contributions of this paper beyond existing methods are not sufficiently clear.
Several key components of the proposed framework appear to have already been explored in prior work. Specifically, adapting a human motion generator to the capabilities of a humanoid tracker has been investigated in PhysMoDPO, while physics-decoupled diffusion DPO and the use of multiple physics-grounded preferences appear closely related to PhysMoDPO and BideDPO. Furthermore, the idea of jointly improving a generator and a tracker has already been explored in works such as PARC.
As it stands, the main contribution of this paper appears to be the integration of these existing techniques into a framework for two-humanoid interaction generation, along with the introduction of contact-related preferences.
- The experimental results do not sufficiently substantiate the contributions specific to this paper.
First, the comparison between InterGen + DPO and DIGHT is difficult to interpret because the paper does not clearly explain the specific differences between the two methods. Without a precise description of how the standard DPO baseline is implemented and how it differs from DIGHT, it is unclear what conclusions can be drawn from this comparison. At a minimum, the authors should explicitly clarify the differences between the DPO baseline and the proposed approach.
Second, Tables 1, 2, 3, and 4 lack metrics that directly evaluate interaction and contact fidelity, such as contact topology precision and recall. Given that the primary contribution specific to this paper appears to lie in modeling two-person interactions and contact fidelity, these metrics are essential for validating the effectiveness of the proposed approach.
Although Force Error is reported, this metric only measures the discrepancy in mean contact force between generated and ground-truth executions. It does not capture whether contacts occur at the correct body regions or whether their durations are accurately reproduced. Therefore, the current evaluation metrics are insufficient to demonstrate improvements in the interaction-specific aspects of the proposed method.
In particular, the results in Tables 1–4 mainly demonstrate improvements in general motion quality and physical executability, which have already been addressed in prior work such as PhysMoDPO. They do not provide sufficient evidence that the contributions specific to this paper lead to better interaction fidelity.
Third, Table 5 reports contact-related metrics, including contact topology precision and recall, and compares InterGen against DIGHT. However, this comparison evaluates the combined effects of the entire framework, including components derived from existing methods, rather than isolating the effects of the proposed contact-related preferences. Consequently, it is difficult to determine how much of the improvement can be attributed to the contributions specific to this paper.
Questions for authors
Please refer to the Critical Weaknesses.
5 comments
Response to Reviewer AQfJ
W2-3: Metrics beyond mean contact force for evaluating interaction fidelity.
To demonstrate the interaction fidelity improvement, we introduce contact topology precsion and recall in main paper (Tab. 5), which evaluates the correctness of contact regions. Topology precision measures the fraction of realized contact pairs that are intended, while recall measures the fraction of intended contact pairs that are realized. More evaluating results of additional baselines are shown in W2-2.
| Method | Topo. Prec | Topo. Recall | Succ. |
|---|---|---|---|
| InterGen | 38.29 | 52.16 | 84.70 |
| DIGHT | 46.77 | 63.94 | 89.23 |
Additionally, to assess whether the durations are accurately reproduced and how accurately generated motions reproduce contact forces at individual joints, we introduce two additional metrics Duration and Joint Force Error. Specifically, for duration metric, we compute the absolute difference between the longest inter-person contact episode in the generated and reference executions. For joint force error metric, we compare the mean contact force at each joint between the generated and ground-truth executions and averaging the absolute differences across joints. The result is provided below:
| Method | FID | MM-Dist | R-Precision (Top-1) | Skate | Float | Interpen | Jerk | Force Error | Joint Force Error | Duration |
|---|---|---|---|---|---|---|---|---|---|---|
| InterGen | 1.539 | 0.954 | 0.474 | 7.27 | 22.40 | 10.69 | 148.96 | 577.41 | 38.13 | 0.24 |
| DIGHT | 1.474 | 0.942 | 0.486 | 5.67 | 18.58 | 8.42 | 111.94 | 427.98 | 27.57 | 0.17 |
DIGHT improves on all metrics, showing that our approach improves interaction fidelity.
W2-4: Evidence for improved interaction fidelity and comparison with PhysMoDPO
To evaluate whether our method improves interaction fidelity, we introduce Force Error, Topology Contact Precision, and Topology Contact Recall in the main paper. In W2-3, we introduce two additional metrics related to interaction fidelity. More quantitative evidences are provided in W2-2 and W2-3.
We also adapt PhysMoDPO to two-humanoid interactions and evaluate it under matched settings:
| Method | Topo. Prec | Topo. Recall | Succ. | Force Error |
|---|---|---|---|---|
| PhysMoDPO | 42.94 | 50.50 | 87.08 | 523.33 |
| DIGHT w/o tracker adapted | 48.31 | 60.83 | 88.47 | 427.47 |
| DIGHT | 46.77 | 63.94 | 89.23 | 413.47 |
Under matched settings, both DIGHT variants achieve better interaction fidelity than PhysMoDPO.
W2-5: Effect of contact preferences.
To isolate the contribution of contact preferences, we report the topology precision and recall for different reward combinations:
| Reward | Topo. Prec | Topo. Recall | Succ. |
|---|---|---|---|
| - | 38.29 | 52.16 | 84.70 |
| trk | 41.72 | 53.87 | 86.88 |
| +fric | 42.53 | 51.76 | 87.48 |
| +float | 42.12 | 53.25 | 87.48 |
| +contact | 48.31 | 60.83 | 88.47 |
| +tracker adapted | 46.77 | 63.94 | 89.23 |
Adding contact preferences significantly improves topology precision and recall.
Dear Reviewer AQfJ,
We would like to follow up and ask whether our responses have addressed your concerns. We would be happy to discuss any remaining issues. If our responses have resolved your concerns, we would be grateful if you could update your assessment accordingly.
Thank you for your time!
Best regards,
Authors of Submission #5253
Response to Reviewer AQfJ
We thank the reviewer for recognizing the more reliable execution of generated two-person interactions in simulation and the value of our contact-aware preference design. We address the specific concerns below.
W1: Positioning and contribution.
Our central contribution is introducing inter-person contact forces for text-to-interaction generation. Making plausible interaction and contact as intended is one of the most important aspects of two-person motion. However, existing methods such as PhysMoDPO and PARC lack mechanisms to ensure the fidelity of complex interaction. Considering only whether the single motion is physically executable can lead to the failures shown in Fig. 1 of the main paper. The intended contact may fail to occur, or it may occur with excessive force destabilizing the humanoids.
Our key insight is the inter-person contact force can directly reveal whether contact occurs, which body parts make contact, and what forces arise. These signals are essential for improving interaction fidelity. Using DPO to incorporate non-differentiable feedback into training is common practice. Our main different with existing methods (e.g., PhysMoDPO) is to use inter-person contact forces to construct contact preference pairs that directly reflect how the two people interact, thereby improving interaction fidelity.
Through introducing the contact preferences, our method improves contact topology precision from 38.29% to 46.77% and recall from 52.16% to 63.94% on contact-annotated benchmark. Qualitative comparisons in Fig.1, Fig. 3, Appendix A, and the videos in supplementary material also illustrate the improvement in interaction fidelity.
W2-1: DPO baseline and additional comparisons.
In Table 1, InterGen + DPO normalizes each of the five physics scores across the K candidates for each prompt, then sums them to rank candidates and form preference pairs.
We additionally compare DIGHT with two baselines to evaluate our optimization design: a) DIGHT (one group). We retain criterion-specific preference objectives but jointly normalizes all five loss weights without grouping; b) PhysMoDPO. We adapt PhysMoDPO to two-person interactions using the same reward it used. The results are as follow:
Compared with the other optimization designs, DIGHT achieves the best performance.
W2-2: Contact fidelity.
We additionally evaluate these methods on our contact-annotated subset, and report the contact topology precision and recall. For InterAgent, Succ. reports only the non-fall rate, as it has no reference trajectory for computing body deviation.
For Table 1:
For Table 2:
For Table 3:
For Table 4: