- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2(+1)
- Presentation
- 3
- Soundness
- 2(+1)
Read review
Paper summary
This paper proposes I²MoT, a unified framework for individual and two-person interactive motion generation and understanding. It contributes three components: CMR, A task-specific Mixture-of-Transformers, Participant-grounded chain-of-thought (CoT) supervision
The paper claims that this design mitigates task interference, lets understanding guide interactive generation, and achieves superior performance across all tasks on HumanML3D and InterHuman.
Critical strengths
- The participant-level annotation of InterHuman (6,217 pairs, multi-view with human review) is a potentially useful resource for fine-grained interaction modeling.
- The paper proposes an evaluation method on unified model: freezing the language branch to preserve LLM’s semantics (including CoT). We find this valuable and reasonable. The paper is transparent about evaluation settings and includes informative diagnostics, such as the motion/relation substitution analysis in Table 13.
Critical weaknesses
-
The central claim of this paper, that unified model have participant-level CoT (benefied from motion understanding) that guides interactive motion generation, is not supported by either the design or the experiments. CoT is introduced as a semantic foundation for understanding-guided generation and as supporting complex interaction generation through individual motion understanding, due to the unified design proposed by this paper. However, Appendix A.9 states: The generation task retains the original interaction caption as its condition; the structured output is not fed back as a generation plan. Therefore, it's not clear how CoT functions in this unified model. Moreover, we didn't see the ablation study w/o CoT in terms of motion understanding/generation.
-
The claimed benefits of unification, mitigating task interference (Q2) and understanding-guided generation (Q3), are tested only on jointly trained models, which perform substantially worse than the models reported in the main tables. Table 1 (generation) uses a generator trained only for text-to-motion; and Table 2 (individual understanding) uses the Qwen3.5 VAE captioner. Neither table/figure reports performance on separate models. Performance of Q2 and Q3 on these models should also be reported (even if very low performance), to make sure the benefits are emerged from model unification.
Questions for authors
Can you provide a controlled comparison of interaction understanding w/o participant-grounded CoT, using the same data and evaluation set? In Table 9, the CoT variant has lower R@3 than non-CoT (0.627 vs. 0.659), while also differing in evaluation samples (857 vs. 1,082), training updates (26k vs. 342k), and relation projection (two-stage vs. direct). A matched ablation is needed to verify the benefit of the new annotations and the CoT formulation, and to justify them relative to existing participant-level descriptions such as in2IN.