- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
- The paper introduces TRACE, a framework for jointly generating body, hand, and object motion conditioned on text and object geometry.
- The authors jointly train full interaction generation with three single-stream completion tasks and connect frozen features from the generative model to a language model for interaction description.
- The paper provides extensive experimental validation on InterAct, OMOMO, and BEHAVE, covering generation, completion, and interaction description, with ablation studies examining stream modeling, latent representations, and geometric supervision.
Critical strengths
- The model architecture is well designed and closely matches the challenges of coordinating body, hand, and object trajectory.
- The experimental results show clear improvements in contact consistency, and extensive ablation studies support the effectiveness of the key design choices.
- The visualizations are clear and informative, effectively illustrating the quality of the generated interactions.
Critical weaknesses
- The novelty of the coupled-flow formulation could be further clarified.Prior work such as LIGHT already jointly models body, hand, and object streams and enables cross-stream information exchange.
- The implementation details of the stream-modeling ablations in Table 3 are insufficiently described.
Questions for authors
- Could the authors provide more architectural details for the ablation variants in Table 3, and clarify how they differ from the proposed coupled model?
- Could the authors discuss the balance between contact consistency and text–motion alignment, given that the R-Precision scores in the main results table are somewhat lower than those of some baselines?
3 comments
Dear reviewer, the authors have responded to your comment. Could you please take a look? Let us know if you have further concerns.
Thanks for the author's response. The rebuttal has addressed most of my concerns.
Therefore, I will maintain my original rating (weak accept).
Rebuttal by Authors for Reviewer tgFd
We thank the reviewer for thoughtful and insightful comments. We address the concerns below:
1. Methodological Distinction (W1): LIGHT exchanges information across body, hand, and object streams and uses different denoising rates to guide generation in motion space. TRACE instead learns a shared flow over separate continuous latents. Each stream has its own velocity, but all three velocities depend on the full current state. We train the same flow for full generation and masked completion. For example, with observed hand and object motion, it holds both streams fixed and updates only the body. Contact and object-relative losses supervise the decoded motion. Table 4 in the paper shows that continuous latents reduce FID from 0.228 to 0.199 compared with raw motion, and Table E evaluates completion under fixed observations.
2. Ablation Configurations (W2, Q1): All three variants use the same frozen split VAE, text and object conditions, and training objectives. Unified concatenates the three latents along the feature dimension and processes them with one Transformer. Independent keeps separate branches, each reading only its own stream state. Coupled keeps stream-specific projections and exchanges information through joint attention. From Unified to Coupled, Contact F1 rises from 0.760 to 0.799, while R@1 increases from 0.400 to 0.404. We will add these architecture details to the revised manuscript.
3. Contact and Text Alignment (Q2): In Table 1 of the paper, TRACE achieves higher Contact F1 than LIGHT (0.799 vs. 0.627) and lower R@1 (0.404 vs. 0.421). Within TRACE, adding geometric supervision in Table 5 improves both Contact F1 (0.715 to 0.799) and R@3 (0.736 to 0.744). We will discuss the retrieval gap alongside the contact gains and distinguish the comparison across methods from the effect of geometric supervision within TRACE.
We thank the reviewer for the constructive feedback. If the reviewer has any further questions or suggestions, we are happy to discuss them.