- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a three-stage framework for text-driven two-person motion in-betweening. First, a retrained CondMDI model is employed to generate initial motions for each of the two individuals. Next, a Global Interaction Condition integrates the initial inter-person motion relationships, textual descriptions, and keyframe constraints to provide sequence-level interaction guidance. Finally, a Local Residual Gate is used to modulate the intensity of residual corrections based on cross-person evidence, evaluated on a per-person and per-frame basis. The input keyframes are precisely recovered in the final output.
Critical strengths
The proposed GIC provides sequence-level target information, while the LRG regulates the magnitude of adjustments at both the character and frame levels. Cross-character evidence is used solely for estimating the gating mechanism, rather than directly overwriting current motion features, serving as an intuitive strategy for preserving fine-grained details. The paper evaluates the model across two datasets based on motion error, temporal dynamics, distribution quality, text alignment, generation diversity, and interaction coordination. Furthermore, it presents comprehensive analyses, including component and feature ablation studies, an examination of the gating scope, experiments with varying numbers of keyframes, and a user study.
Critical weaknesses
-
There is a lack of direct evaluation regarding the core claim of detail preservation. Current metrics, L2P, L2Q, NPSS, and FID, fail to explicitly measure whether fine-grained, single-person motion details are retained. The paper should report metrics such as joint-wise displacement relative to the initial motion, local pose error, or kinematic derivatives (velocity, acceleration, or jerk). Otherwise, the core contribution rests primarily on indirect metrics and a limited set of visualizations.
-
The comparison with the most relevant prior work on two-person motion in-betweening is insufficient. Cross-Space In-Betweening was excluded from quantitative comparisons due to issues with its code and evaluation protocol, while other key baselines were adapted by the authors from text-to-motion generation methods. Given that the quality of these adaptations and the selection of hyperparameters can significantly influence results, the current experiments do not adequately demonstrate an advantage over methods specifically designed for two-person in-betweening.
-
The methodological innovation is largely incremental. Techniques such as single-person diffusion-based initialization, explicit pairwise features, cross-attention, residual refinement, and sigmoid gating are already established in the field. The paper’s primary contribution appears to be an effective combination of these existing techniques tailored for a specific task.
-
The expressive capacity of the LRG module is limited; each refinement block applies the same global vector to all characters and frames, with its magnitude adjusted only by a scalar gate. Consequently, different frames are essentially restricted to scaling the same refinement direction, and cross-character information influences only the intensity, not the content, of the refinement. It is recommended to compare this approach against alternatives such as frame-wise vector gating, vector-valued gating, or schemes where local residuals are predicted directly from cross-character information.
-
There is potential ambiguity regarding character semantics. Since two independent CondMDI initializers receive the same description of a two-person interaction, which often involves asymmetric roles. The paper does not sufficiently explain how these roles are assigned to the respective characters. This is particularly prone to causing role confusion when keyframes are highly sparse.
Questions for authors
See weakness.