- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper addresses multi-person 3D motion prediction. The authors argue that regression-based methods predict joint coordinates directly and so may produce skeletons that are not kinematically consistent. They propose KiJacoMMP, which predicts a future velocity field with a GCN+attention encoder-decoder. Acceleration-field and inter-person interaction encoders feed this decoder. The predicted velocities are then integrated frame by frame from the last observed pose. A Jacobian Iterative Solver (JIS) corrects the integrated joint positions to satisfy bone-length constraints, using an analytic sparse Jacobian and a damped linearized system. The method needs no mass, forces, or physics simulator.
The paper reports lower JPE and APE than recent baselines (including IAFormer and ST-MoE) on CMU-Mocap, Mix1 (6 people), and Mix2 (10 people), with larger gains in crowded scenes. Validation consists of a module ablation on CMU-Mocap, an analysis of solver iteration count (converging by about 10 iterations), 20 repeated runs showing small variance, and one qualitative example.
Critical strengths
-
A simple, practical idea that is easy to adopt. Enforcing bone-length consistency with an analytic sparse Jacobian and a damped solver requires no physical parameters, so it can be used on any skeleton-only mocap data. The solver reaches saturation within about 10 iterations, which makes it plausible as a drop-in component. This is the main reason I find the paper worth encouraging.
-
Consistent gains over strong, recent baselines. The method improves JPE and APE at every horizon on all three settings, including against AAAI'26 ST-MoE, and the improvement grows in the more crowded Mix2 setting (e.g., 15 mm at 1.0 s). The ablations show every module helping, and repeated runs indicate that the margins are well above run-to-run noise.
Critical weaknesses
- The central claim, "kinematically feasible predictions," is never directly measured, and the source of the gain is not isolated.
The motivation is that baselines violate skeletal constraints, but the paper reports only JPE/APE. There is no bone-length error, no measurement of how much baselines actually violate constraints, and no before/after view of what JIS corrects. In addition, the model integrates predicted velocities, which naturally drifts, and the "w/o JIS" variant (162 at 1.0 s) is worse than IAFormer (161) and ST-MoE (158). So part of the JIS gain may come from compensating for drift introduced by the velocity-integration design itself, rather than from constraints improving over coordinate regression. It is also unclear whether "w/o JIS" is retrained or only evaluated with the solver removed. Without feasibility metrics and a cleaner control, the paper's main message is not yet supported by its evidence. I think this is fixable.
- Limited novelty and missing comparisons to the natural alternatives.
The acceleration and interaction encoders are standard (finite differences, GCN, attention), and the main new element is applying a classical constraint solver as a layer. The paper does not compare against simple bone-length projection or classical IK/PBD-style corrections, and does not show JIS as a plug-in on other methods' outputs (e.g., IAFormer, ST-MoE). These would show what the proposed solver adds and whether it generalizes. Evaluation is also narrow (CMU-Mocap plus two mixed sets built partly from pseudo-labeled data, ablations only on CMU-Mocap), and efficiency and key hyperparameters are not reported. Closely related recent work (KinemaDiff, Lu et al.) is cited but not discussed or compared.
Questions for authors
Clarification on these could change my assessments.
-
Is the "w/o JIS" model retrained without the solver, or is JIS only removed at inference? Is the solver differentiated through during training, and how many iterations are used at train versus test time?
-
Can you report bone-length error (mean and variance over time) for KiJacoMMP, the "w/o JIS" variant, and the baselines? This is the direct evidence for the feasibility claim.
-
How does JIS compare with a simple bone-length rescaling/projection or classical IK/PBD correction applied to the same preliminary predictions?
-
Does JIS also improve the outputs of IAFormer and ST-MoE when applied as post-processing?
Response to The Reviewer
We thank the reviewers for suggesting additional experiments to further clarify the independent contribution, transferability, and computational overhead of JIS. We have added the following experiments and analyses to the revised manuscript.
(1) Cross-backbone plug-in experiment (Section 4.6). To examine whether the benefits of JIS are limited to the velocity prediction architecture of KiJacoMMP, we apply it to the predictions of IAFormer and ST-MoE without changing their backbone architectures. After incorporating JIS, both methods exhibit lower JPE at all reported horizons. At 1.0 s, their errors decrease from 159.31 to 158.09 mm and from 158.95 to 157.54 mm, respectively. These modest but consistent improvements support the transferability of JIS. Meanwhile, the complete KiJacoMMP achieves a lower error of 153.01 mm, indicating that simply adding JIS cannot reproduce the performance of the complete framework.
(2) Bone length error comparison experiment (Section 4.7). To directly evaluate the bone segment length consistency targeted by JIS, rather than relying solely on joint coordinate errors, we introduce the bone length error metric, BLE, together with its calculation formula. BLE measures the mean absolute difference between predicted bone lengths and their reference lengths from the last observed frame. At 1.0 s, the BLEs of IAFormer and ST-MoE reach 21.701 and 22.994 mm, respectively. KiJacoMMP also exhibits increasing bone length deviations with longer prediction horizons when JIS is removed, whereas incorporating JIS reduces BLE to the order of 10⁻⁵ mm at all reported horizons. This provides direct evidence of consistency for the predefined fixed-length bone segments, but does not imply that complete kinematic or dynamic feasibility is guaranteed.
(3) Comparison with simpler solvers (Section 5.3). We compare JIS with edge-wise forward and reverse correction applied to the same preliminary predictions. Without correction, the JPE at 1.0 s is 159.11 mm. Edge-wise forward and reverse correction reduce it to 155.54 and 158.00 mm, respectively, indicating that simple corrections are also effective, but their processing order affects the results. JIS further reduces the error to 153.01 mm and achieves the lowest JPE at all three reported horizons. These results support the effectiveness of jointly updating shared joints through a coupled system relative to the edge-wise correction procedures tested in this experiment.
(4) Runtime efficiency experiment (added after the existing content of Section 5.2). We report mean inference latency and the P50 and P95 statistics for batches of 96 three-person scenes, measured over 30 runs after 10 warm-up runs. Without JIS, the mean latency is 132.325 ms. With 1, 3, and 10 iterations, it increases to 165.942, 203.848, and 340.159 ms, respectively, reaching 1140.3 ms with 50 iterations. For 10 iterations, P50 and P95 are 340.012 and 342.011 ms, respectively. We explicitly acknowledge the additional computational overhead introduced by JIS and explain that the iteration budget should be selected by jointly considering constraint satisfaction, prediction accuracy, and inference efficiency in practical applications.