- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
JCA jointly generates video and 3D motion for arbitrary rigs, then estimates a camera to align the motion with the video. It connects a separately pretrained motion model to a video backbone through cross-attention bridges. The paper introduces a paired-data pipeline and bridge guidance, with evaluations on rig animation, human video–motion generation, and motion recovery.
Critical strengths
- The problem is useful: one model generates video and 3D motion for different rigs, with camera alignment for scene placement. It also supports video-to-motion, motion-to-video, and keyframe control.
- Bridge guidance is simple and effective. In Table 3, it reduces PA-MPJPE from about 85 to 72, while disconnecting the bridges increases the error to about 141.
- The data pipeline is practical. Video editing places animated assets in realistic scenes, and filtering checks label consistency. The resulting paired corpus covers a wide range of rigs.
- The results are encouraging: JCA achieves better prompt adherence than the tested rig-animation baselines, and the human-fine-tuned model outperforms EchoMotion on synchronization.
Critical weaknesses
- Although Puppeteer and ActionMesh are included, a direct Wan2.2 → TopoCap/MoCapAnything V2 baseline is missing. This makes it harder to judge the benefit over a strong video-generation-plus-motion-recovery pipeline.
- There is no matched video-quality comparison with the original Wan2.2. It is therefore unclear whether LoRA adaptation and joint training preserve the backbone's video quality.
- The human evaluation reports synchronization and video quality, but not standard text-to-motion metrics such as R-Precision, FID, MM-Dist, and Diversity. These would help assess text alignment and motion quality beyond agreement with the video.
Questions for authors
- Do you plan to publicly release the dataset, code, and model weights?
2 comments
Thanks for the detailed rebuttal. This answers my questions.
The video-first baselines, the Wan2.2 quality comparison, and the text-to-motion metrics are all what I asked for, and the results look convincing to me.
No remaining concerns from me. I'm keeping my score at 3 (weak accept).
Looking forward to the code and model release!
Response to Reviewer H6r1
Dear Reviewer H6r1, thank you for supporting acceptance and for finding the problem "useful," bridge guidance "simple and effective," and the results "encouraging."
The main concern was evaluation coverage: direct video-first baselines, a matched video-quality comparison with Wan2.2, and standard text-to-motion metrics. We added all three. We summarize the new results first, then give details below.
Regarding release, we plan to publicly release the code, trained model checkpoints and data, subject to a formal licensing review. We believe this addresses the reviewer's concerns and question, and are happy to discuss further.
Answers to the concerns
Thank you for the suggestion. We added both direct baselines, Wan2.2 → TopoCap and Wan2.2 → MoCapAnything V2, to the revised Table 1. JCA achieves substantially higher prompt adherence: 58.4, compared with 24.0 for TopoCap and 40.2 for MoCapAnything V2. MoCapAnything V2 achieves higher smoothness (.991 vs. .983) and lower mesh distortion (.16% vs. .20%), but substantially lower dynamic degree (.45 vs. .83).
Following the reviewer’s suggestion, we expanded the video-quality evaluation from Table 2 with additional VBench metrics and the original Wan2.2 baseline, reporting the new results in App. I, Table 10. Our model achieves comparable video quality overall, with improvements on some metrics and small decreases on others, suggesting that LoRA adaptation and joint training largely preserve the backbone’s video quality.
To address the reviewer’s request for standard text-to-motion evaluation, we extended the evaluation in Table 2 with R-Precision, FID, MM-Dist, and Diversity on the same HumanML3D test prompts from Section 4.3, with new results in Table 9 and the evaluation protocol in revised App. G. These results mirror the synchronization results in Table 2: the general JCA model trails the human-specific EchoMotion model, while JCA SMPL-FT substantially outperforms it. It achieves the highest R-Precision at all reported ranks and the lowest FID and MM-Dist among the compared methods. Relative to EchoMotion, R@1 improves from 0.272 to 0.305 and FID decreases from 6.185 to 5.324, supporting text alignment and motion quality beyond video–motion synchronization.
Yes. We plan to publicly release the code, trained model checkpoints and data. Because our models and the OiV dataset are built from third-party assets, videos and motion data whose licenses differ, their release is subject to a formal licensing review.