- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
AniRig recovers an animation-ready rigged asset from a single observed 3D character mesh, conditioned on a user-provided or VLM-inferred skeletal hierarchy. The method jointly predicts observed- and rest-pose skeletons, estimates sparse skinning weights, and reconstructs a canonical rest mesh through differentiable inverse articulation. Asset-level fine-tuning uses rest-recovery and re-posing losses to jointly refine the predictions. Experiments evaluate skeleton and skinning accuracy, as well as complete-asset recovery on an independent real-motion benchmark.
Critical strengths
-
Clear presentation and well-motivated problem. The paper clearly motivates the need to recover a complete, reusable rigged asset from a posed mesh, rather than evaluating skeletons and skinning weights independently. The method and evaluation are organized around this practical and meaningful problem.
-
Coherent method with supporting evaluation. Paired skeleton prediction, structured sparse skinning, and differentiable pose-to-rest reconstruction form a coherent framework. Asset-level supervision jointly refines skeleton and skinning predictions, while component comparisons, ablations, and an independent real-motion benchmark provide evidence for the proposed design.
Critical weaknesses
-
Insufficient validation of hierarchy and semantic conditioning. Although the appendix provides a VLM hierarchy example, it depicts a character in a rest-like pose. Since the paper targets rest recovery from posed meshes, more challenging articulated cases—with self-occlusion, dense joints, and complex appendages—are needed to assess hierarchy reliability. These cases should show the six-view inputs, inferred and reference hierarchies, and resulting rigs. Furthermore, it is unclear whether frozen CLIP embeddings meaningfully distinguish fine-grained joint names such as tail_01 and tail_02. The effects of varying skeletal topologies and naming conventions across animal categories on training and generalization are also insufficiently explored.
-
Limited comparative evidence for downstream usability. Component-level comparisons do not fully establish the practical benefits of the recovered assets. Side-by-side examples comparing AniRig and suitable baseline pipelines under the same re-posing or rig-editing operations would better substantiate the claims of animation readiness and editability. These comparisons should highlight deformation artifacts and any required manual corrections.
-
Incomplete discussion of relevant work. The related-work discussion should address Auto-Connect: Connectivity-Preserving RigFormer with Direct Preference Optimization, which studies connectivity-preserving skeleton generation and geometry-aware sparse bone selection, and Stroke3D: Lifting 2D Strokes into Rigged 3D Model via Latent Diffusion Models, which generates controllable rigged assets using latent diffusion. While their task settings differ, discussing these connections would clarify AniRig’s contributions relative to prior work.
Questions for authors
As weakness.
3 comments
W3. Related work
Thank you for recommending these two related works. We have added both to Related Work. Auto-Connect's connectivity-preserving skeleton generation and geodesic-aware top- bone selection relate to our skeleton prediction and sparse influence selection, respectively. Stroke3D uses latent diffusion to generate rigged assets from 2D strokes and text. This shares AniRig's goal of producing animation-ready assets, with Stroke3D addressing asset generation and AniRig addressing pose-to-rest recovery from an observed mesh.
Revised manuscript: Auto-Connect in Section 2.2, p. 3, L140-141; Stroke3D in Section 2.3, p. 3, L159-161.
Thanks for your response, I will keep my score.
Response to Reviewer GoiW
Thank you for suggesting more challenging examples and a closer analysis of semantic conditioning.
W1. Hierarchy reliability and semantic conditioning
Dense skeleton with multiple branches. To assess hierarchy inference for a dense, branched character, we add a scorpion example and compare the inferred hierarchy with the original asset's skeleton. Most inferred topology agrees with this reference and needs only small local additions, supporting reliable inference of the main skeletal structure. The original output has 59 joints; we manually add only two missing mouthpart joints and their connections, retaining all others. The augmented hierarchy and reference each contain 61 joints with matching topology. Figure 10 shows the six-view inputs, augmented hierarchy, reference skeleton, and resulting rig (Appendix D.3, Figure 10, p. 31, L1620-1623 and L1648-1653).
Severe self-intersection. To examine recovery under severe interpenetration, we construct a humanoid pose from a standard T-pose, with both arms passing through the torso to opposite sides and the legs crossed. Its unedited VLM hierarchy matches the connectivity of the original asset's reference skeleton, supporting the reliability of VLM hierarchy inference for this severely intersecting input. AniRig places the arm chains near the waist, indicating a joint-localization failure. Comparable poses are absent from training. The output remains a connected humanoid skeleton (Figure 11, p. 33, L1759-1762; discussion in Appendix E, pp. 32-33, L1726-1731).
Fine-grained joint names. For fine-grained names such as
tail_01andtail_02, we observe in practice that frozen CLIP produces distinguishable joint-name embeddings. These joint-name embeddings, together with token-index and parent-index positional encodings, jointly condition the model, enabling it to distinguish corresponding joints within a skeletal chain. The humanoid cat in Figure 5's fifth row and the scorpion in Figure 10 show recovered tail chains using such names (Figure 5, p. 15; Figure 10, p. 31; Appendix B.1, p. 16, L822-825).Cross-category skeletal topology. We train on character-specific hierarchies with shared model parameters; at test time, no category- or topology-specific fine-tuning is required. The cross-category asset recovery and animation results in Figure 5, together with the dense, branched scorpion in Figure 10, illustrate the same model's ability to adapt to different bone chains and branching structures (Figure 5, p. 15; Figure 10, p. 31; Appendix C.2, p. 24, L1260-1262).
Cross-category name substitution. To isolate naming, we exchange humanoid and quadruped names in both directions, e.g.,
hand_leftandfront_hoof_left, while fixing the mesh, joint order, parent-child connections, and inference sampling. After the exchange, the main bone chains retain their overall spatial layout and remain consistent with each character's geometry. These examples illustrate AniRig's generalization across skeletal naming conventions (Appendix C.7, p. 27, L1418-1422; Figure 8, p. 27).W2. Downstream re-posing comparison
We compare AniRig with Make-It-Animatable (MIA) on the 40 humanoids from our real-motion benchmark. AniRig uses VLM-inferred hierarchies; MIA uses its pipeline's hierarchies. In Figure 7, both methods recover assets from the same posed mesh, then receive the same target motion through retargeting, with GT shown for comparison. All assets shown in this comparison were obtained without manual correction.
Case (a): limb deformation. MIA produces flattened, stretched arms and twisting, compression, and folding around the hips and legs, which persist after re-posing. AniRig recovers extended arms and separated legs and maintains more intact arm, torso, and leg contours under the target motion.
Case (b): head deformation. MIA's recovered head contour is skewed, and this deformation persists after re-posing. AniRig better preserves the head shape in both stages, with results closer to GT.
These differences persist under the same target motion, showing that AniRig's recovery improvements translate into cleaner downstream deformations without manual asset correction.
Rest-recovery results on the same 40 humanoids (Table 6) show lower CD and higher F-Score for AniRig:
Table 5 and Figure 5 provide further evidence of animation use: Table 5 reports held-out re-posing under the benchmark hierarchy, and Figure 5 shows assets recovered with unedited VLM hierarchies driven by compatible animations.
Revised manuscript: Appendix C.3, Table 6, p. 24, L1278-1294; Figure 7, p. 25, L1341-1345; Table 5, p. 9, L461-471; Figure 5, p. 15.