- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper presents a framework for converting static 3D Gaussian Splatting assets into rigged, animation-aware representations. It adapts a pretrained rigging model to predict skeletons and skinning weights directly from Gaussian inputs, and introduces a rig-guided adaptation module that refines Gaussians in approximately rigid regions while regenerating those in non-rigid regions. The authors also construct a large-scale paired dataset of vanilla and animation-aware Gaussians to supervise the framework.
Critical strengths
The paper identifies a meaningful limitation of animating static 3DGS: accurate rigging alone does not ensure artifact-free deformation, because the spatial support and distribution of the original Gaussians may be unsuitable for articulation. Jointly addressing rigging and representation adaptation is well motivated.
The two-branch adaptation strategy provides a sensible balance between appearance preservation and geometric flexibility. Restricting updates in approximately rigid regions while allowing regeneration near articulated regions is an intuitive design.
The paired dataset and its construction pipeline constitute a useful contribution. The reported quantitative results and qualitative comparisons provide encouraging evidence that animation-aware Gaussian adaptation can reduce deformation artifacts.
Critical weaknesses
The practical applicability and visual evidence need further development. The paper motivates converting existing static Gaussian assets into animatable content, but the demonstrated applications remain relatively narrow. The authors should clarify where this representation offers a practical advantage over established mesh-based animation pipelines, including those used in embodied simulation, and how it could complement video-based world-model workflows. This does not require demonstrating superiority across all these settings, but it does require a clearer account of the intended use cases and their specific benefits. More diverse application demonstrations would strengthen the contribution. In particular, static figures are insufficient to establish animation quality: demo videos showing continuous motion, multiple viewpoints, large articulations, and failure cases are essential for assessing temporal consistency and deformation artifacts.
The robustness of Gaussian adaptation on real captured assets remains insufficiently established. The principal training and evaluation assets are constructed from rigged meshes, while the generated-asset examples provide limited evidence of robustness to reconstruction noise, incomplete coverage, and uncertain rigging in practical inputs. I would encourage an evaluation on a real multiview human dataset, such as ZJU-MoCap, or a comparable setting. One informative protocol would reconstruct a canonical Gaussian asset using the multiview observations at a single timestamp, apply rigging and Gaussian adaptation, and evaluate its animation against held-out motion frames using PSNR, SSIM, and LPIPS. The comparison should include the unadapted reconstruction under the same rig and appropriate reconstruction or animation baselines, with supervision differences clearly specified. Reporting results with both estimated and reference rigs would additionally distinguish adaptation robustness from upstream rigging errors. Such an experiment would directly test whether the proposed refinement and regeneration remain effective beyond the mesh-derived training distribution.
Questions for authors
please refer to weakness.
4 comments
Follow-up on our response
Dear Reviewer QEph,
Thank you again for your thoughtful review. As the discussion deadline approaches, we would appreciate knowing whether our response addressed your concerns or if any points still need clarification.
Best regards,
The Authors
Thanks to the authors for their comprehensive comments.
Most of my problems have been solved. Animation in Gaussian would be an important problem in VR/XR.
I would like to keep my initial score.
Official Comment by Authors
Thank you for taking the time to carefully review our rebuttal and provide your feedback. We are glad to hear that our responses have addressed your concerns. We appreciate your constructive comments and suggestions, which have helped us further improve the clarity and quality of our manuscript.
Response to Reviewer QEph
Our method is intended for static assets that are already represented as 3D Gaussians. This representation supports fast, photorealistic rendering and can be particularly useful for assets that may require additional material or hair modeling to render faithfully in a mesh-based pipeline, such as objects with glossy or furry surfaces. Recent methods, including DRiVE, G-Skin, RigGS, and GaussiAnimate, have explored rigging and animation with 3D Gaussians in different settings.
A mesh-based workflow for animating an existing Gaussian asset typically involves extracting a mesh, rigging it, and transferring the rig back to the Gaussians. Mesh extraction and rig transfer can both introduce errors. Our method predicts the skeleton and skinning weights directly from the input Gaussians, avoiding the need for either step. Gaussian adaptation further reduces artifacts that can arise when the Gaussian primitives deform under skeletal motion.
We have added a project page and included its link in both the abstract and original files in the supplementary material. The page features numerous video demonstrations and comparisons with existing methods, highlighting the advantages of our approach. Higher-resolution versions of the videos are available in the supplementary material and can be viewed locally without streaming delays.
Following the suggested experimental setup, we have added experiments on real-world human data (ZJU-Mocap and DDC) in Sec. 5 (lines 414-431). Starting from statically reconstructed 3D Gaussians, we predict a skeleton and estimate skinning weights for that skeleton. We then fit the rigged Gaussians to the dynamic sequences by optimizing the skeletal poses and evaluate our method by comparing the resulting renderings with the corresponding ground-truth video frames. Table 4 reports the quantitative results, and Fig. 6 shows the qualitative comparisons. The relatively small number of input views available for static Gaussian reconstruction (e.g., 23 camera views for ZJU-MoCap) can limit the quality of the initial reconstructions and, in turn, the quality of the rendered animations.
Table 4. Comparison of rendering quality on real-world datasets.