- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper introduces AvatarDynamizer, a method for transforming off-the-shelf static human avatars into controllable dynamic avatars. Given a static identity texture and a sequence of pose-conditioned normal maps, a video diffusion model generates dynamic textures, which are then decoded into 3D Gaussians for multi-view-consistent rendering. The authors also collect DynaHuman, a multi-view human dataset with diverse identities and motions, to support learning pose-dependent surface dynamics. Experiments across four datasets demonstrate improved generative quality over the evaluated dynamic baselines.
Critical strengths
-
The motivation of this paper is clear and well justified. The proposed method enhances static avatars with pose-dependent surface details by combining dynamic texture generation in texture space with neural decoding into 3D Gaussians. This is a sensible design that leverages video generative priors while preserving multi-view consistency.
-
I appreciate the substantial effort involved in constructing DynaHuman, including dense multi-view capture, non-rigid registration, and dynamic texture preparation. Its combination of diverse identities and rich motion sequences provides valuable data for learning avatar surface dynamics.
Critical weaknesses
-
The paper does not report the rendering FPS or the per-frame computational cost at inference time, making it difficult to assess its practical rendering efficiency.
-
Although the authors acknowledge limitations with loose garments and complex clothing deformations, the paper does not show corresponding failure cases of the proposed method. Such examples would help clarify its practical limitations and the range of clothing it can handle reliably.
Questions for authors
-
What motivates the texture layout used in this work rather than the standard SMPL-X UV layout? An ablation comparing the two layouts would help clarify the benefits of this design.
-
Have the authors considered adapting the fine-tuned video model using methods such as Self Forcing or Causal Forcing? Would these offer advantages over the current approach in generation efficiency or long-sequence temporal consistency?
3 comments
Response to Reviewer FQ69
Q2 — Post-training acceleration and long-sequence consistency
Self Forcing and Causal Forcing. We see both methods as promising extensions to DTG. Our current model generates dynamic textures in bidirectional windows. An autoregressive adaptation could generate successive texture chunks conditioned on the static identity, driving poses, and previously generated textures. Their few-step formulation could improve efficiency and enable streaming, while training with generated histories would explicitly target consistency across successive texture chunks. The potential gains should be assessed jointly with fine-detail fidelity and motion control.
Four-step distillation. As a related post-training study, we implemented and evaluated a four-step LoRA-distilled DTG, preserving our identity and pose conditioning within the existing bidirectional window-based generation scheme. This experiment evaluates sampling-step reduction; it does not evaluate the autoregressive adaptations of Self Forcing or Causal Forcing. In the inspected sequences, qualitative comparisons with the original DTG reveal reduced fine-scale wrinkle detail and poorer temporal continuity across generation windows. We therefore retain the 50-step configuration for our main results and report the four-step variant as an exploratory acceleration study.
EC — Participant consent and permitted identity use
Participants provided voluntary written informed consent after receiving information about the research goals, intended uses, and data-security procedures. The agreement permits non-commercial algorithm research and publication of captured data and derived results for scientific dissemination and reproducibility. Other uses require additional explicit consent. Participants may revoke consent at any time, and their contact information is not made public. We will clarify these procedures and permitted uses in the revised ethics discussion.
Thanks for your detailed responses! The explanation of layout is intuitive, and results address my concerns. It maybe better to update the LoRA-distilled results on the final version.
Response to Reviewer FQ69
We thank the reviewer for noting that our motivation is clear and well-justified, highlighting our design is sensible that uses video generative priors while preserving multi-view consistency, and acknowledging the value of our DynaHuman dataset. We provide additional efficiency and texture-layout evaluations, concrete failure cases, an exploratory acceleration study, and clarifications on participant consent and permitted identity use. We also provide figure of failure cases in the new main submission on page 10.
W1 — Rendering efficiency and per-frame cost
We report per-frame Gaussian decoding/rendering time and the estimated cost including DTG. We additionally evaluate a subject-specific avatar distilled from LHM+AD, which predicts the animated avatar directly from motion without video diffusion.
Inference cost on H100 NVL and RTX 3090.
Measurements use a single GPU, bf16 model inference, 29,159 Gaussians, and one 800×600 view per frame. Decoding/rendering assumes pre-generated textures and includes normal-map creation and network inference. DTG-inclusive costs sum separately measured stages, with texture-generation time amortized over 44 new frames per window.
Texture generation dominates the animation cost. The distilled motion-driven avatar was trained on 6,000 poses from S76. The following table compares its quality with LHM+AD.
Quality comparison on S76:
Distillation slightly improves PSNR and SSIM but increases LPIPS and FVD, indicating a trade-off between inference speed and perceptual quality.
W2 — Failure case visualization
Fig. 7 illustrates three limitations discussed in Appendix J. Loose clothing: the dress splits around the legs and takes on a trouser-like shape during animation, most visibly in the tug-of-war poses. Severe self-occlusion: the squatting motion produces local texture artifacts around the waist and legs, which become less visible in later frames. Garment removal: the avatar follows the driving motion but keeps its original clothing, failing to reproduce the removal shown in the motion reference.
Q1 — Texture layout
Our layout is designed to allocate texels more uniformly over the body. Because each valid texel anchors a Gaussian, this allocation determines the initial surface-sampling density. Following ASH (Pang et al., 2024), the torso and limbs share a connected UV chart. A dedicated square head region supports separate head and body branches, as in EVA (Junkawitsch et al., 2025).
We evaluate texel allocation and UV distortion on the same reference mesh, using surface-area-weighted statistics over the common body region:
CV denotes standard deviation divided by the mean.
These results show more uniform texel allocation and lower local distortion. Decoded body Gaussians also exhibit lower CVs in their largest principal scales (0.369 vs. 0.439) and canonical-space sixth-neighbor distances (0.229 vs. 0.341), averaged over 100 frames per subject on S71/S76 with equal subject weighting.
We also compare layout-specific RDT reconstruction pipelines at 256×256, using a GGD trained for each layout. Results are averaged equally across S71 and S76.
Each pipeline uses its own texture preparation and rendering postprocessing.
The layout-specific reconstruction results favor our UV layout on all three mean metrics, complementing the direct evidence of more uniform texel allocation and lower distortion.