- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
In this work, the authors present HybridAvatar, an animatable human avatar that supports inference in both mesh mode and Gaussian mode. They achieve this through pose-dependent Gaussian avatar learning, per-pose mesh asset baking, and pose-space blending. Experiments show improved performance over direct mesh extraction from an animatable Gaussian avatar and over the static DeMapGS baseline.
Critical strengths
-
The problem setting is interesting: learning engine-ready assets with learning based Gaussian avatars.
-
The method supports multiple modes, including mesh, Gaussian and hybrid mode.
-
In mesh mode, the method outperforms the static Gaussian baseline (DeMapGS + LBS) and direct mesh export from an animatable Gaussian avatar.
Critical weaknesses
-
Although baking Gaussians into mesh assets for animatable avatars is interesting, the technical novelty is limited, as most components rely heavily on DeMapGS and Animatable Gaussians. In addition, the paper does not discuss or compare with closely related alternatives that learn a motion-dependent deformable template together with dynamic texture maps (e.g., Habermann et al., Real-time Deep Dynamic Characters, ACM TOG 2021 and Xiang et al., Modeling Clothing as a Separate Layer for an Animatable Human Avatar, ACM TOG 2021). It remains unclear what advantage baking from Gaussians offers over baking appearance directly onto a deformable template, for example by optimizing its texture maps against the multi-view images.
-
The pose-space blend is the main new component, but it is not sufficiently validated. It is unclear how much quality is lost by blending compared with directly extracting the maps at the test poses. Moreover, since the kNN-based blend cannot extrapolate beyond the appearance observed during training, which limits its applicability to out-of-distribution poses. It would be helpful to report the distribution of distances from the testing poses to the training poses, together with results on unseen motions.
-
The storage cost of the mesh mode is not reported. Novel poses require the full per-pose map database, whose size grows linearly with the number of training frames (three 1024×1024 maps per pose, likely several to tens of GB per subject), and each frame reads K = 16 map sets.
-
In the supplementary videos, the mesh mode loses fine clothing wrinkles in some demos (e.g., the shadow-casting scene), while coarser clothing deformation is preserved in the "Animatable Mesh Avatars" results. The authors should analyze the source of this detail loss and discuss in the limitations which scales of clothing deformation the mesh asset can reproduce.
Overall, I think this paper lacks the comparisons and evaluations needed to demonstrate its superiority over simpler baselines, and its discussion of limitations is incomplete regarding the pose distribution, fine wrinkles, and storage.
Questions for authors
-
What is the advantage of baking from Gaussians over learning a deformable template and directly optimizing its texture maps against the multi-view images?
-
What is the storage size of the per-pose map database per subject, and what are the total extraction and training times?
-
What causes the loss of fine wrinkles in some mesh-mode videos (e.g., the shadow-casting scene)?