- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper addresses the problem of costly neural inference during real-time animation of 3D Gaussian avatars. The method aims to fill the gap between 3D morphable models, per-person blendshapes, fixed-rig avatars, and animatable avatar models by combining photorealism, identity-shared representations, and linear blendshape-based animation at runtime. The method extracts an identity-shared blendshape basis from pretrained avatar models using block-local, rendering-aware PCA with memory-budgeted component allocation. A lightweight coefficient predictor MLP replaces the costly neural decoder during animation. The method is evaluated on three different avatar architectures (AGORA, FlexAvatar, DynaAvatar) and achieves significant improvements in CPU animation speed while largely preserving rendering quality.
Critical strengths
- [Clear motivation] The paper addresses a valid and practically relevant problem. The idea of extracting an identity-shared linear blendshape representation from pretrained nonlinear avatar models is well motivated.
- Components are well thought shown their impact clearly in Table 3 and 4.
- [Practical Method] The method does not require retraining the original host models and enables real-time animation on mobile devices. The demo shows the approach is useful in practice.
Critical weaknesses
- [Limited novelty] Previous works such as GEM (Zielonka et al., 2025) and SqueezeMe (Iandola et al., 2025), and RGBAvatar have already explored distilling neural Gaussian avatars into efficient linear representations. Although the method introduces an identity-shared basis, the paper does not directly demonstrate its advantages over subject-specific distillation approaches. A controlled comparison in terms of reconstruction quality, memory usage and computational cost would help establish the contribution of the method.
Questions for authors
Could the authors provide a comparison between the identity-shared basis and a subject-specific PCA distillation baseline, similar to GEM, using the same host model? In particular, what is the trade-off between reconstruction quality, speed, and total memory requirements?
2 comments
My points are addressed. I'll keep my positive rating.
Dear Authors, thank you for your detailed answers!
W1. Thanks for the clarification, and sorry that I missed the figure in Appendix H. Q1. Thanks for the detailed follow-up comparison.
I'll keep my positive rating
Author Response to Reviewer TocY
Thank you for the positive review. The new results are included in the revised paper, where all changes are marked in blue.
W1. Novelty and comparison with subject-specific methods. We would like to respectfully clarify how GALA differs from GEM, SqueezeMe and RGBAvatar. These methods build a basis for one person from a multi-view or monocular capture of this person. In contrast, GALA takes a pretrained avatar network of many identities and distills the network itself into a single basis. This basis is shared by all identities of the network, including unseen people. To the best of our knowledge, such a distillation has not been attempted before.
Thank you for the suggestion to directly demonstrate the advantages over subject-specific methods. We agree that such a comparison is important. The original submission already compares GALA with GEM and RGBAvatar in App. H (Tab. 9 and 10). In cross-reenactment, FlexAvatar + GALA achieves lower expression and pose errors than all per-subject methods on INSTA, Ava256 and VFHQ, although FlexAvatar + GALA uses only a single photo of the subject. Since these methods use their own training pipelines, we have now added a controlled comparison in which both approaches use the same host model (Q1).
Q1. Shared vs. subject-specific basis with the same host model. Table R1 shows that, for unseen motion, the PSNR of our shared model is within 1 dB of the PSNR of the per-subject models, even though the test subjects are not used for the construction of the shared basis. For each test subject, we construct a per-subject basis and train a per-subject coefficient network using 512 outputs of the host model for this subject. We use the same host model, pipeline and memory budget as for the shared model, and we sample the animation parameters from the training data of the host model. For the head models, the per-subject models have a large advantage on their own training samples. Most of this advantage does not transfer to unseen motion, which indicates that the per-subject models overfit to their training samples. In cross-reenactment, which is the most realistic scenario, the shared and the per-subject models perform on par. The per-subject models are better for AGORA and the shared model is better for FlexAvatar, in both cases by about 0.6 dB. For DynaAvatar, we animate the test subjects with four motion sequences of other held-out subjects, and the difference between the shared and the per-subject models is only 0.01 dB. Given the same memory budget, the shared and the per-subject models also run at about the same speed. In contrast, the costs of the two approaches differ significantly. The storage of the shared basis is constant, whereas the storage of per-subject bases grows linearly with the number of identities and is 100 times larger for 100 identities (Table R1). Initializing a new identity takes seconds of GPU time with the shared model and minutes with a per-subject model. The reason is that the shared model requires a single inference of the host model, whereas per-subject models require many inferences and a PCA decomposition. The one-time construction of the shared model pays off after 30–50 identities. This comparison is now included in App. K of the revised paper.
Table R1. PSNR with respect to the host model, using predicted coefficients. In-train: training samples of each model, which belong to other identities for the shared model. Held-out: unseen motion of 10, 10 and 2 test subjects for AGORA, FlexAvatar and DynaAvatar. Cross-reenactment: motion of other people. The shared model is constructed once, which takes 80 min, 66 min and 16 h for the three host models. Bold: lower cost, and PSNR that is better by more than 0.1 dB.