- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
FaceGID is a diffusion-based method for facial expression retargeting. Specifically, given facial geometry associated with a particular identity and a reference image depicting a target expression, FaceGID first converts the facial geometry into 2D images that encode geometric information, allowing it to leverage a 2D diffusion model to reconstruct 3D geometry. It then fine-tunes a LoRA adapter based on FLUX.2 to perform expression retargeting. The trained LoRA generates geometry images with the retargeted expression, which are subsequently converted back into 3D geometry. In addition, the authors propose a training-free method to further refine the expression retargeting results during inference.
Critical strengths
- The paper is well written and enables readers to quickly understand the core ideas.
- The overall framework is reasonably designed, and reformulating facial expression retargeting as a 2D conditional generation task is insightful.
Critical weaknesses
- The robustness of the method appears limited. Converting facial geometry into 2D geometry images allows FaceGID to leverage the powerful priors of 2D diffusion models, but it may also compromise the robustness of geometric reconstruction. Since 2D diffusion models generally have limited control over fine-grained details, small errors may not pose significant problems for ordinary images. However, for geometry images, even minor inaccuracies can lead to spatial misalignment of mesh vertices. Such errors may originate from multiple sources, including denoising errors in the diffusion model and reconstruction errors introduced by the VAE.
- The method cannot fully replace existing mature solutions. The authors demonstrate that FaceGID can produce more realistic expressions than expression-basis replacement methods based on 3D Morphable Models (3DMMs). However, traditional methods retain significant advantages in terms of efficiency and support for diverse input styles, making them difficult to replace in practice. This limits the practical impact of FaceGID's contributions.
- Overall, I consider FaceGID a reasonably designed method supported by a relatively comprehensive set of experiments. My main concern is that it addresses a relatively narrow and long-standing problem for which mature solutions already exist. Furthermore, the proposed approach primarily involves transferring and combining existing techniques from closely related areas, while still being unable to fully replace established solutions. I am therefore uncertain whether its contributions meet the acceptance threshold of a top-tier conference. At this stage, I lean toward rejection, although my final decision will also depend on the other reviewers' assessments and the authors' rebuttal.
Questions for authors
My primary concerns are not about the technical details of the method, which I believe are explained reasonably clearly in the paper. Instead, I would like the authors to elaborate on the robustness of the proposed approach and its practical use cases. Based on the current presentation, I find it difficult to see how FaceGID could replace expression-basis replacement techniques in practical applications such as video games and VR, where predefined expression templates can enable facial expression retargeting that is both fast and reliable.