- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies single-image 3D reconstruction of eyeglass-wearing heads, with particular emphasis on recovering lateral eyeglass structures such as temples and ear-side attachments. The core idea is to use a video generation model to synthesize view-diverse observations from frontal portraits, recover approximate camera parameters for these generated frames, and use them as pseudo-multiview supervision.
Critical strengths
- The strongest contribution is the data-supervision paradigm. Instead of requiring calibrated real multiview capture, the paper converts frontal portraits into approximately multiview observations using video generation and then estimates corresponding camera trajectories.
- On the held-out EPPM evaluation, GlassHead improves substantially over the reported baselines. For example, Table 1 reports PSNR 16.00 versus 12.90 for the strongest baseline on that metric, LPIPS 0.230 versus 0.347, and DreamSim 0.061 versus 0.120, while also improving both eyeglass-specific metrics. The method reconstructs a Gaussian head in a single forward pass in under one second and uses 4.75 GB GPU memory at inference.
Critical weaknesses
- The most important concern is that the main quantitative evaluation is performed on EPPM-20K itself. The training and evaluation identities are disjoint, but the target views are nevertheless produced using essentially the same portrait/video-generation pipeline that defines the training distribution. Therefore, the results convincingly demonstrate that GlassHead models the EPPM pseudo-multiview distribution better than the evaluated baselines, but they do not yet establish equally strongly that the recovered lateral structures are geometrically correct for real photographs.
- The paper states that GlassHead is trained on the newly constructed EPPM dataset, whereas the competing methods are evaluated using their released implementations. Based on the current manuscript, I do not find evidence that the strongest baselines were retrained. This is a substantial confound because the paper's central premise is precisely that existing methods suffer from insufficient multiview eyeglass supervision. If GlassHead is given a large targeted training set while competing models retain their original training distributions, the very large improvements in Table 1 cannot be attributed cleanly to the proposed reconstruction architecture or supervision strategy.
- The most novel conceptual claim is that imperfect video-generated views provide effective supervision for learning complete 3D eyeglass structure. However, the ablations currently focus on the GAN loss, hierarchical decoder, hierarchy depth, image encoder, and initialization strategy. I do not find a controlled experiment that holds the GlassHead architecture fixed while removing the generated non-frontal supervision.
Questions for authors
- Can the authors provide quantitative evaluation on genuinely captured multiview data, for example using calibrated NeRSemble views, rather than only qualitative real-world examples?
- Can the authors report a controlled ablation in which the same GlassHead architecture is trained without pseudo-multiview supervision, e.g. using only the frontal reconstruction objective?
Thank you for the thoughtful review. We appreciate your constructive feedback and have substantially revised the manuscript with additional experiments addressing your concerns point by point.
Critical Weaknesses
We agree that evaluation on EPPM-Test alone cannot establish generalization to real-world data. We therefore introduce quantitative comparisons on two real captured datasets (Table 1 and Figure 4):
On FaceScan, which was not used for training or fine-tuning, GlassHead achieves the best results on five of seven metrics. Although UIKA and FlexAvatar outperform GlassHead on several NeRSemble metrics, both methods have used NeRSemble data during training, whereas GlassHead is trained only on EPPM-20K.
We also expand our in-the-wild evaluations (Figure 5 and Appendix F, Figure 14) with portraits captured under diverse lighting, backgrounds, and head poses. These results provide further evidence of generalization beyond our synthetic training distribution.
We agree that evaluating only released pretrained baselines on EPPM-Test may introduce a training-domain mismatch. To address this concern, we additionally fine-tune UIKA and GAGAvatar on EPPM-20K, retaining their original architectures and training objectives. Both methods are fine-tuned for 100,000 iterations on two NVIDIA A800 80GB GPUs. The updated results are reported in Table 1, with implementation details in Appendix E. Both baselines improve substantially on EPPM-Test after fine-tuning. We do not fine-tune FlexAvatar because its training code is not publicly available.
We have added the requested controlled ablation in Table 2 and Figure 6. Specifically, we train a variant using only frontal reconstruction losses, removing the multiview perceptual and adversarial losses while keeping the GlassHead architecture and training settings unchanged. Without pseudo-multiview supervision, the model produces flattened, billboard-like reconstructions with severe distortions under novel viewpoints. Quantitatively, PSNR decreases from 16.00 to 9.70, while LPIPS increases from 0.230 to 0.498. These results demonstrate that pseudo-multiview supervision is essential for recovering plausible 3D head geometry and lateral eyeglass structures, rather than relying solely on the hierarchical reconstruction architecture.
Questions for Authors
Q1. Quantitative evaluation on captured multiview data.
We now provide quantitative comparisons on NeRSemble and FaceScan (Table 1), using synchronized real camera views rather than generated pseudo-ground-truth images. For NeRSemble, we select 40 eyeglass-wearing identities and evaluate against 600 real target views. We also report additional results on eyeglass-free subjects in Appendix G (Table 4). The evaluation protocol, subject selection, and camera alignment details are provided in Appendix C. For FaceScan, we collect 190 eyeglass-wearing cases and 1,520 multiview images using a synchronized 30-camera capture system.
We further include magnified eyeglass comparisons (Figure 4 and Appendix F, Figures 13–14) to highlight the preservation of temples, hinges, and ear-side attachments.
Q2. Controlled ablation without pseudo-multiview supervision.
We have added precisely this experiment in Table 2 and Figure 6. We retain the same GlassHead architecture but train it using only the frontal reconstruction objective. The frontal-only model produces flattened, billboard-like reconstructions and suffers substantial degradation in novel-view quality. In contrast, the full model recovers more complete and visually coherent head and eyeglass structures. This experiment directly supports our central claim that imperfect H3-generated pseudo-multiview observations provide valuable supervision for learning 3D structures that cannot be reliably inferred from frontal reconstruction losses alone.