- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper introduces a self-supervised framework for portrait image relighting that separately models lighting and appearance. The experiments show that it outperforms the methods included in the comparison. Furthermore, the framework performs well on out-of-domain portraits.
Critical strengths
- The self-supervised framework does not require paired training data, making it flexible enough to accommodate different data sources.
- The proposed appearance adapter and geometry-aware light modulator separately model appearance and lighting, achieving good identity consistency and lighting control.
Critical weaknesses
- The comparison with previous relighting methods is not convincing to me. In the qualitative comparison, only DiFaReli is specifically designed for 2D portrait relighting. It would be better to include more 2D portrait relighting methods, such as Total Relighting [1], Lux Post Facto [2], and POLAR [3].
- The relit portraits appear slightly over-smoothed, which makes me question whether the trade-off between avoiding supervised data and visual quality is worthwhile in this self-supervised framework.
I would like to read the other reviewers' comments and the authors' rebuttal. I may raise my score if the authors can address some of my concerns.
[1] Pandey et al., Total Relighting: Learning to Relight Portraits for Background Replacement. SIGGRAPH 2021.
[2] Mei et al., Lux Post Facto: Learning Portrait Performance Relighting with Conditional Video Diffusion and a Hybrid Dataset. CVPR 2025.
[3] Chen et al., POLAR: A Portrait OLAT Dataset and Generative Framework for Illumination-Aware Face Modeling. CVPR 2026.
Questions for authors
- Why is DiffusionLight needed to estimate the target HDR map for DiffusionRenderer? I believe the target spherical-harmonic illumination could be directly converted into an HDR map. In addition, DiffusionRenderer results are missing from the qualitative comparison.
5 comments
Dear Reviewer,
I hope this message finds you well. As the discussion period is nearing its end, I wanted to ensure we have addressed all your concerns satisfactorily. If there are any additional points or feedback you'd like us to consider, please let us know. Your insights are invaluable to us, and we’re eager to address any remaining issues to improve our work.
Thank you for your time and effort in reviewing our paper!
Dear Reviewer nADV,
With only about five hours remaining before the discussion period closes, we sincerely hope you could spare a moment to revisit our responses.
We have worked hard to address your concerns through additional experiments, quantitative analyses, and manuscript revisions. We truly hope that our efforts and additional results have adequately addressed your concerns.
We would greatly appreciate your further consideration and look forward to hearing from you before the discussion closes.
Thank you again for your time and consideration.
Best regards,
The Authors
Author Response
We thank the reviewer for the thoughtful and constructive feedback. We address the concerns and questions below.
W1. Comparison with additional 2D portrait relighting methods.
We thank the reviewer for this suggestion. Note, as the three suggested methods (Total Relighting [1], Lux Post Facto [2], POLAR [3]) are neither open-sourced, nor provide quantitative results on public datasets, so a controlled comparison with them is not feasible. We therefore compare with three other 2D portrait relighting methods, DreamLight [4], DPR [5], and GeomConsistentFR [6]. As shown in the table below, our method outperforms all the three methods on every metric and on all three benchmarks. We in Fig. 22 further show that our method can produce superior portrait relighting results than these methods.
[1] Pandey et al., Total Relighting: Learning to Relight Portraits for Background Replacement. SIGGRAPH 2021.
[2] Mei et al., Lux Post Facto: Learning Portrait Performance Relighting with Conditional Video Diffusion and a Hybrid Dataset. CVPR 2025.
[3] Chen et al., POLAR: A Portrait OLAT Dataset and Generative Framework for Illumination-Aware Face Modeling. CVPR 2026.
[4] Liu et al., DreamLight: Towards Harmonious and Consistent Image Relighting. NeurIPS 2025.
[5] Zhou et al., Deep Single-Image Portrait Relighting. ICCV 2019.
[6] Hou et al., Face Relighting with Geometrically Consistent Shadows. CVPR 2022.
W2. Slightly over-smoothed visual results.
We thank the reviewer for this careful observation. We found that this issue is led by the DDIM inversion error, rather than our self-supervised framework. Note, as shown in the Fig. 25, replacing DDIM with reversible sampler BELM [7] can help remove the over-smooth issue. We have updated the visual results in paper accordingly.
[7] Wang et al., BELM: Bidirectional Explicit Linear Multi-step Sampler for Exact Inversion in Diffusion Models. NeurIPS 2024.
Q1. Compare with DiffusionRenderer using HDR maps converted from spherical-harmonic lighting.
We have followed the suggestion to conduct the comparison. As shown in the table below, the performance of DiffusionRenderer degrades substantially under this condition, indicating that a direct SH-to-HDR conversion alone is not suitable for DiffusionRenderer. Additionally, Fig. 22 provides the visual comparison for DiffusionRenderer (DR).