- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper presents Ratio‑RFE, a novel image harmonization framework reformulating the task as source‑relative log‑ratio relighting‑field estimation. Phong‑inspired Ambient‑Diffuse‑Specular (ADS) pathways separately model global low‑frequency shifts, spatially‑varying shading, and local high‑frequency specular highlights. An ADS‑MK dynamic aggregation module fuses these complementary representations to produce a unified relighting field. Experiments achieve state‑of‑the‑art quantitative and qualitative results on iHarmony4. Without fine‑tuning, Ratio‑RFE generalizes well to the out‑of‑distribution ccHarmony dataset. Comprehensive ablations validate the log‑ratio formulation, ADS multi‑path design, dynamic aggregation, and ratio‑domain supervision.
Critical strengths
-
Novel physically‑motivated log‑ratio relighting‑field formulation for image harmonization. Most existing harmonization approaches either directly predict final RGB outputs or perform explicit intrinsic decomposition into reflectance and illumination. This work avoids the ill‑posed full intrinsic decomposition while still embedding image‑formation physics into network design.
-
Impressive practical generalization performance across dataset domain and resolution. The model trained purely on iHarmony4 obtains SOTA results on ccHarmony. Moreover, it generalizes to high-resolution inference without retraining, while other methods degrade substantially on higher resolutions.
Critical weaknesses
-
Phong‑inspired ADS pathways are learned feature representations rather than physically‑grounded decomposition. Although the architecture is motivated by Phong ADS lighting model, the three branches do not perform true physical decomposition of ambient/diffuse/specular components. There is no ground‑truth supervision for individual ADS terms, and the paper provides limited evidence that each pathway strictly corresponds to its intended physical lighting component.
-
Limited analysis of failure cases and real‑world challenging cases. Experimental evaluation mainly uses standard benchmark datasets iHarmony4 and ccHarmony. The paper lacks systematic study of tough real-world scenarios: e.g., foreground shadow cast by new background, highly‑transparent foreground objects, or large‑scale color gamut mismatch. It is unclear how well the physical assumption holds under these real‑world conditions, which might be the practical limits of the proposed approach.
Questions for authors
- Could you provide further analysis or experiments to verify to what extent each pathway actually captures its target lighting phenomenon, rather than just learning complementary generic image features?
- Why does the log‑ratio prediction formulation bring substantial cross‑resolution generalization benefit compared with direct RGB regression? Can you provide an intuitive or mathematical explanation for this observation?
- In transformation‑aligned training, you apply auxiliary L1 loss on the clipped ground‑truth log‑ratio field . Does clipping to discard useful supervision for large lighting corrections?