- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper aims to address the trade-offs between blemish removal, texture preservation, and identity consistency in facial retouching. It combines saliency-aware patch sampling, a multi-expert LoRA and reward-weighted flow-matching. Experiments on FaceKeeper-Bench and a CelebA-HQ show visually strong results.
Critical strengths
- In section 3.2, It is very interesting that merging experts is not element-wise but row-wise by using SLERP. The explanation is also interesting that the direciton of a scalar can only be positive or negative while the direction of a vector is much more geometrically informative.
- The visual results are good.
Critical weaknesses
- Writing is a bit awful. Relatively simple operations are often described using unusual or insufficiently justified terminology. For example, in line 216, it says "we no longer process the entire graph" but it actually means "we no longer process the entire image". Why use "graph" at all when the whole paper is talking about image? In line 214, it says "random or fixed windows" but it actually means "random or fixed crops during training.". The term "Gaussian semantic kernel" actually measures Gaussian similarity in a learned positional embedding space. Why it is semantic at all? It is OK to use fancy words, but it is not OK to allow the terminology to obscure rather than clarify the underlying method.
- Related to above, although the description is lengthy, several basic details are missing. For example, in section 3.1, how large is the patch? Is the training only on patch? How to balance patch loss and whole image loss? Where is the saliency computed, source or GT? If there is no enough space, then don't waste the space on the fancy words and complex description.
- The ablation test is insufficient. For the example in section 3.1 again, the proposed method essentially combines a local high-gradient saliency score with a mechanism that encourages spatially diverse coverage. Why not just use NMS on high-gradient patches and take top-K or sample K from top-N? In section 3.2, why use global threshold rather than per-expert threshold? What's the insight of it? If the number of experts is large, won't it cut some experts entirely? Is there any trade-off? I know it is mentioned in limitation, but there is no analysis at all. In section 3.2, matrix A is described as "A carries general-purpose directions independent of intent”, but A is actually randomly-initialized and frozon during training. Why it carries general-purpose directions independent of intent? Is it just another fancy sentence or it really means much more than "A provides a shared low-dimensional basis"?
- Some claims are not supported by method theory or experiments. For example, in section 3.2, it says "Following sparsification, the intersection of the support sets of different experts in parameter space is minimized". Even if each expert is sparse, there is no way to discourage them from overlap at random entries. For example, if all experts are [1, 0, 0, 0], their sparsity is 75% but their overlapping is still 100%.
- Some important formulas are missing. In section 3.4, there are 6 different losses, but only one of them is defined. They should be at least defined in Appendix.
- The description of data is not sufficient. For example, in FaceKeeper-Bench, where does the GT come from (since it reports PSNR and LPIPS)? What makes me more confused is CelebA-HQ, what is the reference? If the blemish is synthesized, there should be construction pipeline in the paper.
- There are many baselines in the table, but I am not sure if they are fine-tuned on the same data? I guess not since it contains GPT Image and Nano Banana. Then it is unclear whether the performance comes from model design or data. Especially when we look at the ablation table, it seems that LoRA itself gives the majority of the improvement.
- User study, 5 evaluators labelling 100 images, seems too small-scale.
Questions for authors
See weakness 2-7.