- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes a synthetic face generation paradigm, FaceFlow. It promotes generation diversity by introducing learnable intra-class variation in the identity embedding space. The method replaces the direction-agnostic perturbation used in IDPerturb with an identity-conditioned direction learned via Riemannian flow matching. Experiments show improved identity consistency and downstream face recognition performance over random perturbation.
Critical strengths
- The paper identifies a reasonable limitation in synthetic face generation, regarding random angular perturbation. The analysis in Fig. 1 provides useful evidence of anisotropic real intra-class variation and reasonably motivates learning the perturbation direction.
- The proposed method is conceptually simple and can be applied without retraining the face generator.
Critical weaknesses
- This paper exhibits relatively limited novelty over prior identity-perturbation SOTAs. Angular embedding perturbation has been well established as an effective way to enrich generation diversity (e.g., in IDPerturb, SteerFace, and NegFaceDiff). SteerFace further introduced learnable perturbation magnitude. Therefore, FaceFlow neither introduces embedding perturbation itself nor the paradigm of learnable perturbation; its main methodological contribution is limited to learning the direction instead of sampling it randomly.
- Current experiments do not sufficiently isolate where the improvement comes from. The main performance comparison in Tab. 1 is built on top of UIFace, which is itself a strong SOTA method, rather than a neutral baseline, making it difficult to separate the gains inherited from UIFace from those introduced by FaceFlow. It also lacks decisive evidence whether the paper’s key modeling choices (learned directional prior and being identity-specific) are necessary; further see questions.
Questions for authors
- FaceFlow is built on a pretrained UIFace generator, a strong SOTA that already performs the second best in Tab.1, rather than the neutral baseline commonly used in this line of work (which UIFace itself is based on), i.e., IDiff-Face. Therefore, its FR performance in Tab. 1 already benefits from the established strength of UIFace and does not clearly show how much improvement is brought by FaceFlow alone. The authors should supplement a parallel, controlled comparison between IDiff-Face and an IDiff-Face-based FaceFlow to isolate the contribution.
- FaceFlow neither newly introduces embedding perturbation itself nor the paradigm of learnable perturbation. The methodological distinction from recent identity-perturbation SOTA methods (IDPerturb, SteerFace, and NegFaceDiff) needs to be made much clearer.
- The authors miss several relevant SOTA methods (e.g., MorphFace, NegFaceDiff and SteerFace) for comparison. I find the omission of SteerFace particularly puzzling, as FaceFlow is not only methodologically related to SteerFace in both developing learnable embedding perturbation, but also resembles it in several specific aspects of the experimental presentation, e.g., the trade-off visualization and SDD-FIQA-based evaluation. It is therefore quite surprising that SteerFace is not discussed at all.
- While adaptive perturbation directions are plausible, it is unclear whether Riemannian flow matching is necessary to obtain them. Once real intra-class variation is known to be anisotropic, simpler data-driven models such as PCA-based sampling, or GMM-based sampling to account for the multimodal structure claimed by the authors, could already provide non-random, adaptive directions. The authors should consider comparing flow matching with such methods as baselines for anisotropic sampling.
- It is also unclear whether the learned directional prior needs to be identity-specific. The paper models , but Fig. 1 only shows that intra-class directions are structured and non-uniform; it does not show that this structure must vary with the reference identity. Could the authors compare against a shared learned prior such as ? This would directly test whether conditioning on is necessary.
2 comments
Dear Reviewer,
Thank you again for the careful review and for the questions. We have posted our responses, together with the additional experimental results.
Could you please let us know whether these responses and results address your concerns? If any point remains open, we would be very grateful if you could tell us which further experiment you would still find necessary. We will prioritize that within the discussion period.
Thank you again for your time.
Best regards, The Authors
For Question 1. To isolate FaceFlow’s contribution from the choice of generator, we conducted a controlled comparison using the IDiff-Face generator and the same 10,000 virtual identities used in our paper. IDPerturb achieves scores of 98.73, 91.73, 91.64, 92.65, and 88.07 on LFW, AgeDB-30, CFP-FP, CALFW, and CPLFW, respectively, with a mean of 92.56. Replacing its random perturbation directions with directions produced by the FaceFlow flow increases the scores to 98.97, 92.78, 93.64, 92.95, and 89.00, respectively, with a mean of 93.47. Thus, FaceFlow improves the mean by 0.91 percentage points even with the IDiff-Face generator, indicating that its gains are not attributable solely to UIFace.
For Question 2. FaceFlow’s contribution is to learn the identity-conditioned distribution of intra-class directions through flow matching on real same-identity pairs. IDPerturb samples random directions within a spherical cap around the reference identity. SteerFace uses random orthogonal perturbations as a training regularizer to suppress intra-class semantics in the learned identity representation, then removes the perturbation at inference. In contrast, FaceFlow keeps the generator frozen and uses the endpoint of a flow trained on real same-identity pairs as the perturbation direction. NegFaceDiff takes a different approach by modifying the diffusion sampling process with negative identity guidance to push generated samples away from other identities. Thus, the methods target different aspects of generation: SteerFace suppresses intra-class semantics during training, NegFaceDiff promotes separation from other identities, and FaceFlow models intra-class variation in the identity embedding space.
For Question 3. MorphFace and SteerFace are valuable works. We did not include MorphFace in our experimental comparison because we could not find publicly available code during our experimental period. SteerFace emerged as concurrent work during our experiments and was therefore not included in the original evaluation. NegFaceDiff is also relevant, as it introduces negative identity guidance during diffusion sampling to promote inter-class separation, whereas FaceFlow learns intra-class directions in the identity embedding space.
We recognize the similarity between SteerFace and our use of SDD-FIQA and trade-off visualizations. During our experiments, we found that the conventional intra-class diversity metric Dintra can increase when face generation quality is poor, potentially overstating useful diversity. We therefore use SDD-FIQA as a complementary and more intuitive way to assess the quality of FaceFlow-generated faces alongside their intra-class diversity.
For Question 4. To compare direction samplers, we evaluated them under the same lb=0.5, 10k × 50 downstream face-recognition protocol. FaceFlow achieves scores of 99.15, 93.68, 94.49, 93.40, and 89.32 on LFW, AgeDB-30, CFP-FP, CALFW, and CPLFW, respectively, with a mean of 94.01. The isotropic Gaussian sampler achieves 91.08, 83.12, 77.67, 83.97, and 68.62, with a mean of 80.89. The rank-16 PCA sampler achieves 94.37, 76.80, 57.71, 84.72, and 62.20, with a mean of 75.16. FaceFlow achieves the highest mean among the three methods.
For Question 5. To test whether the directional prior benefits from identity conditioning, we trained a shared flow $p(u \mid \theta)$ that does not take the reference embedding A as input. Using the same 10,000 identities and UIFace decoder, with 50 images generated per identity, this shared flow achieves scores of 98.85, 91.25, 83.26, 91.60, and 82.70 on LFW, AgeDB-30, CFP-FP, CALFW, and CPLFW, respectively, with a mean of 89.53. Compared with the identity-conditioned FaceFlow result of 94.01, the largest drops are on CFP-FP and CPLFW. This suggests that conditioning the flow on the reference identity is particularly beneficial for intra-class variation.
Thank you for the questions and constructive feedback. We hope these clarifications and planned revisions address the concerns and support an improved final assessment.