- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
FlowFaceSwap is a video face-swapping framework built on a frozen rectified-flow video generator. It optimizes source and target identity tokens at test time, then edits the target video using the difference between identity-conditioned velocity predictions. Semantic region weights and landmark-guided gates modulate the residual to preserve target expressions and motion. Experiments on FaceForensics++ and CelebVHQ compare the method with specialized face-swapping systems and methods without face-swap-specific training.
Critical strengths
-
The paper is clearly presented. The identity-token optimization, velocity-difference editing, and structure-aware residual modulation are easy to follow. The main text and appendix provide reasonably detailed implementation descriptions and ablations.
-
Face swapping without training a dedicated generator is a valuable direction. Leveraging a frozen video-generation prior reduces the need for task-specific generator training. However, the method still requires substantial test-time identity optimization, so this benefit should be distinguished from overall computational efficiency.
Critical weaknesses
-
Visible artifacts in the supplementary videos undermine the central quality claims. Among the four examples, cases 02, 03, and 04 exhibit pronounced, unnatural twitching around the eyes, eyebrows, or mouth. These artifacts impair usability and weaken the claims of fine-grained motion preservation and temporal consistency (Abstract; Section 4.2). Source-identity resemblance also appears limited, and some results in Figure 3 do not convincingly retain distinctive source features. Presentation problems with the supplied target videos prevent reliable frame-by-frame assessment of expression fidelity, but the unnatural motion in the generated outputs is clearly visible.
-
The structure-preservation mechanisms do not adequately address temporal instability. The method uses a video-generation backbone, temporal mask smoothing, and landmark-derived dynamics, but controls the residual primarily through regional weights and frame-dependent gates, without directly constraining motion continuity in the edited output (Sections 3.4–3.5). The observed twitching suggests that these mechanisms are insufficient to support the claimed fine-grained dynamic preservation. On CelebVHQ, Smoothness is also lower than FlowDirector’s (0.9719 versus 0.9916; Table 1). Direct evaluation of local motion is needed beyond aggregate smoothness and expression-feature distances.
-
Regional suppression may sacrifice identity without achieving a convincing identity–expression balance. The eyes, eyebrows, and mouth encode both expression and identity; reducing edits in these regions does not itself disentangle the two (Sections 3.4–3.5). In Table 2, adding the structure gate reduces Top-1 retrieval from 0.94 to 0.92, suggesting a possible identity cost, although this small difference requires cautious interpretation. Meanwhile, visible twitching persists in the supplementary results. The current evidence therefore does not demonstrate a satisfactory balance between source-identity fidelity and natural target dynamics.
-
The video comparisons do not sufficiently establish the claimed practical advantage. PhotoSwap and SwapAnything primarily target images, while FlowDirector is a general video-editing method rather than a native face-swapping system (Section 4.1; Table 1). Although video pipelines such as VFace are reported separately, synchronized qualitative comparisons would better establish the relative performance. FlowDirector’s publicly released examples appear less affected by the discontinuities seen here; these are not matched comparisons, but they motivate closer examination of why the proposed editing procedure introduces such artifacts despite using a video prior.
Questions for authors
-
What causes the eye, eyebrow, and mouth twitching in supplementary cases 02–04, particularly given the use of a video-generation backbone? Could you provide correctly displayed, synchronized target videos for frame-by-frame comparison?
-
Why do these artifacts persist after semantic modulation and landmark-guided protection? Could you provide matched video comparisons with and without the structure gate, together with mouth- and eye-motion trajectories relative to the target?