- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes CIFT, a face-forgery detection framework based on learning using privileged information. During training, it uses donor references as privileged relational inputs. A dual-stream Mamba module (XID-Mamba) with symmetric cross-attention models donor–target relationships, while type-conditioned Identity Gap Supervision (IGS) constrains their direction and magnitude. These training objectives transfer donor information into target representations while preserving a target-only classification path. A frozen Stable Diffusion branch provides auxiliary denoising regularization. Cross-dataset experiments demonstrate promising generalization to unseen forgery methods and synthesis pipelines, without requiring donor references or diffusion computation at inference.
Critical strengths
-
The motivation of the paper is clear: existing methods mostly rely on artifact clues such as spatial, frequency, blending, or reconstruction. However, with the development of manipulation techniques and the continuous changes in synthesis methods, current methods face the core challenge of how to ensure generalization when the synthesis pipeline changes. Motivated by this, the paper designs a method based on Learning Using Privileged Information (LUPI), which uses donor information as privileged information available only during training to improve the generalization ability of the method.
-
During training, the method uses the actual donor reference as privileged relational supervision to shape the target representation, while entirely discarding the donor at inference and using only the single observed image as input. This not only enhances the capability of feature extraction but also ensures the fairness of comparison with other baseline methods under the single-image inference setting.
-
Extensive comparisons and component-level ablations provide substantial empirical support for the method’s generalization performance and help establish the contributions of its main components.
Critical weaknesses
-
The paper attempts to ensure the consistency of extracted features between the training and inference stages by employing an identical classification path in both stages, rather than relying on explicit alignment mechanisms for constraint. That is, the paper does not seem to provide statistical evidence demonstrating that the feature distribution under relational supervision during training is consistent with the feature distribution without such supervision during inference.
-
The paper defines "source-free inference" as "requiring no donor data at inference." However, in existing literature, "source-free" has an established meaning, generally referring to source-free domain adaptation, where source domain data is available during training but unavailable during adaptation, and "source" refers to the source domain, which is unrelated to the donor reference. Such phrasing is likely to cause confusion for readers. It is recommended to modify the terminology or add a footnote at its first occurrence to aid reader comprehension.
-
The paper employs a diffusion-based auxiliary denoising regularization branch but does not provide a detailed explanation of the rationale behind this choice. My question is: why must it be diffusion regularization specifically? It is recommended to compare it with other simpler regularization methods.
-
The paper only compares the inference parameters and computational cost of different relational heads in Table 13. However, this is an internal variant comparison within the model (and the inference parameter counts are identical), lacking a comparison of inference resources with other methods such as DiffusionFake, SBI, and UCF. The efficiency of the proposed method remains to be verified. It is recommended to supplement experiments on the inference parameters, per-frame FLOPs, and latency on the same hardware across the respective methods.
-
Some figures in the paper are confusing. For example, Section 3.1 (Line 159) states: "For face swapping, x_s is the identity donor associated with I_s, while x retains target-conditioned context associated with I_t." This is intended to specify that x_s serves as the identity provider. However, in Figure 1, x_s is depicted as an original image before face-swapping, rather than an identity provider. This contradicts the definition in the main text and makes it difficult for readers to understand. In addition, some small text in this figure is unclear.
-
The paper compares numerous methods to demonstrate the effectiveness of the proposed approach. However, most of the compared baselines were published before 2025 (although it includes 2025 works like SELFI, the results are incomplete). Adding more methods from 2025 and beyond to the comparative experiments would be more convincing.
Questions for authors
see weakness