- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes Pretrained-feature-Anchored Learning (PAL) for multi-dataset deepfake detection. PAL constrains real training samples to remain close to their frozen pretrained representations, while learning several forgery directions to measure how fake samples depart from this pretrained feature space. The method also introduces a fixed threshold derived from the anchor score and validation forgery scores, allowing the same decision rule to be applied across unseen datasets without test-time tuning. Experimental results show improved acceptance of unseen real faces while maintaining competitive real–fake discrimination.
Critical strengths
This paper identifies a practically important but often overlooked failure mode in multi-dataset deepfake detection: real faces from unseen sources can be misclassified as fake even when overall AUC remains high. The paper further evaluates this issue explicitly through unseen-real acceptance and thresholded accuracy, which makes the analysis more relevant to real-world deployment.
Critical weaknesses
-
I can confirm that the issue of real samples being misclassified as fake has been studied in previous works, and that models distinguishing real data from different sources has also been studied in previous works. Then, is the real novelty of this paper merely to make the representations of real data closer to the pretrained representations?
-
Keeping the representations of real data unchanged does not necessarily mean that it is beneficial for real–fake classification.
-
Source-domain real data still participate in training. This method mainly constrains source-domain real samples to remain close to their pretrained representations, but this cannot guarantee that the actual decision logic of the model changes. Since the fake representations and the classification boundary can still adaptively adjust, the model may simply relearn a decision rule similar to the original one in a new representation coordinate system. Therefore, the current method is more like re-constraining the reference position of the representation space rather than substantially optimizing the decision mechanism. The authors even acknowledge that “whereas training reals can only be shifted slightly against them within the anchor’s slack”.
-
Under this training scheme, the most questionable issue is whether test real data can still remain consistent with their frozen features. If not, the method would be meaningless.
-
Overall, this work proposes an interesting but rather flawed idea, and the method design cannot solve the problem it raises.
Questions for authors
If the authors can theoretically demonstrate that their method truly changes the detector’s decision logic, I believe this would make the work more complete and would improve my score. In its current form, the method essentially maintains eight forgery-class prototypes while constraining the real distribution to remain unchanged during training, which I find difficult to be convinced by.
2 comments
We thank the reviewer for reading our rebuttal and for the response.
In our rebuttal, we aimed to address each of the concerns raised in the initial review in detail. However, we would be grateful if the reviewer could clarify which concerns remain unresolved, or which parts of our response were not convincing. We would also greatly appreciate any specific suggestions, such as additional experiments, analyses, or clarifications, that would strengthen the paper, and we will do our best to address them.
I thank the authors for their response. After considering it, I have decided to maintain my original score.