- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes a generalizable deepfake detection framework consisting of Adaptive Subspace Residual Tuning (ASRT) and Confounder-Suppressed Prototype Decomposition (CSPD). ASRT uses layer-wise singular-value distributions to determine the trainable residual subspace of a pretrained CLIP ViT, while CSPD employs a learnable prototype pool to estimate and suppress forgery-irrelevant components in the feature space. Experiments on cross-dataset and cross-manipulation benchmarks, together with several ablation studies, are presented. The proposed framework is conceptually intuitive. However, I have concerns about the completeness and fairness of the baseline comparisons, the evidence supporting the causal deconfounding claim, and several methodological details. The experimental results do not sufficiently establish the claimed state-of-the-art generalization performance or the effectiveness of the proposed causal interpretation.
Critical strengths
- The paper is generally well-written and clearly organized, making the proposed method and experimental setup relatively easy to understand.
- The paper addresses the important problem of generalizable deepfake detection. Combining hierarchical parameter adaptation with confounder suppression is a reasonable and promising research direction.
Critical weaknesses
- Table 2 reports results for FA, but FA is missing from Table 1. Similarly, DFD-HR is included in Appendix Table 7 but omitted from the main cross-dataset comparison. Results for these methods are available in their original papers, and their weights are available for reproduction. These omissions raise concerns about the claimed superior cross-dataset performance. The authors should clarify why these comparisons are missing and provide a more comprehensive evaluation against recent methods.
- Table 2 evaluates BleFace, whereas Table 8 evaluates FSGAN. Moreover, most baseline methods are evaluated on eight subsets of DF40, while the proposed method considers only six. These inconsistencies make it difficult to assess the robustness of the reported results and raise concerns about potential selective reporting. The authors should justify the selection of manipulation methods and provide more consistent evaluations.
- CSPD aims to suppress forgery-irrelevant confounders, but the paper provides insufficient evidence that the learned prototypes actually capture nuisance factors such as identity and background. Moreover, the prototype usage patterns reported in the appendix suggest that they may also capture forgery-related information. Further analysis is needed to validate the claimed deconfounding effect.
- Equation (15) defines the weight loss as the negative mean of the residual singular values. Minimizing this term directly encourages the singular values to increase. Without an explicit constraint or a sufficiently justified balancing mechanism, this objective may encourage uncontrolled growth of the residual transformations rather than regularize them. The authors should clarify which quantities are optimized, how the singular values are constrained, and how this objective affects training stability.
Questions for authors
See weaknesses.
2 comments
Thank you for clarifying the original DF40 subset selection and expanding the video-level evaluation. The added DF-CBM baseline scores below Effort at the frame level, and the requested comparisons with FA and DFD-HR in Table 1 remain unresolved. DFD-HR already reports video-level AUC for all eight DF40 subsets and could be included in the expanded Table 2. For Table 8, I would like to see the proposed method compared on the same subsets with baselines whose frame-level results are available or can be reproduced. Given these gaps, I believe the claims of superior generalization should be stated more cautiously. I maintain my original rating.
Response to Reviewer H6rp
We sincerely thank you for the time and effort you have devoted to reviewing our manuscript and for your thoughtful comments and insightful questions. Your feedback has helped us improve the clarity and completeness of the manuscript. We address your comments in detail below.
RH6rp-Q1: Coverage of recent methods in the cross-dataset comparisons
Thank you for raising this concern. We first selected methods closely related to our work and then included additional methods from the broader deepfake detection field. Both the frame-level and video-level comparisons included three methods published in 2025 and two published in 2026.Our intention was to cover a broader range of methods across the two tables to assess generalization, which led to differences in the baseline selections.
DFD-HR is a valuable reference for our work. Its cross-dataset evaluations also use different sets of comparison methods for frame-level and video-level results. In response to your concern, we have expanded the comparisons with recent methods in Tables 1 and 7 to provide a more comprehensive assessment of our method's generalization performance. For example, we have added DF-CBM(ECCV'26) to Table 1 and 7.
RH6rp-Q2: Consistency of the DF40 evaluation subsets
We thank you for pointing out the inconsistency in the evaluation subsets. Our initial evaluation followed the setting reported in “When Detectors Forget Forensics: Blocking Semantic Shortcuts for Generalizable AI-Generated Image Detection,” which considers six manipulation subsets. When incorporating results from additional related work, we found that MAP-Mamba, published in TIFS in 2026, did not report results on FSGAN. We therefore replaced FSGAN with BleFace in Table 2, which accounts for the difference in subset selection between Tables 2 and 8.
In response to your comment, we have expanded the video-level evaluation in Table 2 to eight subsets. For the frame-level comparison in Table 8, some baseline papers report only video-level results, which cannot be directly used for a frame-level comparison. This limits our ability to extend the comparison to all eight subsets. In future work, we plan to reproduce the frame-level results of these baselines to enable a more comprehensive comparison.
RH6rp-Q3: Evidence that the prototypes capture nuisance factors
Thank you for raising this question. We address the same concern in our response to Reviewer gvj5, Q2, and our response to Reviewer W3j9, Q4. These responses discuss the interpretation of class-dependent prototype routing and the additional visualizations used to examine the effect of CSPD's subtraction operation. We refer the reviewer to those responses for details.
RH6rp-Q4: The role of Equation 15 and control of residual parameter growth
We thank you for highlighting this issue. The motivation for Equation 15 is that the residual components are initialized from directions associated with smaller singular values of the pretrained weights. We aim to strengthen the contribution of these directions so that they can participate effectively in adaptation for forgery detection. Equation 15 therefore serves to enhance residual adaptation capacity.
During optimization, the dominant component remains frozen, while the residual component is trainable. To counteract excessive parameter growth, we apply the weight decay used with the Adam optimizer, as specified in the manuscript, to the residual parameters, including the trainable singular values. Equation 15 encourages stronger residual transformations, while weight decay penalizes large parameter magnitudes, providing a counteracting mechanism.
The orthogonality loss serves a different purpose: it reduces redundancy among residual directions and does not directly constrain the magnitudes of the singular values.
We acknowledge that the original manuscript did not sufficiently distinguish the roles of these mechanisms. We have added a description of Equation (15) in lines 335–338 of the revised manuscript to clarify its role in enhancing residual adaptation capacity and explain how weight decay counteracts excessive parameter growth.
We thank you again for the helpful comments and suggestions.