- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper finds that deepfake detection performance generally degrades across successive MLLM layers. Based on this observation, the authors train a visual detector using intermediate-layer features to obtain an initial judgment. They then construct reflective reasoning data with the help of an external MLLM and train the target MLLM through RBI to keep or revise the initial judgment. Finally, they propose CT-OPSD, which uses token-level disagreement between positive and negative teachers to reweight on-policy self-distillation, further improving reflective reasoning and detection accuracy.
Critical strengths
- I like the contrastive teacher token weighting, which uses disagreement between positive and negative teachers to place more emphasis on important reasoning tokens.
- I like the design of in RBI. By averaging the MLLM and visual-detector logits, it encourages the MLLM to make stronger corrections when the initial visual judgment is wrong.
Critical weaknesses
- One advantage of MLLMs over traditional binary detectors is that they can provide forensic reasoning in addition to real-or-fake predictions. However, the paper only evaluates detection accuracy, without assessing the reliability of the generated explanations.
- The paper focuses on deepfake detection, but some baselines are designed for general AI-generated image detection. How well does this method perform on general AIGC detection benchmarks? Also, comparing general AIGC detectors on deepfake benchmarks may not be entirely fair.
- Some mathematical symbols are not clearly defined, making the method harder to follow than necessary.
Questions for authors
The proposed method seems applicable to general AI-generated image detection, but the paper focuses on deepfake detection, while some of the baselines are designed for general AIGC detection. Could the authors clarify why the scope is limited to deepfake detection and better explain the relationship between these two tasks in the context of this work?
4 comments
Dear Reviewer Nsu3,
Thank you again for your time and effort in reviewing our manuscript.
As the discussion period is coming to an end, we would like to kindly ask if there are any remaining points that you would like us to clarify.
We appreciate your thoughtful feedback and hope that our responses have adequately addressed your earlier comments.
Sincerely,
Authors
Thank you for the clarifications. Overall, I think this is a very good paper, and most of my concerns have been addressed. It would be helpful to see additional results on general AIGC detection benchmarks. I lean toward weak acceptance.
Dear Reviewer Nsu3,
Thank you for your encouraging feedback and for carefully considering our responses.
As you point out, general AIGC detection is also an important task in this field. We will continue to work on extending SeeTR to the general AIGC detection task.
Sincerely,
Authors
We sincerely appreciate your time and effort in reviewing our paper. We respond to each of your questions one-by-one in what follows. We have made every effort to address your concerns thoroughly. If any concerns remain, we would greatly appreciate hearing them and the opportunity to address them further.
[W1]Reliability of the generated explanationsAs you suggested, we supplemented the original qualitative analysis (original Figures 11–12, revised Figures 15–16) with machine and human evaluations. SeeTR ranks first overall and on every criterion in both evaluations. To separate explanation quality from detection accuracy, each evaluation uses only images that all detectors in that comparison classify correctly.
i) Machine evaluation of explanation reliability
All three MLLM judges give SeeTR (CT-OPSD) their highest overall score. We randomly sampled 500 fake images that all four detectors in the table correctly classified as fake in the cross-domain & forgery evaluation. Each judge saw the image and one anonymous rationale at a time, was told that the image was fake, and scored the rationale on three criteria using a five-point scale (revised Figure 8).
Averaged across judges, SeeTR (CT-OPSD) also ranks first in artifact validity and localization, description quality, and clarity (4.36, 4.33, and 4.62; revised Figure 7).
ii) Human evaluation of explanation reliability
Human raters gave SeeTR the highest average score on all three criteria, with an overall score of 3.35 out of 4, compared with 2.60 for Veritas++, the strongest baseline (revised Figure 6). We randomly sampled 10 real and 10 fake images. For each image, 23 participants saw the ground-truth label and ranked four rationales on each of three criteria. We hid the detector names and shuffled the rationale order separately for each image (revised Figure 5).
First through fourth place received 4, 3, 2, and 1 points, respectively.
The results, evaluation prompt, and study details are provided in Appendix D (D.1 human evaluation, D.2 machine evaluation) of the revised manuscript.
[W2, Q1]AIGC detection baselinesWe deliberately included AIGC detectors in our evaluation because the two tasks share generative artifacts. Both AIGC images and facial deepfakes contain artifacts from generative models such as GANs and diffusion models. AIGC detectors learn these artifacts from diverse generated images. The same artifacts also appear in facial deepfakes created by entire face synthesis (EFS) and facial editing (FE). We mark AIGC detectors with † in Tables 1–2 of the revision. For a fair comparison, all baselines are evaluated with their official code and released checkpoints under the same protocol (Section 4.1).
Our comparison shows that AIGC detectors are much weaker on face swapping (FS) and face reenactment (FR), while remaining competitive on EFS and FE. In Table 2, SeeTR outperforms them by large margins on FS (DeepFaceLab: 72.96 vs. 43.35 and 51.30 for TranX-Adapter and Deep-VRM) and FR (HeyGen: 87.34 vs. 45.27 and 76.46). These manipulations replace the identity of a real face or drive its pose, expression, and mouth while preserving identity. Our artifact taxonomy explicitly covers them, which highlights the importance of fine-grained, face-specific rationale construction. This indicates that SeeTR examines facial forgery cues at a finer granularity than AIGC detectors, which makes it more effective on FS and FR.
We agree with the reviewer that extending our work to AIGC detection is an important future direction. Combining the fine-grained facial forgery details of this work with AIGC detection could lead to a broader deepfake detection framework. Such a framework should also strengthen detection of FS and FR, which existing AIGC detectors struggle with. As SeeTR's taxonomy and prompts are designed for facial forgeries, we have not evaluated it on general AIGC benchmarks in this work.
We have clarified the relationship between the two tasks in Section 4.1 and marked the AIGC detectors in Tables 1–2 of the revised manuscript.
[W3]Clarity of mathematical notationTo address your concern, we have thoroughly revised Section 3 to clarify the mathematical notation throughout. The corresponding changes are specifically highlighted in orange in the revised manuscript.