- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper’s premise is that a forensic cue means different things in different scenes. Smooth skin or flawless geometry points to AI generation in a photograph, but is ordinary craft in a painting or a 3D render. Detectors trained mostly on photographs therefore misread stylized content, and the paper argues that scene context must condition both which cues a model generates and how much weight each cue carries. There are two main contributions: 1. Redscenes dataset:168,688 Xiaohongshu images with human-verified Real/Fake labels and Gemini-generated style and subject labels. 2. FakeCueS, a Qwen detector that conditions both source classification and cue generation on a predicted scene representation, and trains open-ended forensic cues with GRPO using a set-level reward combining visual support, scene-conditioned source association, and novelty, without requiring reference rationales.
Critical strengths
-
Well-motivated problem and useful dataset. Cue validity across styles is a real gap. The paper documents that existing explainable detectors and their training sets are photo-centric. RedScenes offers real-world social-media data with human-verified source labels, a reasonable watermark-screening pipeline, and joint style and subject annotations. It covers Real artwork, design and 3D content.
-
Strong reported numbers and transparent reporting. In-domain and AnomReason-Deepfake numbers are strong. The appendix candidly reports negative findings, including near-unanimous cue verdicts, cue voting causing a net loss relative to the head, and ablations that do not isolate reward terms.
Critical weaknesses
-
Dataset is good but I am worried about the potential label leakage in scene annotation. Authors use Gemini 3 Pro to assign style and subject labels with the image and its confirmed source label together. Style boundaries are often ambiguous. For example, a photorealistic AI-generated portrait could reasonably be labeled either “photography” or “3D rendering”. Knowing that an image is Fake may bias the annotator toward “3D”, while a Real image with similar appearance may be labeled “photography”. In some extent, style labels may therefore encode source information. This is supported by the highly skewed source proportions across styles: about 82% of 3D images are Fake, compared with about 22% of Design images. This matters because FakeCueS predicts style and feeds it into source classification. The model could exploit style as a proxy for the source label rather than learning scene-dependent cue validity. The authors should report how scene labels change when the source label is withheld, for example by re-annotating a subset without it and measuring agreement. They should also evaluate the model with source-agnostic scene labels.
-
Another concern is about whether performance gains can be attributed to the proposed components. Firstly, the paper does not compare variants with and without scene conditioning, scene supervision, or scene-conditioned association under an otherwise identical setup. Rows in Table 3 differ in training steps, prompts and prediction paths, and the authors acknowledge that the table does not isolate individual components. Besides, Classifier with Scene uses no cue generation or RL, yet it reaches 91.73% on RedScenes, essentially the same as FakeCueS (91.53%). The cue generation and reward design therefore contribute little to detection accuracy. Also, all baselines in Table 1 are off-the-shelf or zero-shot, while FakeCueS is trained on RedScenes. The 12.25 pp margin therefore largely reflects in-domain training.
Questions for authors
-
The ethics statement conditions any release of RedScenes on legal review. Given that the dataset is presented as a primary contribution and that the main results are not reproducible without it, can you state what is likely to be released and in what form (images, URLs plus labels, or labels only)? Will training and evaluation code be released?
-
The reported predictions come from the source head, which does not use the generated cues. In what sense do the cues explain the model’s decision? On the 790 test images where cue voting and the source head disagree, which output should a user trust, and why?
-
Figure 5(b) justifies a Real verdict through “conscious artistic conception”, which the cue-generation prompt explicitly forbids. How often does this kind of reasoning occur in test outputs?
-
Have you evaluated the accuracy or usefulness of the generated cues, through a human study, an automatic faithfulness test, or a comparison with explanations from baselines such as FakeVLM or AIGI-Holmes? If not, what evidence supports the claim that FakeCueS improves explainable detection?
4 comments
Response to Reviewer tdtt (Part 2 of 3)
W2: Component contributions beyond in-domain training
We use training comparisons with the same backbone to assess gains beyond in-domain training. The following results reproduce Table 3 of the revised manuscript. All configurations use Qwen3.5-4B, with all except Zero-shot trained on RedScenes. Values are accuracy (%), and Avg. is the mean across nine OOD datasets.
| Method | Predict | ID: RedScenes | OOD: Anom.-DF | OOD: Chameleon | OOD: Avg. |
|---|---|---|---|---|---|
| Zero-shot | Label | 66.77 | 92.37 | 75.48 | 82.69 |
| Pure RL | Cue | 89.55 | 93.50 | 81.82 | 84.82 |
| FakeCueS | Direct | 92.89 | 94.58 | 84.79 | 87.32 |
| − Cue Learning | Direct | 91.73 | 92.26 | 81.77 | 84.05 |
| FakeCueS | Cue | 92.81 | 94.23 | 81.73 | 85.50 |
| − Scene Statistics | Cue | 90.54 | 94.07 | 79.86 | 85.07 |
Compared with standard GRPO on Qwen3.5-4B (Pure RL), FakeCueS improves ID accuracy by 3.26 percentage points and mean OOD accuracy by 0.68 points when both use Cue voting. This demonstrates the additional benefit of scene-conditioned cue learning.
The two core ablations assess cue learning as a whole and scene-conditioned statistics. Removing cue learning (− Cue Learning) reduces Direct accuracy by 1.16/3.27 points on ID/OOD. Replacing scene-conditioned statistics with global statistics (− Scene Statistics) reduces Cue accuracy by 2.27/0.43 points. The updated results show that cue learning improves both in-domain detection and external generalization, with the full model outperforming the scene-aware classifier.
To address the advantage of in-domain training, we also trained a standard source classifier without scene or cue modules. Its ID/mean OOD accuracies are 91.56%/85.96%, compared with 92.89%/87.32% for full FakeCueS Direct. The advantage thus persists against a classifier trained on the same RedScenes data.
Scene supervision and scene-conditioned statistics have distinct roles. In the classifier-only comparison, retaining the scene architecture while removing the scene-supervision loss changes mean OOD accuracy from 84.05% to 85.46%. The component gains are therefore supported by cue learning and scene-conditioned statistics, rather than by adding scene-classification supervision alone.
Q1: Dataset and code release
We plan to release the RedScenes images and labels together with the training and evaluation code to support reuse and reproduction of the main results. We are organizing and de-identifying the dataset and plan a near-term release, subject to completion of reviews covering data-use permissions, copyright, and privacy.
Q2: Relationship between generated cues and classification decisions
Direct and Cue are independently usable prediction modes for different application needs. We train Qwen3.5-4B for one epoch on the 151,790 RedScenes training images. Direct provides efficient detection through the source-classification head. Cue generates forensic cues and takes a majority vote over their source verdicts, making the cues the explicit basis of the Cue decision. Cue learning benefits Direct during joint training by improving their shared representations.
The two modes have similar detection performance on RedScenes, and the choice depends on the application. Direct avoids text generation, while Cue provides observations and reasoning that can be inspected. When they disagree, the application should retain its preselected mode: Direct when detection efficiency is the priority, or Cue when inspectable forensic cues are required.
Q3: Frequency of reasoning that violates the prompt constraints
Thank you for pointing this out. We randomly sampled 200 complete test responses containing 800 cues and used an external model to examine observation, summary, and reasoning for source inferences based on creative intent, compositional purpose, or expressive motivation. The audit flagged 21 cues as potential violations, yielding an estimated prevalence of approximately 2.63% among generated test cues. None of the 200 responses consisted entirely of such cues. These findings indicate that prompt constraints do not fully eliminate this form of reasoning, but its estimated prevalence is low.
Response to Reviewer tdtt (Part 3 of 3)
Q4: Accuracy and usefulness of the generated cues
Independent pointwise and pairwise comparisons with FakeVLM, AIGI-Holmes, and other methods favor FakeCueS's complete forensic responses.
We compare 1,120 complete responses from eight models on 140 images covering 70 scenes, including incorrect answers from each model. For pointwise evaluation, the separately trained specialist evaluator DeepfakeJudge scores responses from 1 to 5 (Kuckreja et al., 2026). For pairwise evaluation, the external general-purpose multimodal model Gemini Argon compares responses using the Veritas evaluation prompt, and preferences are aggregated into Elo ratings (Tan et al., 2026b).
| Method | DeepfakeJudge ↑ | Elo: source label provided ↑ | Elo: source label withheld ↑ |
|---|---|---|---|
| FakeVLM | 1.964 | 758.2 | 776.2 |
| FakeShield | 2.750 | 902.4 | 843.4 |
| AIGI-Holmes | 2.729 | 938.7 | 917.0 |
| FakeReasoning | 2.629 | 981.8 | 1024.2 |
| UniGenDet | 3.107 | 1037.7 | 1044.3 |
| Veritas | 3.443 | 1020.2 | 1074.3 |
| BusterX++ | 3.471 | 1076.4 | 1109.7 |
| FakeCueS | 3.757 | 1284.6 | 1210.9 |
FakeCueS achieves a DeepfakeJudge score of 3.757, exceeding the two methods you mention, FakeVLM (1.964) and AIGI-Holmes (2.729), and ranks first under both pairwise conditions. Since classification correctness can influence response scoring, we additionally withhold the ground-truth source label so the evaluator compares responses using the image and response content. Under this condition, FakeCueS retains an average preference rate of 77.98%, including 59.05% against the strongest comparator, BusterX++. Its forensic responses therefore retain a quality advantage without providing the evaluator with the correct source label.
Kindly Follow-Up: Reviewer tdtt
Dear Reviewer tdtt,
Thank you again for your thoughtful review and constructive suggestions. As the discussion period ends in about 5 hours, we would greatly appreciate it if you could take a look at our response when you have a moment. We would be happy to clarify any remaining questions, and if our response addresses your concerns, we would be grateful if you could take it into account in your final assessment.
Best regards, The Authors
Response to Reviewer tdtt (Part 1 of 3)
Thank you for your detailed comments on scene annotation, attribution of performance gains, and explanation validity. We first apologize for an error in our initial implementation and the additional review burden it caused. Our checks identified that cue clusters and historical statistics were not correctly shared across GPUs during training. We have corrected the implementation, rerun training and evaluation, updated the full-model results, and expanded OOD evaluation from two datasets to nine. We address your concerns below.
W1: Source information in scene annotation and potential label leakage
Thank you for highlighting how source labels could affect ambiguous boundaries such as photography versus 3D. We first clarify the pipeline: scene annotations are used only during training for scene-alignment supervision and scene-specific cue statistics; inference requires neither scene labels nor source labels. The model predicts style and subjects from the image and combines these predictions with visual features to form the scene representation used for source classification and cue generation.
To examine potential bias in the training annotations, we test whether source labels change scene annotations and whether scene-specific source proportions can explain detection performance.
A. Most scene annotations remain unchanged when source labels are withheld.
We sample five images from each of 70 scenes, totaling 350 images, and use the scene-annotation model to annotate each image with and without its source label. All other inputs and decoding settings are held fixed.
For the style boundaries you specifically raise, 94.57% of style labels remain unchanged. Joint agreement on style and all subject indicators is 91.43%. Differences primarily involve the addition or removal of subject labels, such as animals, and boundaries between photography and design or between anime and painting. This paired audit shows that most style and subject annotations remain stable across the two source-label conditions.
B. The model distinguishes sources within the same scene; style priors alone cannot explain its performance.
Source proportions do differ between 3D and Design. We therefore construct a baseline that predicts source solely from the training-set AIGC/Non-AIGC proportions of each scene, without reading the image. We compute balanced accuracy within each of the 65 scenes containing both classes and average equally across scenes (scene-macro BAcc.), so the majority class in a scene has no scoring advantage.
The prior-only baseline achieves 72.61% overall accuracy but 50.00% scene-macro BAcc., compared with 89.73%/91.07% for FakeCueS Direct/Cue. This gap shows that the model's discrimination extends beyond identifying the style and selecting its majority source class.