- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper introduces Fake-Reason, with 80K region-annotated images and 10K label-only samples, and RAFE, which adds region-level attention supervision to multimodal supervised fine-tuning. It aims to improve detection while grounding explanations in localized visual evidence.
Critical strengths
- The dataset design is thoughtful: real images also receive regional explanations, while modern samples without clear local artifacts receive label-only supervision. This reduces the risk of explanations becoming a fake-image-only output pattern.
- Detection results are competitive across diverse benchmarks. A same-backbone ablation reports a Synthbuster improvement from 92.8% to 98.3% with attention supervision, providing useful evidence for the auxiliary loss.
Critical weaknesses
- The central explanation and localization claims lack direct quantitative evaluation. Attention concentration does not establish factual correctness or dependence on the highlighted evidence. Dataset quality also lacks a quantitative audit; Figure 8 pairs a dog-region annotation with a date-stamp description, illustrating a relevant alignment error.
- Evaluation independence and reporting need clarification. Appendix B.4 reports hyperparameter selection using Synthbuster results without identifying a separate validation split, and GenImage training/test separation is insufficiently documented. Table 1's four Synthbuster entries average 98.3%, not the reported 94.6%; Tables 4/6 report 98.3%, whereas Table 7 repeats 94.6%. These issues complicate interpretation of the detection gains.
Questions for authors
- Can an independent audit compare explanation factuality, region alignment, and hallucination rates against ordinary SFT, including the mismatch in Figure 8?
- Were hyperparameters selected on separate validation data, how was GenImage overlap prevented, and which Synthbuster average is correct?
- Can matched cross-domain ablations separate attention supervision from the early/modern training-data composition?
- How does RAFE relate to FakeXplain [1], LEGION [2], LTE [3], and ReAlign [4]? Could suitable comparisons clarify detection generalization, and grounding or explanation quality where applicable?
References: [1] Ji et al. FakeXplain: AI-Generated Image Detection via Human-Aligned Grounded Reasoning. ICLR 2026. [2] Kang et al. LEGION: Learning to Ground and Explain for Synthetic Image Detection. ICCV 2025. [3] Ji et al. Locate-Then-Examine: Grounded Region Reasoning Improves Detection of AI-Generated Images. CVPR 2026. [4] Huang et al. ReAlign: Generalizable Image Forgery Detection via Reasoning-Aligned Representation. CVPR 2026.