- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper focuses on the performance degradation of AI-generated image detectors under common post-processing operations and when the generator distribution is shifted. It points out that the common cause might be that the model relies on shortcut features that are not generalizable. In response to the limitations of existing methods, which typically intervene in specific data biases, the authors propose Frequency Attribution Mask (FAM), which serves as a post-hoc remedy for shortcut learning. FAM constructs a frequency attribution map using the input gradients of the detector, masks the high-attribution frequency components with a class asymmetry threshold, and then fine-tunes the masked reconstructed images. Experiments on two pre-trained detectors, Corvi and Rajan, show that this method improves the detection robustness of the model under unseen generators and post-processing conditions, and achieves better results than the original detector on real-world benchmark scenarios.
Critical strengths
- This paper addresses a relevant and practical problem. Improving the robustness of AIGI detectors to common post-processing operations and unseen generators is important for real-world applications.
- This paper provides a clear motivation for the proposed method. The authors systematically analyze the limitations of existing approaches and propose a detector-adaptive method that identifies frequency cues based on the detector’s own input gradients.
- Experiments on two pretrained detectors show improvements under post-processing and unseen-generator settings, with additional evaluations on in-the-wild benchmarks.
Critical weaknesses
- Gradient sensitivity is not established as a proxy for shortcut reliance. Highly attributed frequencies may encode transferable cues rather than shortcuts. FAM could therefore remove useful information, while fine-tuning on masked inputs may introduce new shortcuts.
- The contribution of frequency attribution remains unclear. In Table 2, random frequency masking yields substantial gains, while spatial attribution masking performs similarly to FAM. These results do not fully isolate attribution-specific benefits from masking and fine-tuning.
- The paper does not report the fraction of frequency components removed or the spectral energy retained, leaving sample-wise intervention levels and their effects unclear.
- Direct comparisons of real and fake frequency attribution maps are needed to support the claimed band differences and motivate asymmetric rather than shared thresholds.
- Evaluating only two pretrained detectors leaves uncertainty about how training stage and initial performance affect FAM’s effectiveness.
Questions for authors
- What evidence supports linking highly attributed frequencies to non-robust shortcuts rather than transferable cues? Does masked fine-tuning introduce new shortcuts?
- Can FAM, random frequency masking, spatial attribution masking, and the unmasked baseline be compared under matched training settings and, where applicable, masking strengths to isolate the sources of gains?
- Can the authors report class-wise masking ratios (mean and variance) and retained spectral energy?
- Can attribution visualizations and quantitative analysis substantiate real–fake frequency differences, alongside a comparison of class-asymmetric and shared thresholds?
- How does FAM perform across early, intermediate, and converged checkpoints of the same detector?