- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes the CuRe framework, which reformulates binary classification into regression for real-generated mixing ratio estimation. It further selects a source-response subspace to suppress nuisance variation and restrict the final classifier's access to potential shortcut cues. The generalization and robustness are validated across 10 benchmarks.
Critical strengths
1、The proposed method achieves consistent and improved forgery detection performance across 10 diverse benchmarks, showing strong generalization against unseen generative models. 2、The proposed paradigm converts the conventional discrete AIG detection task into a continuous learning formulation for mixing ratio estimation. The method design aligns well with the core research motivation.
Critical weaknesses
Main Weakness:
- Insufficient justification for the proposed method over simpler shortcut mitigation strategies.
Figure 2 highlights the separation of features associated with different JPEG quality levels (q95 vs. q50) as evidence of format-related shortcut learning. However, such shortcuts can be mitigated through straightforward data augmentation or bias-controlled training, such as randomizing JPEG quality levels independently of real/fake labels or balancing compression distributions across the two classes. Moreover, the authors already apply JPEG format alignment during training. It remains unclear why these simpler strategies are insufficient and what additional benefits CuRe provides beyond existing shortcut mitigation techniques. A controlled comparison with these baselines is necessary to better justify the motivation and necessity of the proposed framework.
- Unclear relationship between semantic representations and forgery detection performance.
The paper argues that excessive reliance on semantic information contributes to shortcut learning, while Figure 2 suggests that suppressing semantic grouping leads to better separation between real and generated images. However, the relationship between semantic discrimination and forgery detection performance is not clearly established. Does stronger semantic discrimination necessarily impair authenticity detection, and is there quantitative evidence supporting this hypothesis? Furthermore, if reducing semantic dependence is central to the proposed approach, it is unclear why the framework relies on semantically powerful pretrained vision encoders with limited LoRA adaptation. Why not train a task-specific detector from scratch or adopt a backbone with weaker semantic priors? These choices require stronger motivation and controlled experimental validation.
Minor Weakness:
1、Experimental results show more significant improvements on in-the-wild benchmarks, yet the underlying reasons are not analyzed. Moreover, the definition of "in-the-wild" is not explicitly provided, and details such as dataset split protocols are missing.
Questions for authors
Why is the subspace dimension set to 128? There is no experimental evidence proving this dimension is optimal.
Actually, I am leaning toward a borderline rating for this paper. However, I would be willing to raise my score if the authors can adequately address my first two major weaknesses.
3 comments
Thanks for the response
Thank you for the response, which has addressed my concerns. I am willing to raise my score.
Dear Reviewer MSWu,
We are grateful for your quick follow-up and for your willingness to re-evaluate our submission in light of our response. We truly appreciate your positive assessment of our work.
If anything remains unclear or you have further comments, we would be happy to address them, and we will keep following this thread through the end of the author-response period.
Thank you once more for your time and constructive feedback.
Best regards, The Authors
Augmentation baselines, semantic representations, in-the-wild definition, and sensitivity to k
Thank you for the thoughtful questions, which have helped us improve the paper.
W1 (Major): Why are simpler shortcut-mitigation strategies insufficient?
Response: We agree that data augmentation and bias-controlled training can mitigate specific shortcuts. However, they require knowing in advance which bias to remove, and a dedicated augmentation has to be designed for each one. For a controlled comparison, we added JPEG, blur, and resizing augmentations to the binary baseline, keeping the backbone, training data, and base training setup the same, and compared the three models under different perturbations:
Balanced accuracy (%) on AIGIBench.
Overall, targeted augmentation brings only limited improvement: with augmentations added, the binary baseline is still more than 9 points below its clean accuracy in the worst case, and its clean accuracy does not improve either. In contrast, CuRe drops by at most 2.4 points under these perturbations.
In addition, generator-specific shortcuts cannot necessarily be resolved by adding more generators to the training set, since a new generator may differ in distribution from those already seen. Compared with approaches that rely on expanding the training data, actively suppressing shortcuts is therefore more effective.
W2 (Major): Semantic representations and the choice of pretrained backbone
Response: Thank you for pointing this out. The wording in the paper was indeed imprecise. We have corrected the relevant statements in the introduction and the caption of Figure 2 in the revised PDF (marked in blue).
We do not believe that semantic discrimination ability impairs detection. The finer visual details captured by pretrained representations help distinguish real from generated images. What we want to avoid is decisions that rely on coarse differences in category or content, which are unrelated to authenticity and can easily become shortcuts. This is also what Figure 2 is meant to show. Such shortcuts form easily in practice, since real and generated images in common training sets often differ in content.
We further ran an experiment: removing the suppression of content directions in Stage 2 (λ_s = 0) reduces the Overall balanced accuracy from 89.7 to 80.3. This indicates that keeping the decision away from directions dominated by content variation is important for generalization.
We still use a semantically strong pretrained backbone because we want to preserve these visual details, which is why we adapt it only with LoRA. Pretrained representations are useful in themselves: in Table 8, stronger pretrained backbones give better results for both binary training and CuRe, whereas detectors trained on the same data without such pretrained representations (NPR and SAFE) reach only 56.8 and 62.4 Overall balanced accuracy. The key is therefore not whether to use a semantically strong representation, but how to adapt it.
Minor: Definition of in-the-wild, the reason for larger gains, and the data split
Response: In-the-wild benchmarks contain images collected from real online environments such as social media, or images that simulate the degradations of online sharing. Their generators are more diverse and often unknown, and the images are frequently compressed or resized. CuRe generalizes well to unseen generators and is robust to postprocessing, which is why its gains are larger there.
Regarding the data split, CuRe is trained only on the training set of GenImage SD v1.4, epochs are selected on its official validation set, and all 10 benchmarks are used only for testing. We have added these details to the revised PDF.
Q: Why is the subspace dimension set to 128?
Response: We added a sensitivity analysis on k, using the same Stage 1 checkpoint and only recomputing the subspace and retraining the linear classifier.
Balanced accuracy and AUC (%) on AIGIBench.
The results are not very sensitive to k: for k between 32 and 224, the balanced accuracy stays between 91.0 and 93.0, which suggests that most of the signal is concentrated in a small number of dimensions. When k becomes too large (192, 224), performance drops and gradually approaches that of using the full features.
We should note that we had not previously run a broad search over k. We had only tried a few values. We have added this sensitivity analysis to the revised PDF (Appendix B.5).
We hope this addresses your concerns, and we are happy to discuss further.