- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper proposes an asymmetry-guided iterative adaptation framework for AI-generated image detection, addressing limited generalization to unseen generators and the resulting false negatives. Its central observation is that initially detected synthetic images contain source-specific cues that can help recover other missed images from the same source. In contrast, using target images predicted as real as real-labeled training samples can reinforce errors associated with undetected synthetic images. At each iteration, the framework assigns synthetic pseudo-labels to target images predicted as synthetic and to a randomly sampled subset of the remaining images, enabling exploration beyond the detector’s current coverage. These samples are used jointly with independent, trusted real-image replay to optimize a binary cross-entropy objective, constraining false positives and decision-boundary drift caused by noisy pseudo-labels. The updated detector then re-evaluates the target collection, and adaptation proceeds until the growth in synthetic predictions saturates, subject to minimum and maximum iteration limits. The method is evaluated on 13 benchmarks. Across the 11 primary benchmarks, it improves average balanced accuracy from 87.2% to 98.5% on held-out evaluation subsets. Its main contribution is to turn partial cross-generator generalization into source-specific iterative adaptation while avoiding the reinforcement of false negatives through asymmetric supervision. These results are obtained through adaptation on unlabeled target data with an external trusted real-image pool, rather than zero-shot inference with a fixed detector.
Critical strengths
1.Well-motivated empirical insight. The preliminary experiments identify an important phenomenon: initially detected synthetic images provide useful cues for recovering missed images from the same source, whereas training on target images pseudo-labeled as real can reinforce existing false negatives. These findings provide a clear empirical basis for the proposed framework. 2.Thoughtful asymmetric supervision design. The framework obtains synthetic supervision from target data and real supervision from an independent, trusted real-image pool. This avoids repeatedly treating missed synthetic images as real during adaptation. Trusted real-image replay further helps control false positives and decision-boundary drift. 3.Strong empirical results and broad evaluation. The method achieves strong results across the reported benchmark comparisons. The evaluation spans 13 benchmarks covering multiple generation paradigms, in-the-wild images, and common post-processing operations. Component ablations, class-wise results, and analyses of difficult sources provide further evidence for the effectiveness of the proposed design.
Critical weaknesses
1.Insufficient characterization of noise introduced by stochastic exploration. The method assigns synthetic labels to randomly sampled images from the remaining pool, which may include genuine real images. Although trusted real-image replay is intended to constrain this label noise, it remains unclear under what conditions it can prevent the detector from learning spurious associations between target-domain characteristics and the synthetic class. This concern is particularly relevant when real images dominate the target collection. Further analysis under varying real-to-synthetic ratios would help establish the reliability of this mechanism. 2. Limited reliability for scarce or underrepresented synthetic sources. The effectiveness of iterative recall depends on both the number and the relative proportion of images from a difficult source. Figure 7 shows that gains can be unstable, and adaptation can underperform the initial detector in some low-count settings, such as those with only 10 images from the difficult source. The authors attribute this behavior to insufficient same-source evidence for learning a stable source-specific pattern. This limits the method’s applicability to emerging generators represented by only a few images in the target collection. 3.Dependence on the coverage of the trusted real-image pool. Trusted real-image replay draws on multiple datasets and additional web photographs and is an important component of stable adaptation. However, its ability to control false positives remains unclear when target real images differ substantially from the replay distribution, such as images from specialized acquisition devices or domain-specific imagery. A more detailed analysis of sensitivity to replay-pool size, composition, and distributional coverage would help clarify this dependency.
Questions for authors
1.Robustness to exploration-induced label noise. Stochastic exploration may assign synthetic labels to genuine real images in the target collection. Could the authors clarify under what conditions trusted real-image replay can effectively constrain the resulting label noise? Reporting synthetic-image recall and real-image false-positive rates across different target real-to-synthetic ratios and exploration budgets would help establish the robustness of this mechanism. 2.Construction and sensitivity of the trusted real-image replay pool. Trusted real-image replay appears central to stable adaptation. Could the authors provide the total pool size, the proportions contributed by each source, and details of the authenticity screening and deduplication procedures? Appendix A specifies that each round uses an equal number of replay real images and pseudo-labeled synthetic images; reporting the actual sample counts for representative benchmarks would further clarify the data requirements. Ablations on replay-pool size and source composition, together with an evaluation under a distribution mismatch between replay and target real images, would help characterize the method’s dependence on real-image coverage.
2 comments
Response to Reviewer NRay (2/2)
Response to W3 / Q2: Trusted-real pool construction, distribution mismatch, and pool size
- W3.1: Stable anchor effect of trusted real supervision under distribution mismatch. We fix GenImage fake images and vary the target-real and replay-real sources to examine trusted real supervision under distribution mismatch. The cross-source results below show that replay can provide effective real-class constraints under distribution mismatch between target and replay images, supporting the stable anchor effect of trusted real supervision across differing source distributions. This effect is further enabled by the asymmetry of data collection: unknown fake images cannot be obtained in advance, whereas real images can be broadly pre-collected and augmented across scenes, contents, acquisition conditions, and processing pipelines, which improves the coverage of the real reference set and reduces the impact of target-real shift.
| Target real | Replay real | Fake accuracy | Real accuracy | Balanced accuracy |
|---|---|---|---|---|
| ImageNet | Open Images | 97.65 | 99.50 | 98.58 |
| MS COCO | ImageNet | 98.47 | 100.00 | 99.24 |
| CC12M | LAION | 98.13 | 97.38 | 97.75 |
| Open Images | CC12M | 97.13 | 98.88 | 98.00 |
- W3.2: Sensitivity to replay-pool size. We vary the replay-pool size in multi-round adaptation on GenImage and AIGIBench. For efficient experiments, we randomly sample about 8,000 fake test images from GenImage and about 25,000 fake test images from AIGIBench. When the number of replay real images required by an update exceeds the available pool, replay draws are resampled with replacement. Small pools provide insufficient real constraints, while a sufficiently large pool supplies supervision with enough diversity for a stable counteracting effect, and the required pool capacity therefore depends on the scale of the target collection, with diminishing gains once sufficient coverage is available. Table entries are GenImage / AIGIBench.
| Replay-pool size | Fake accuracy | Real accuracy | Balanced accuracy |
|---|---|---|---|
| 1,000 | 99.50 / 99.90 | 80.94 / 28.58 | 90.22 / 64.24 |
| 2,000 | 99.31 / 99.94 | 96.94 / 61.60 | 98.13 / 80.77 |
| 5,000 | 99.25 / 99.96 | 99.06 / 91.48 | 99.16 / 95.72 |
| 10,000 | 99.06 / 99.64 | 99.50 / 98.38 | 99.28 / 99.01 |
| 20,000 | 98.56 / 99.60 | 99.69 / 99.10 | 99.13 / 99.35 |
- W3.3: Replay requirements on representative benchmarks. GenImage contains about 48k fake test images and AIGIBench contains about 112.5k fake test images. In each update, random exploration samples as many images as the model-predicted fakes, and trusted replay real images are used in the same number as the resulting pseudo-fakes. We report the replay requirements for the first three rounds, during which the predicted-fake counts grow fastest, and the corresponding replay requirements grow accordingly. Table entries are GenImage / AIGIBench.
| Update round | Predicted-fake images | Exploration images | Required replay-real images |
|---|---|---|---|
| 1 | 35,346 / 65,849 | 35,346 / 65,849 | 70,692 / 131,698 |
| 2 | 38,972 / 88,875 | 38,972 / 88,875 | 77,944 / 177,750 |
| 3 | 42,990 / 90,576 | 42,990 / 90,576 | 85,980 / 181,152 |
- W3.4 Replay-pool construction: We build the trusted real replay pool by randomly drawing 50k images from each source dataset, so that each source contributes equally and the pool covers diverse scenes, contents, acquisition conditions, and processing pipelines. Regarding authenticity screening, candidate images are restricted to established, human-verified real-image datasets and publicly hosted photographs, and any samples whose provenance could not be confirmed are excluded. Deduplication is performed both within the pool and against all evaluation benchmarks, using ID matching of the datasets and image metadata, so that no replay image overlaps with the target collections used for adaptation or testing.
Response to Reviewer NRay (1/2)
We sincerely thank the reviewer for the constructive comments. We have carefully addressed the concerns regarding exploration-induced label noise, scarce and underrepresented synthetic sources, and the construction and coverage of trusted-real replay by providing further clarifications and conducting additional experiments.
Response to W1 / Q1: Robustness to exploration-induced label noise
Response to W2: Scarce and underrepresented synthetic sources
Our adaptation learns a source-specific within-class pattern from the predicted fakes to recall more fakes of the same source. With too few samples, the predicted fakes cannot form a stable pattern, leading to unstable adaptation. In practice, our framework is deployed in a dual-track manner: the online detector keeps serving while images accumulate, and the collection threshold that triggers offline adaptation can be set according to the desired stability, so a higher threshold delays adaptation until enough evidence is gathered. This instability is transient rather than persistent: as shown in Figure 7 of the paper, once a difficult source grows from 10 to 50 images, adaptation already yields largely stable positive gains across various fake proportions, and these gains increase further with more samples. In real deployment, new generators typically spread quickly once released; for instance, GPT-Image-2 first appear only in small numbers online but expand rapidly within a short period, so the accumulated data quickly reach the level required for stable adaptation.