- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper studies AI-generated image detection with one training generator and unseen test generators. Its method, ReSCOPE, reconstructs each real image twice with the frozen diffusion model SD1.4 (DDIM inversion, then denoising), giving a pair of fakes. It fine-tunes CLIP ViT-L/14 or SigLIP2-Giant with rank-4 LoRA on GenImage SD1.4, using BCE plus a cosine consistency loss that pulls the pair's normalized features together. Training alternates phases with both losses and phases with the consistency loss alone. An analysis reports that the pair's feature difference lies in local low-dimensional subspaces. The paper claims 97.57% mean accuracy over generators (mAcc) on GenImage and 88.93% accuracy on Chameleon. It tests the SigLIP2 detector on six more benchmarks against baseline numbers taken from prior papers. An ablation on both backbones compares it with BCE-only training and a linear classifier on frozen features (the linear baseline).
Critical strengths
On the same backbone, the alternating consistency schedule beats BCE-only training, and inference needs no reconstruction.
In Table 7, with CLIP, mAcc rises from 80.09% for BCE-only training to 93.37% for ReSCOPE. With SigLIP2, it rises from 89.75% to 97.57%. This is the only matched comparison in the paper. But each setting is a single run, and the controls start from a different initialization (App. B.4). So I read it as suggestive evidence only.
Critical weaknesses
-
The method recombines known studies, and the paper never shows why aligning two reconstructions should remove generator-specific cues.
- The training data, the pair and the loss each appear in earlier work. DRCT (Chen et. al., ICML 2024) and PPL (Yang et. al., ICLR 2026) already train on diffusion reconstructions of real images and align features within a label. PPL, the strongest baseline in Table 1, does this with LoRA on CLIP under the same GenImage SD1.4 protocol. DID (CVPR 2026) already uses the same pair of consecutive reconstructions (l.108–109). The loss is that of CORE (Ni et al., CVPR Workshops 2022), which the paper does not cite: classification plus a cosine consistency without negatives on two same-label views. What is new is the choice of this pair for the alignment, and the schedule.
- The paper has no rigorous justification for why the method works. The link between the pair's feature difference and generator-specific cues is only a drawing: "The schematic places this response along the axis of source-related variation" (l.202). Both reconstructions carry SD1.4 traces, and nothing explains why invariance to a second pass would remove the signature of the first. The evidence is Fig. 2(c–f): one CLIP detector, one unseen generator (BigGAN) and 500 images.
- The subspace analysis does not lead to the method. It is contribution 1 (Section 3), but predicting the feature difference and removing its subspace both fail (App. A.2–A.3).
-
The results do not separate the method from the backbone, the extra data and the protocol, and report no variance.
- The state-of-the-art claim holds only with a backbone that no baseline uses. The headline result and all cross-dataset tables (2–6) use SigLIP2-Giant at 384 px. The linear baseline alone scores 7.68 points higher with SigLIP2 than with CLIP (Table 7). With CLIP ViT-L/14, ReSCOPE scores 93.37% mAcc, below five baselines in Table 1, including PPL (97.20%). OMAT, a baseline that also fine-tunes CLIP with rank-4 LoRA on SD1.4, scores 94.63%.
- Extra training data, mismatched protocols and fixed-threshold metrics weaken the comparisons. ReSCOPE also trains on 10K reconstruction pairs, half of them from a pool the paper never describes (App. B.1). The Table 4 baselines are trained on ProGAN, and only ReSCOPE's inputs are re-encoded as JPEG at quality 80 (l.1117–1121). For GenImage, mAcc is the standard metric. Elsewhere, every result is accuracy at a fixed 0.5 threshold. EvalGEN contains only fakes, so a detector that always answers "fake" scores 100%. Accuracy on real photographs (RAISE) drops to 78.40% (l.1138).
- The margins come from single runs, with a checkpoint chosen on test data. The margin over PPL is 0.37 points, with no standard deviation. The reported checkpoint is the best of six, scored on a subset of the GenImage split used for testing (App. C, Table 13). The six span 0.265 points. Table 7 has no control that adds the reconstructions as extra BCE fakes or uses generic augmentation pairs. So its gain cannot be attributed to the reconstruction pair.
Questions for authors
-
Please report ReSCOPE (CLIP), the SigLIP2 linear baseline and BCE-only SigLIP2 on Tables 2–6. If ReSCOPE (CLIP) matches the CLIP-based baselines, or if the margin over BCE-only SigLIP2 holds everywhere, that would mostly address this concern.
-
Please run ReSCOPE, BCE-only training and the variant without consistency-only phases with multiple seeds from a shared initialization and avoid p-hacking by choosing the checkpoints on data disjoint from the GenImage test split.
-
Which model produced the second reconstruction pool (l.899)? A generator other than SD1.4 would break the single-generator claim. Also, does the SigLIP2 configuration put a fake-classification loss on the pairs (l.929–930)?
-
If possible, please add two experiments: the reconstructions as extra BCE fakes without the consistency loss, and the consistency loss on pairs of JPEG or blurred views to verify the efficacy of reconstruction pair.
-
Please report more metrics (such as AUROC, AP, TPR at 1% FPR, and accuracy on real and fake images) on every benchmark. I would like to see if ranking holds without a fixed threshold.
-
Which variant, resolution and schedule does the SigLIP2 linear baseline use, and was it tuned? It scores 85.24% (Table 7), while other works report 92.0% (2509.12995) and 94.5% (2602.01738) under the same protocol. The claimed 12.33-point gain over it (l.073–075) rests on this number, thus needs better clarification.