- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes RED for generalizable AI-generated image detection. RED extracts CLIP representations of the original image and intermediate reconstructions from a frozen multiscale VQ-VAE. Scale-wise token negative log-likelihoods from a frozen VAR model guide image-dependent stage weighting, followed by cross-stage Transformer aggregation. The method achieves strong average performance across six evaluation collections, including five outside the detector’s training distribution.
Critical strengths
- The design is well motivated: reconstruction features and NLL scores share the same token hierarchy. Ablations support both intermediate states (89.9% → 91.0%) and NLL guidance (91.0% → 92.5%).
- Strong results across six collections: 92.5% average accuracy and 97.5% AP, with additional robustness evaluations.
- Source-only model selection and alternative real-image source controls strengthen the evaluation.
Critical weaknesses
- Table 9 shows reasonably strong overall accuracy, decreasing from 90.7% to 88.5% when ImageNet real images are replaced with Chameleon real images. However, real-image accuracy and false-positive rates are not reported separately, leaving the absolute false-alarm rate on non-ImageNet real images unclear.
- RED applies the same NLL-derived weights before cross-stage attention and again during output pooling. The improvement from 91.0% with uniform weights to 92.5% supports NLL guidance overall, but does not isolate the benefit of applying these weights twice or sharing them between the two locations.
- Equation (4) measures the conditional NLL of newly introduced tokens, whereas Equation (2) constructs reconstruction states containing information accumulated across preceding scales. Although the shared hierarchy establishes stage alignment, the rationale for using an incremental score to weight the entire cumulative visual representation remains insufficiently explained.
Questions for authors
- Could the authors report real-image accuracy (TNR) and false-positive rates at the fixed threshold of 0.5 for ImageNet, Chameleon, LSUN, and MS COCO, together with the generated-image detection rate?
- Could the authors compare input-only weighting, output-only weighting, and weighting at both locations with shared versus separate NLL-based weights, while keeping the remaining architecture fixed?
- Why is per-scale conditional NLL preferred over cumulative NLL for weighting cumulative reconstruction features? Could the authors compare it with token-averaged cumulative NLL using the same source-domain standardization and detection architecture?
Author's Responses
Dear Reviewers,
The authors have provided detailed responses to your concerns.
Please review their responses ASAP and respond to them, to try and resolve concerns before the end of the author-review discussion phase (Nov 18, AoE).
Best, AC