- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies whether AI-generated image detectors can use one score orientation and threshold across different sources, generators, and processing conditions. It develops a reconstruction response , response-survival analyses, and shared-decision criteria, and evaluates 58 detectors across 384 conditions. The deployment question is relevant, and the audit provides useful evidence. However, the additional theoretical insight, attribution of performance loss, and reproducibility require further support.
Critical strengths
- The paper evaluates a practical deployment requirement: maintaining one operating rule across heterogeneous conditions.
- Independent calibration and confirmation, exhaustive threshold evaluation, and simultaneous CDF bounds strengthen the shared-rule conclusions.
- The matched comparison covers many recent detectors and reports both failures and methods supporting useful shared operating points.
Critical weaknesses
-
The theoretical analysis does not sufficiently explain the deployment failures. The threshold-intersection criterion largely formalizes feasibility, and the confidence bounds use standard tools. The more specific analysis in Theorem 3.1 and Figure 3 concerns mean separation, but its connection to the observed shared-threshold incompatibility is not demonstrated.
-
The detector comparison lacks technical interpretation. Figure 5 and Table 10 report performance differences without linking them to training procedures, representations, augmentations, or score construction. Local discrimination loss is also not separated from direction and threshold incompatibility. A focused technical analysis is needed to explain why representative methods succeed or fail.
-
Essential implementation details are missing. Appendix C.1 does not identify the model and checkpoint implementing , the image-sizing rules, or their order relative to processing . Appendix C.2 provides a baseline-checkpoint selection policy but lacks identifiers that uniquely specify the evaluated checkpoints.
Questions for authors
- Could the authors provide a concrete example showing how the response-survival analysis explains an observed shared-rule failure, and clarify which conclusions are restricted to mean separation?
- Could the authors use existing scores to compare representative strong and weak detectors, separate local discrimination loss from direction and threshold incompatibility, and relate these patterns to specific design choices?
- Could the authors specify the implementation and checkpoint of , the image-sizing and processing order, and the checkpoint identifiers used for the public detectors?