- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper argues that conventional real-vs-generated endpoint comparisons confound multiple stages of image generation. A detector may respond strongly to a generator's codec reconstruction and in the opposite direction to subsequent image-to-image generation, causing the final endpoint difference to conceal both effects. The paper formulates detector scores using a potential-outcomes causal framework and constructs source-matched interventions, where each source image is observed unchanged, after each generator's codec round trip, and after four increasing image-to-image generation doses. Contrasts identify codec, cross-generator effects, etc.
Critical strengths
The paper identifies a genuine weakness of standard AI image detector evaluation where the same endpoint detector score can arise from very different generative pathways. Experimental design is also strong. The paper also formally establishes which contrasts are recoverable, and proves the minimal coordinate requirements. Evaluation is also diverse.
Critical weaknesses
Generalization is limited by the particular path structure (the main theory and experiment model source → codec → image-to-image generation), even though modern synthesis pipelines can involve upscaling, editing, postprocessing, etc. that are not covered by the central experiment.
Questions for authors
Relevant to the weakness described above, but how would the claim change with other paths of image generation?