- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper presents an investigation of the limits of the detection of generated images. It uses "image abstractions", which are basically simple image augmentations like blurring, noising or down sampling, on which it trains detector networks to show that generated images are still detectable even under strong "abstractions".
Critical strengths
The paper addresses the timely and important question whether the distributions of generated images already match the training data or further improvement in generation methods is needed.
Critical weaknesses
The paper suffers from several severe problems, including readability, completeness of related work, ignoring SOTA generators, over-claiming, very low novelty and a questionable experiment design.
The title suggest an in-depth statistical analysis of complex image distributions - However, what the reader gets is simple off-the-shelf binary classification of images under augmentations.
The paper is hard to read, not because it is so complicated - rather the opposite: it stretches trivialities in lengthy passages that hardly add new information for the reader.
The related work section is rather outdated, referring to mostly older works. This is also the case for the selected generator models which are quite old: the newest is from 2023. This results in low-resolution experiments only.
The novelty of the insights provided is very low, as the authors write them self: it is basically standard procedure to use (the same) augmentations in benchmarks to test the robustness. The claimed novelty come from questionable setup: trying to overcome the separation of OOD data by the application of (mostly) linear augmentations is doomed to fail in any case. This is what the experiments actually show.
Questions for authors
None. I really would be interested in an in-depth statistical analysis of image-distributions from modern generative models, showing where and why they fail(?) to match real data. However, this would require a completely different approach..