- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper addresses localized AI-edit detection, where only part of a real image is AI-modified. The authors show that existing MetaCLIP2-based probing struggles with such edits because global pooling dilutes local signals. They propose a training-free windowed probing method using multi-scale crops and maximum-score aggregation. They also investigate patch-level probing and aggregation strategies. Experiments across four benchmarks show improvements in some settings but inconsistent gains overall.
Critical strengths
- The paper addresses the practical challenge of detecting localized AI edits, where existing detectors often struggle because most of the image remains authentic. This is an increasingly relevant problem given the growing use of AI-based image editing tools.
- The proposed windowed probing method is simple and computationally efficient. It builds on an existing detector without requiring additional training or modifying the backbone, making it easy to reproduce and apply.
Critical weaknesses
- The results on localized edits don’t really support the main claim. On FLUX-Kontext the gain is small and not significant (0.928 to 0.937), and on BR-Gen windowed scoring is actually worse (0.850 to 0.788). The abstract and TL;DR also overstate things: 0.850 on BR-Gen is the pooled baseline, and patch probing needs training and is close to chance.
- The aggregation-geometry principle feels circular. The paper decides that evidence is “concentrated” because windowed wins, and then uses that as proof of the principle. On BR-Gen, where masks are available, pooled wins even for very small edits. Also, the dilution analysis uses patches the probe scores as fake, not the real edited regions, and real images show the same pattern (Table 16).
- The novelty is limited. The method is basically four center crops of an existing probe, similar to multi-crop test-time augmentation. Since crops are resized up, the gain might come from higher resolution and not from spatial isolation. Almost everything is also tested on one probe (MetaCLIP2), so it’s hard to call this a general principle.
Questions for authors
- Can spatial concentration be measured independently (e.g., from edit masks) to predict the better aggregation before seeing results? Why does pooled scoring win on BR-Gen even for edits under 5% of the image?
- What does the AIGI-Now semantic split contain, and does the windowed gain hold when measured with AUC instead of accuracy?
- How much of the gain comes from upsampling the crops rather than isolating the edit? For example, how does full-image evaluation at higher resolution compare?