- Rating
- 2
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a pipeline that locates the AI edit region in a single image. Specifically, it proposes a new training recipe, which additionally uses an unedited image to route the attention of an edited image from a different source. Results show that the proposed method has a slight gain of F1 score and IoU over the base model PE, while achieves a lower FP rate.
Critical strengths
The paper proposes an interesting idea that uses an unedited image to route the attention of an edited image from a different source. This idea sounds counterintuitive, but experiments show that it improves over the base model and achieves an lower FP rate.
Critical weaknesses
- From the reported results, the ordinary PE seems to have a very good base recall and overall F1. The gain achieved by the proposed method is mainly about precision, and is overall marginal considering the slight F1 and IoU improvement.
- The method proposed a counterintuitive training recipe. However, there is no in-depth analysis about why it can work. A paper with good analysis can be still very insightful even when the quantitative gain is not high.
Questions for authors
- What's the criteria to group two distinct parents together? Do they share similar edits despite being very different images?
- What types of edit are present in the training dataset? Common editing types are attribute modification, addition, removal, etc. And can the model generalize to unseen edit type during inference?
- How is the real FP pixel area calculated? I assume it's not normalized to [0, 1], but it also doesn't look like the absolute FP pixel counts according to the visual results in Fig.3.
- What's the specific settings of PE initialization and ordinary PE?
- What does the naming of "modern" and "earlier" mean? Are the images from the modern group being edited by modern AI editor like GPT and QWen, while the editors from the earlier group are not the "modern" models?
- As I understand, the proposed auxiliary attention is only with the data from the modern group, and also only present within a certain number of attention blocks. Is this understanding correct? Are there ablations about 1) when training with modern group only / earlier group only / mixed, 2) which group to use the auxiliary attention and 3) in which attention blocks to trigger the proposed fusion?
- Does recipient mean the image which accepts the attention key and values from the donor image? Is the recipient-donor definition related to the one in the image forensics literature?