- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The authors study the problem of image-editing detection and attribution and evaluate on five models across six datasets. The author pioneerly addresses this task. However, some critical issues on fairness and reliability in experimental comparison exist and need clarifying.
Critical strengths
- A clear discrimination between editing detection given base-suspicious paired image, and attribution of editing model.
- A method of reference value simultaneously reporting detection and attribution, while attempting cross-model evaluation.
Critical weaknesses
- BLIP-2 is used to describe base and suspicious, which are then put together into proxy prompt, during which the target image semantics can be leaked into the re-editing pipeline.
- The reliability of ``dissimilarity/variety/stability'' is questionable given that only 50/100/2 positive/negative samples/editting models are validated on.
Questions for authors
- How does the detection/attribution accuracy change when using the original raw prompt rather than BLIP-2 proxy prompt?
- When totally unseen models are added into closed-set candidate models, is the system output
Un-edited'' orUnseen editing models''?