- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The authors evaluate five MLLMs on 3,500 generated face images from seven sources and 500 real photographs. They compare detection across developers, measure the effects of provenance processing, and check whether judgments repeat and explanations match the images. They find no consistent advantage for images from the same developer. Removing C2PA records has no significant overall effect after correcting for multiple comparisons. MarkNull removes SynthID and changes detection rates, although it also changes the images. Repeated calls on 200 generated images often produce different labels. Human reviewers find that most observations in explanations of correct detections match the images. The study also includes uncertainty estimates and a processing control using real photographs.
Critical strengths
-
All five detectors judge the same images, the generators receive the same prompts, and each source contributes the same number of images. The shared real photographs also allow a fair comparison of false positives. Section 4.1 reports that detection rates for pairs from the same developer are only 0.36 percentage points lower than for the other pairs. The 95% confidence interval runs from -2.74 to 1.92 percentage points. This supports the conclusion that there is no consistent advantage across the models tested.
-
The study identifies problems that a single accuracy score would miss. Across the 200 original images from the two sources used for repeated evaluation, 30.3% of detector and image groups change labels across three calls. Table 4 also shows that Seed repeats the wrong label on 99% of those images. The provenance checks and real-photograph control add another useful finding. Processing can change judgments even on images that started as real photographs. These results matter for anyone considering MLLMs as authenticity judges.
Critical weaknesses
-
The provenance results need to be read as effects of the processing procedure. MarkNull changes the pixels as well as removing the watermark. Table 14 shows that it raises FAKE rates on real photographs by 4.33 to 56.67 percentage points across the five detectors. The experiment therefore does not isolate reliance on SynthID. Likewise, the C2PA result depends on whether the answering model receives the credentials, which remains unknown in Appendix C.2. The authors acknowledge these limits. They restrict what can be concluded about provenance use, but do not invalidate the measured changes in detection.
-
The human study in Section 4.3 and Appendix F.7 covers only explanations of correct detections. Reviewers find that 259 of 288 observations match the image. This is useful evidence about those explanations, but it should not be generalized to wrong answers or taken to show which cues caused a decision. The paper states this restriction clearly. I see it as a limit on the coverage of the study rather than a flaw in the reported result.
Questions for authors
- Is there any evidence that C2PA credentials reach the models through the endpoints used for detection? This would help interpret the lack of an overall effect after removal.
- How were the 100 explanations selected within each detector and source? Was selection random among eligible correct detections? Appendix F.7 describes the quotas and says selection preceded quality review, but the choice within each group is less clear.