- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates how factual inconsistencies can help detect AI-generated images that look realistic. For example, an image may show a product with features that the real version does not have. The paper calls this knowledge-intensive detection and introduces: (i) a task formulation to detect knowledge inconsistencies; (ii) K-AIGI-Bench with about 1,000 images and (iii) K-VERA, a training-free multi-agent framework that uses several vision language agents without additional task-specific training. Starting from an image, it identifies the scene and objects, formulates questions about the depicted details and retrieves webpages and reference images to check them. It then checks whether the sources support the findings and produces a judgment with an explanation and supporting references. The paper evaluates detection accuracy and explanation quality using ablations and a human evaluation of explanations. K-VERA is reported to perform better than the compared detectors. Combining it with an existing pixel-level detector also improves detection on three additional benchmarks. This shows the benefits of using factual verification alongside conventional detection cues.
Critical strengths
-
The paper introduces K-AIGI-Bench, a new benchmark to detect factual errors in realistic images. K-AIGI-Bench covers eight knowledge topics and records the intended error in each generated image. This enables one to test if a detector identifies the actual inconsistency rather than simply testing if the real/fake label is right.
-
The complete system performs well and gives explanations that can be checked. Combining it with DDA also improves detection over either method alone on all three external benchmarks.
Critical weaknesses
-
K-VERA uses separate agents to perform web searches, factual checks and visual error detection. The paper does not compare it with a single model using the same search tools and processing budget. As a result, the paper does not show that the proposed workflow is needed.
-
On the external benchmarks, the paper does not separate detections based on factual inconsistencies from those based on visual flaws. The results show that the complete system works but not that the proposed factual checking contributes outside the constructed benchmark.
Questions for authors
-
How does K-VERA compare with a single agent using the same underlying model, search tools and a processing budget? This would show that dividing the checking process among several agents improves detection beyond providing access to external evidence.
-
On the external benchmarks, how many correct fake image detections are attributed to factual inconsistencies and how many to visual flaws? Have the claimed factual inconsistencies been checked against the images and cited sources? This would show that gains are due to factual checking.
-
Have human reviewers also checked whether the factual errors are visible in the images and supported by the cited webpages or reference images? If so, how often were both conditions satisfied?
4 comments
Response to authors
Thank you for the new results. Was the single agent given the same processing budget as K-VERA?
An image can be fake even if K-VERA gives the wrong reason. On the external benchmarks, did anyone check the images to confirm that the factual errors reported by K-VERA were actually errors
Thank you for the follow-up questions.
Q1. Processing budget of the single agent. The single agent (Qwen3.7-Plus w/ tools) was allowed up to 32 tool-use rounds (Sec. 5.1, L361–363). Default K-VERA allows up to 48 rounds across its tool-enabled roles. Importantly, with a total budget of 24 rounds, i.e., at most 4 tool-use rounds per tool-enabled agent and at most 4 Actors, K-VERA still achieves 0.753 balanced accuracy, outperforming the single agent with up to 32 rounds (0.739) (Table 7, L786; Table 1, L337).
Q2. Verification of knowledge inconsistencies on the external benchmarks. Yes. We manually inspected 50 images from the in-the-wild benchmarks that are labeled fake and for which K-VERA returns "Knowledge-Inconsistent". In every one of them, we confirmed at least one knowledge inconsistency explicitly identified by K-VERA. We have added two such examples to the appendix (Appendix M, L1474–1478, Fig. 16).
Response to authors from 1QVT
Thank you for the clarification. My main concerns have been addressed.
We thank the reviewer for the helpful comments. We address your concerns below.
Q1. Single agent with the same model and tools. We added Qwen3.7-Plus w/ tools to Table 1 (L337, L363–365): a single agent with the same backbone and all five tools. It reaches 0.739 BAcc, between the tool-free backbone (0.685) and K-VERA (0.754). K-VERA also produces clearly better explanations: GT-KI Recall 0.562 vs. 0.528, and EQS 2.17/2.71/2.82 vs. 1.83/2.64/2.65 (L398–403). Both external evidence and the multi-agent decomposition therefore contribute. Results with three further backbones are in Table 9 (Appendix D, L820–833).
Q2. Factual versus visual detections on external benchmarks. Table 14 (Appendix M, L1462–1476) gives the verdict distribution.
Many AIGI verdicts are themselves grounded in web evidence rather than visual flaws (Appendix M, Fig. 15): closely related images found online that are explicitly labeled as AI-generated, or generator watermarks. On K-AIGI-Bench, where the ground-truth inconsistency is known, GT-KI Recall and EQS check whether the claimed issue is correct, visible in the image, and supported by the cited evidence. For EQS, the evaluators inspect the cited webpages and images (Table 1; Appendix H.1).
Q3. Human verification. In the user study, participants were asked to verify whether each claimed inconsistency is actually present in the image and factually correct, using web search when needed (Sec. 5.5, L471–473). For fairness across methods, K-VERA's reference webpages and images were withheld. Whether the cited sources support each claim is evaluated by the EQS evaluators, who inspect these sources directly (Appendix H.1).
Please note that we have updated the paper. In the revised PDF, revised text is shown in blue; for newly added sections, only the section titles are blue. Line numbers here refer to the revised PDF.