- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes EvoGuard, an extensible agentic framework for AI-generated image detection that integrates heterogeneous detectors through a multimodal large language model. It introduces capability-aware tool selection and dynamic orchestration to adaptively invoke detectors, analyze their outputs, and synthesize evidence for final predictions. The agent is trained using GRPO with only image-level binary labels, avoiding the need for fine-grained reasoning annotations. Experiments on three in-the-wild benchmarks demonstrate competitive detection performance, improved balance between real and fake image accuracy.
Critical strengths
1. An interesting and practical framework for heterogeneous detector integration.
The paper presents an interesting agentic framework that reformulates AI-generated image detection as evidence synthesis over heterogeneous off-the-shelf detectors, rather than developing another standalone detector. The combination of capability-aware tool profiles and dynamic orchestration provides a flexible approach to integrating detectors with different architectures and output formats. This is a meaningful direction for addressing the limitations of individual detectors in evolving real-world scenarios.
2. Promising extensibility with relatively low training annotation requirements.
A notable advantage of EvoGuard is its ability to incorporate additional detectors without retraining the agent. The experiments on training-free tool extension support this practical benefit, which is particularly relevant given the rapid evolution of generative models. In addition, the GRPO-based training strategy relies on image-level binary labels rather than expensive fine-grained reasoning annotations, making the framework potentially easier to adapt and maintain as new detection methods become available.
Critical weaknesses
While EvoGuard demonstrates promising performance by integrating heterogeneous detectors, the current experiments do not sufficiently disentangle the benefits of detector complementarity from those of learned agentic decision-making. In Table 3, the select one tool variant achieves an average B-Acc of 92.00%, nearly identical to MIRROR alone (91.97%), raising questions about whether the agent genuinely learns sample-adaptive tool selection or predominantly relies on the strongest detector. More importantly, the one round variant, which allows more flexible tool selection, consistently underperforms select one tool across all three benchmarks (90.67% vs. 92.00% average B-Acc). Although the full framework improves performance to 92.70%, the paper does not adequately explain these observations or demonstrate how the learned orchestration strategy effectively selects and integrates complementary evidence. Consequently, the current evidence remains insufficient to fully substantiate the claimed advantages of intelligent tool selection and multi-round reasoning over simpler detector selection and integration strategies.
Questions for authors
1. Does the agent genuinely learn sample-adaptive tool selection?
The select one tool variant performs almost identically to MIRROR alone. Could the authors report the distribution of first-round tool selections across different image categories? In particular, it would be valuable to examine whether the agent frequently defaults to MIRROR or selects alternative detectors when they are more reliable for specific samples. Comparing the accuracy of the selected detectors against MIRROR on the same samples would provide more direct evidence of adaptive tool selection.
2. Why does flexible single-round tool selection underperform selecting a single tool?
An unexpected observation in Table 3 is that one round consistently performs worse than select one tool across all three benchmarks, despite allowing more flexible tool selection. Could the authors explain this degradation? Does invoking additional detectors introduce conflicting or misleading evidence, or does the limitation arise from the agent's ability to integrate multiple outputs within a single round? It would also be helpful to clarify how subsequent reasoning rounds in the full EvoGuard framework mitigate this issue.
3. Does dynamic orchestration adapt to sample difficulty and effectively resolve detector conflicts?
Figure 4 reports the overall distributions of interaction rounds and tool calls, but does not reveal how these behaviors relate to sample difficulty. Could the authors divide the evaluation samples according to the number of constituent detectors that correctly classify them (0–4) and report the corresponding termination rates, average tool calls, and final accuracy? For samples correctly classified by all four detectors, does the agent tend to terminate earlier with fewer tool invocations? Conversely, for challenging samples where three detectors are incorrect and only one is correct, can the agent identify and prioritize the reliable detector? Representative successful and unsuccessful decision trajectories would provide valuable insights into the learned orchestration behavior.
4. How does EvoGuard balance detection performance against inference cost?
EvoGuard improves the average B-Acc over MIRROR by 0.73 percentage points (92.70% vs. 91.97%), while requiring approximately 6.7 times the inference time on LOKI (17m35s vs. 2m37s). Although the improvements in class balance and extensibility are valuable, could the authors further clarify the practical benefits of this additional computational cost? A performance–cost analysis under different tool-call budgets, particularly against MIRROR and simpler sequential tool invocation strategies, would help demonstrate the efficiency of the proposed framework.
8 comments
Respond to Reviewer XfTH (2/6)
Question 2: Why does "single round" underperform "select one tool", and how do later rounds help?
We thank the reviewer for this careful observation. To examine the two explanations raised by the reviewer, we grouped the test images by the agreement of the four detectors and compared the two variants and the full EvoGuard on the same images.
(1) Additional detectors are not harmful when they provide a majority. On images where the detectors split 3–1 (3 detectors hold the same judgement), the single-round variant performs on par with "select one tool" (B-Acc averaged over the three benchmarks: 0.868 vs. 0.869). It follows the majority on 88% of these images. The single-round variant is therefore able to integrate multiple outputs.
(2) The single-round variant falls behind on ties. On images where the detectors split 2–2, no majority exists, and the single-round variant is worse (0.6904 vs. 0.7708). Here it sides against MIRROR on 104 images, and these decisions are correct only 36% of the time. "Select one tool" almost always calls MIRROR alone, so it never sees the conflict. The difficulty is thus contradictory evidence, specifically evenly split evidence that a single reasoning step arbitrates poorly. The single-round constraint makes such conflicts frequent, because the agent must request all the tools it wants in that single round (3.5 calls per image on average, including the weakest detectors).
(3) How later rounds mitigate this. The full EvoGuard does not have to commit to its tools in advance. It sees the first outputs and then decides whether more evidence is needed (2.4 calls per image on average). It improves over the single-round variant in both conflict groups: from 0.8676 to 0.8858 on 3–1 splits and from 0.6904 to 0.7713 on ties. Its tie-breaking is also more reliable: when EvoGuard sides against MIRROR on a tie, it is correct 58% of the time, compared with 36% for the single-round variant, and it does so less often (74 vs. 104 images).
(4) What this ablation says about the design. EvoGuard is built around multi-round orchestration: the agent gathers evidence step by step and decides its next action based on what it has seen. The single-round variant keeps the same tools and reasoning but removes this loop. Without the loop, the extra detectors bring no gain on majority cases and hurt on ties, so the net result is below simply routing to the single most reliable detector (0.9067 vs. 0.9200). With the loop, the same detectors yield a gain over both variants (0.9270). Additional detectors therefore pay off only when the agent can act on their outputs, which is the motivation for our multi-round design.
Respond to Reviewer XfTH (3/6)
Quesiton 3: How does the agent's behavior relate to sample difficulty?
We grouped the test images of all three benchmarks by the number of detectors that classify them correctly (k = 0–4 correct detectors) and report the requested statistics for the 4-tool EvoGuard.
Table R3-2.
| k (correct detectors) | Images | Terminates after round 1 | Avg. tool calls | EvoGuard acc. | MIRROR acc. | Majority vote acc. (ties → MIRROR) |
|---|---|---|---|---|---|---|
| 0 | 57 | 57.9% | 2.23 | 0% | 0% | 0% |
| 1 | 326 | 50.3% | 2.37 | 50.0% | 42.3% | 0% |
| 2 | 920 | 48.4% | 2.30 | 83.8% | 82.6% | 82.6% |
| 3 | 1,526 | 46.4% | 2.39 | 95.3% | 94.2% | 100% |
| 4 | 2,235 | 41.7% | 2.40 | 100.0% | 100% | 100% |
| All | 5,064 | 45.1% | 2.38 | 91.3% | 90.3% | 89.3% |
EvoGuard's advantage lies in the hard groups. For majority voting, we break 2–2 ties with MIRROR, the most accurate detector. Majority voting is always wrong when only one detector is right (k = 1), and on ties (k = 2) it gives the same answers as MIRROR (82.6%). EvoGuard reaches 50.0% and 83.8% in these two groups, and it beats the strongest single detector in every group where the detectors disagree. Overall, it reaches 91.3%, compared with 89.3% for majority voting and 90.3% for MIRROR.
(2) Does the agent stop earlier on easy images? The agent cannot know k (the number of "right" detectors), because k depends on the ground truth. What it can see is whether the outputs it has received so far agree, and its decision to stop follows this signal. When it has seen at least two outputs and still has unused tools, it calls more tools in 43.0% of cases if the outputs conflict, but in only 28.5% if they agree. Agreement among the detectors called so far is not the same as k, so the average number of calls is similar across groups (2.2–2.4), while accuracy differs greatly.
(3) Why do hard images end after the first round more often? In the table, 57.9% of the images at k = 0 end after the first round, compared with 41.7% at k = 4. This does not mean that the agent uses less evidence on hard images. On hard images, it more often calls several detectors at once in its first round (51% of the images at k = 0 and 43% at k = 1, vs. 36% at k = 4) and then usually answers. On easy images, it more often starts with one detector and adds others one at a time, which takes more rounds.
(4) When three detectors are wrong and one is right, can the agent find the right one? When three detectors agree and one disagrees, we call the one that disagrees the minority detector. Following it only helps if the agent can tell when it is right. We therefore compare two cases: the minority detector is right (k = 1) or wrong (k = 3).
Table R3-3.
| Minority detector | Minority right (k = 1): images / % followed | Minority wrong (k = 3): images / % followed |
|---|---|---|
| Any | 326 / 50.0% | 1,526 / 4.7% |
| MIRROR | 138 / 84.8% | 88 / 61.4% |
| FakeVLM | 136 / 33.8% | 477 / 3.4% |
| Effort or AIDE | 52 / 0% | 961 / 0.1% |
“% followed” is the share of these images on which EvoGuard’s final answer agrees with the minority detector, whether or not it was called. Higher is better on the left, lower on the right.
The agent follows the minority detector about ten times more often when it is right than when it is wrong (50.0% vs. 4.7%). This holds at two levels. First, the agent trusts each detector according to how often that detector is right when it is in the minority. MIRROR is right in 61% of these cases (138 of 226), and the agent usually follows it. Effort and AIDE are right in only 5% of these cases (52 of 1,013), and the agent does not follow them, which is the better choice. Second, the agent also tells cases apart for the same detector. It follows FakeVLM in 33.8% of the images where FakeVLM is in the minority and right, but in only 3.4% of those where it is in the minority and wrong.
(5) Representative trajectories. We describe 6 LOKI trajectories: successes at k = 1 to 4, and failures at k = 0 to 1. In each case, the agent first reads the image tags and uses the tool profiles to choose which detectors to call. After each output, it decides whether to call more detectors or to answer.
Respond to Reviewer XfTH (1/6)
We thank the reviewer for the detailed review and for recognizing EvoGuard as an interesting and practical framework for integrating heterogeneous detectors, with promising train-free extensibility and low annotation requirements. We address each question below.
Question 1: First-round tool selection and comparison with MIRROR on the same images
Below we report the requested statistics for the 4-tool EvoGuard and the "select one tool" variant on all test images.
(1) Why the "select one tool" variant matches MIRROR. With a single call, the agent has to pick the detector it expects to be most reliable for the image, before seeing any tool output. In our tool pool, MIRROR is the most reliable detector in almost every category. Across the 18 (benchmark, content category) groups with at least 20 images, MIRROR is the most accurate detector in 13 and within 3 points of the best in 4 others. Accordingly, the variant selects MIRROR for 95.4% of images. For the remaining 4.6%, it selects Effort or FakeVLM, and on these same images the selected detector is about as accurate as MIRROR (91.5% vs. 93.6%). This explains why its B-Acc (0.9200) matches MIRROR's (0.9197). What a single call cannot do is correct the chosen detector when it is wrong, since no other evidence is available. This is what EvoGuard's multiple turns add, as shown in (3).
(2) First-round selection of EvoGuard by category. The table shows the first tool called by EvoGuard for each content category with at least 100 images, with the variant's MIRROR rate for reference.
Table R3-1.
EvoGuard starts with MIRROR on 75.9% of images, compared with 95.4% for the variant, and its first call varies strongly with the category. For example, it starts with Effort on 99% of satellite images and with FakeVLM on 75% of LOKI animal images and 96% of CF anime images. This is not a fixed default either. In the 3-tool setting, where no single tool dominates, the first call is split between FakeVLM and Effort by category (e.g., FakeVLM for 88% of LOKI text screenshots and Effort for all LOKI satellite images). In the multi-turn setting, however, the first call is an entry point rather than the final choice: when EvoGuard starts with another tool, it still consults MIRROR afterwards on 98% of these images. The more informative comparison with MIRROR is therefore at the level of the final decision.
(3) Comparison with MIRROR on the same images.
(4) Summary. We agree that MIRROR is EvoGuard's main source of evidence in the 4-tool setting. This is warranted, since MIRROR is the most reliable detector in nearly every category, and it leaves limited headroom: MIRROR alone is correct on 90.3% of the images. Within this headroom, EvoGuard's gains come from deciding when to override MIRROR, which a single committed choice cannot do. As a result, EvoGuard outperforms the select-one variant on all three benchmarks, and achieves a much better balance between real images and fake images.