- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
Recent methods can detect AI-generated images and explain their decisions, but their explanations are not always supported by the image or based on meaningful forensic evidence. The paper introduces ClaimEval, which breaks explanations into the smallest independently verifiable atomic claims. It assesses language quality, checks whether the claims are supported by the image, groups related claims, and evaluates their value as forensic evidence. The authors build an expert-reviewed dataset and train an evaluator using supervised fine-tuning followed by Structure-Guided GRPO. Comparisons with the evaluated baselines show better agreement with expert judgments, while experiments removing individual reward components help establish their contributions.
Critical strengths
- I found the distinction between visual faithfulness and AI generation detection very useful. Grouping related claims also matter for combined evidence, dependencies and overlapping evidence.
- The experiments give convincing support for the approach. The authors compare against models following the same evaluation structure, check agreement with independent expert ratings, and test performance on unseen image and explanation sources. The reward ablations help show what the training components contribute.
Critical weaknesses
The main idea is clear, but I found myself going back and forth between the main text and appendix to follow some important details. The annotation rules, full reward definitions, and calculations behind the final explanation score are spread across the appendix. A compact summary of the key definitions and scoring rules in the main text would make the method easier to follow.
Questions for authors
Could you include a compact summary of the key annotation rules, training rewards, and final scoring calculations in the main text? A small table would help readers follow how these parts fit together without repeatedly referring to the appendix.