- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes EAGLE, an MLLM-based evaluator for AI-generated images. It introduces cross-modal and visual evidence anchors and uses shared and anchor-specific latent queries to extract evidence for different assessment criteria. Experiments show strong within-dataset and cross-dataset performance across several image assessment tasks.
Critical strengths
The paper provides a clear and practical framework for modeling task-dependent evidence in MLLM judges. The empirical results are strong, particularly in cross-dataset evaluation, and the ablations support the main architectural choices.
Critical weaknesses
The two evidence-anchor categories are manually defined and may oversimplify assessment criteria that depend on mixed evidence. In addition, experiments use only one MLLM backbone, making it unclear how well the proposed design generalizes across different MLLM architectures.
Questions for authors
How sensitive is EAGLE to the choice of MLLM backbone? Have the authors tested whether the same evidence-anchor structure transfers to another MLLM family?
3 comments
Thank your comment. I keep my score.
Thank you for your positive assessment and continued support of our work. We sincerely appreciate your time and constructive feedback.
Author Response to Reviewer sY5N
We sincerely appreciate your positive comments and insightful suggestions. Below, we provide our point-by-point responses to each of your comments.
Response: We agree that some assessment criteria may depend on multiple types of evidence. The cross-modal and visual anchors are therefore not intended to form an exhaustive or mutually exclusive taxonomy, but rather to represent two common forms of dominant evidence dependence in image assessment.
In EAGLE, shared queries allow information to be reused across criteria, while anchor-specific queries emphasize the evidence most relevant to each judgment. This design can therefore accommodate mixed evidence while still providing a structured inductive bias for criterion-specific grounding, rather than enforcing a hard separation between evidence types. We will clarify this scope in the revised manuscript.
Response: EAGLE is not highly sensitive to the choice of MLLM backbone. To verify this, we instantiate the same evidence-anchor structure on InternVL3-8B without changing the overall training design.
Table: Results are reported as (SRCC, PLCC).
Under standard evaluation, EAGLE with InternVL3-8B performs comparably to or better than the Qwen2.5-VL-7B version on most metrics. Under cross-dataset evaluation, the two backbones remain closely comparable, with only small variations across settings. Notably, although Qwen2.5-VL-7B and InternVL3-8B exhibit substantially different zero-shot behavior, applying EAGLE brings both backbones to a similar strong performance level.
These results show that the proposed evidence-anchor design is not tied to Qwen2.5-VL and can be transferred effectively to a different MLLM family. We will include this additional backbone evaluation in the revised manuscript.