- Rating
- 4(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper reveals a fundamental limitation in the standard evaluation metrics used for generative image models, showing that they cannot distinguish between two distinct sources of image flaws: poor inliers and hallucinations. Poor inliers are images that preserve the semantic properties of the target distribution but are rendered poorly, whereas hallucinations are images that violate those semantic properties while remaining visually plausible. The authors mathematically formulate these two sources of error by modeling the generated distribution as a mixture of degraded inliers and hallucinations, which introduces a parameter measuring the degradation level of the inliers and another parameter representing the fraction of hallucinations.
The authors show that standard feature extractors fail to represent semantic deviations and that standard metrics, which rely on averaging scores over all samples, dilute and fail to identify these errors. Consequently, a single evaluation score is consistent with many different combinations of inlier degradation and hallucination rates. This means models cannot be properly compared from a single score point, but rather require analyzing how the metric scores change across varying levels of degradation and hallucination to understand the exchanges made by the metric.
To validate their theoretical framework, the authors conduct controlled experiments by manually varying the levels of inlier degradation and hallucination, and they perform evaluations on real generative models. In both setups, standard evaluation metrics fail to distinguish between the two errors, often failing to penalize or even rewarding hallucinations, which ultimately leads to an incorrect ranking of different generative models. Finally, the authors propose a new measure based on a tail statistic that averages only the most atypical samples. This method successfully separates the two failure modes and provides a reliable way to detect hallucinations and rank models correctly.
Critical strengths
The paper is well written, organized, and clear.
-
The paper sheds light on two distinct sources of errors and their mixture, providing a clear and mathematically rigorous formulation of the combination of hallucinations and poor inliers. This provides a clean and elegant structure to the problem upon which the research community can easily build.
-
The authors provide a theoretical analysis of the limits of standard metrics, using total variation distance to bound the score gap and the score drift. This mathematical proof elegantly shows how the feature extractor itself limits the signal before any scorer is even chosen, which represents a nice theoretical contribution.
-
The experiments adequately demonstrate the described phenomenon and provide strong support for the theory presented. The authors validate their claims using both controlled simulations and samples from real generative models, ensuring that the theoretical predictions translate to practical scenarios.
-
The authors validate their theoretical findings and rankings with human evaluation, proving that the proposed tail statistic aligns with human perception and successfully corrects the ranking inversions caused by standard evaluation metrics.
-
Most importantly, the authors provide a new evaluation measure based on a tail statistic that provides a viable remedy to the discussed problem. This successfully turns a theoretical insight into a highly practical tool for the community.
Critical weaknesses
-
The proposed metric is highly sensitive to the choice of the tail fraction threshold, and the paper lacks an automated or systematic method to select this parameter.
-
The proposed tail statistic does not address the fundamental representation bottleneck of existing feature extractors. The authors mathematically prove and empirically demonstrate that if the underlying feature representations do not capture a semantic deviation, no anomaly detector or tail statistic can recover it. As a result, well rendered semantic hallucinations still go completely unnoticed, meaning the proposed solution remains highly dependent on the quality of existing feature representations.
-
The paper lacks a dedicated limitations section. A detailed discussion outlining the boundary conditions of the proposed tail statistic, such as its sensitivity to sample size, behavior under severe class imbalance, or performance on conditional image generation tasks, is highly important for a complete scientific contribution.
Questions for authors
-
Can the theoretical framework and the proposed tail statistic presented in this work be extended beyond evaluation to active training paradigms, such as serving as reward signals in reinforcement learning post training? A brief discussion on how the metric could guide model training would highly enrich the paper.
-
The paper models poor inliers and hallucinations as two distinct and independent sources of error. However, is it possible that these failure modes are fundamentally coupled? For instance, when a generative model lacks the precise semantic information required for perfect fidelity, it may face a trade-off where it must either output a blurred or degraded image that remains in-distribution, or alternatively produce a sharp, visually plausible image that contains a hallucination. This suggests a potential latent variable or shared underlying cause explaining both error types, and the authors are encouraged to discuss this relationship
3 comments
Follow-up on our response
Dear Reviewer 4VPB,
Thank you for your positive and constructive review. As the discussion period ends on November 18, we wanted to check whether our response on the choice of the tail fraction, the limitations of the analysis, and the possible coupling between the two failure modes answered your questions. We are happy to provide any further clarification.
I thank the authors for their clarifications and the changes made for the manuscript, addressing most of my concerns. I enjoy reading the paper and learning from it. I believe the paper provides a good contribution to the research community. Hence, I raised my score.
Response to reviewer 4VPB
We thank the reviewer for the comments. We have uploaded a revised version of the paper and answer the questions below.
Weaknesses 1–3 (tail fraction, representation bottleneck, limitations). All three weaknesses concern the tail statistic, so we first clarify its role. We do not propose the tail as a metric. It demonstrates what our analysis predicts for the aggregation stage. Once the extractor and the scorer rank hallucinations above the inliers, averaging only the tail of the scores removes the dilution of the mean (Section 5.1.3). On trained generators, the tail then reverses the ranking of the standard metrics, as annotators confirm (Section 5.2.2). The limits the reviewer identifies follow from our analysis, and they are why we present the tail as a demonstration.
We would be grateful if the reviewer could read the new Section 6, which we believe addresses these points directly.
Q1. Using the metric as a reward signal. Using such a metric during training lies beyond the scope of this paper, but our analysis has a direct implication. A metric that meets the requirements of the new Section 6 would separate the hallucination rate from inlier quality, and could therefore serve as a training signal that reduces hallucinations without trading them for inlier quality. The current standard metrics cannot serve this role, since a model could improve its score by improving its inliers while hallucinating more (Prop. 1).
Q2. Coupling of the two failures. Whether the two failures are coupled is a question about how generators produce them, which our paper does not study; our analysis concerns how evaluation metrics respond to them. We treat poor inliers and hallucinations as distinct kinds of output, not as products of independent causes. Eq. 2 describes the generated distribution, not the process that produces its errors. It splits the generated samples by semantics into an inlier and a hallucination component. α and δ vary independently only in the sense that α is a mixture weight and δ moves the inlier component, so each can be set without changing the other. This is what lets us measure how a metric responds to hallucinations at fixed inlier quality.
Studying this coupling would be a different analysis, and one that depends on ours. Suppose we ask whether a training or sampling choice improves inlier quality, lowers the hallucination rate, or trades one for the other. Answering that requires measuring the two separately, which the standard metrics cannot do (Prop. 1). Such a study would therefore need metrics that decouple the two failures, along the requirements of Section 6.