- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
Automatic evaluation of faithfulness increasingly relies on a large language model acting as a judge, yet the most reliable judges are proprietary frontier models. Their per-call cost, rate limits, and off-premises inference, however, make them ill-suited to the continuous, high-throughput monitoring that benchmarking and production use demand. In this work we investigate three fundamental questions: whether a panel of cheap open-weight judges (4–9B parameters) can be aggregated to stand in for a frontier one, what the substitution sacrifices in agreement (Cohen's ) and accuracy, and when it is worth making. To address them, we propose RAIM, an aggregation scheme robust to the members' correlated errors, which couples: ( ) a cross-fitted stacked logistic regression that fits the members' weights jointly, therefore penalising weaker judges echoing a stronger one; and ( ) an admissibility test that, read from the members' own outputs, identifies a regime in which aggregating them improves on their best member and stays within reach of the frontier judge. We instantiate RAIM under ten judges drawn from disjoint families and we measure the substitution across eight faithfulness benchmarks. Read as paired differences against Claude Sonnet, the substitution clearly improves on one benchmark and clearly worsens on three (only two by a non-negligible margin), leaving the remaining four unresolved. The panel retains a median 93% of the frontier judge's agreement and gives up only 2.9 points of balanced accuracy on average. Inference runs at a sixty-fourth of the frontier's price at conventional cloud rates, or at the electricity cost on premises, so the operative expense is a one-time in-domain calibration of some fifty to a hundred labelled records, amortised over a few tens of thousands of evaluated items. Against the literature, the panel is competitive with purpose-trained detectors on their home benchmarks, losing 1.3 points of accuracy to GPT-4o and 1.9 to the best LLM-AggreFact leaderboard model; yet the strongest detector we reran falls 6 points behind on our grounded sets, and cannot score the ungrounded ones. In conclusion, whether pursuing the aggregation is worthwhile depends on the members themselves, making the gain auditable from how widely competence is spread across them and how far their errors decorrelate — both read at no further cost off the aggregator's calibration set. If several capable members err on different items, the panel improves on its best judge and approaches the frontier; conversely, where one dominates, the stacker recovers the leader, yet only there does the frontier remain materially ahead. A panel of cheap judges can therefore stand in for a frontier one at a small fraction of the cost wherever this audit admits it.
Critical strengths
How to use AI models to answer a question and produce a very large report in a very short time.
Critical weaknesses
There is nothing new to advance AI or machine learning.
Questions for authors
How many of the papers listed in the reference section that the authors have read? How much of the results reported in the paper is produced from hallucination? Author relied on AI tools for the result, but they have only API access. Currently, there is no method to know how much of the model's output is because of hallucinations. How much confidence the author has that the reported result is hallucination free?
2 comments
Response to Reviewer 9YRN (2/2): on how hallucinations enter the work, on where the gold labels come from, and on the role of API access
We updated the response as we noticed we did not published to "Everyone". No content was changed.
How much of the results reported in the paper is produced from hallucination?
Currently, there is no method to know how much of the model's output is because of hallucinations.
How much confidence the author has that the reported result is hallucination free?
We pair these three comments as they all concern the same matter: hallucinations, their detection, and how they enter our work.
Again, we should have communicated better. We want to clarify upfront that no reported number is produced by a language model. Indeed,
the judges are the object of the study: each is asked whether a candidate text is hallucinated and their verdicts are the data; every number in the paper is then computed from those verdicts by deterministic code, against a ground truth the benchmarks themselves publish.
Hallucinations therefore enter the work in two roles, both as data under analysis: as the candidate texts the benchmarks supply (which the judges must classify) and as the judges' own wrong verdicts (which we measure against the published labels and which the panel we introduce is designed to reduce).
In neither role can they alter the measurement itself.
As to the confidence that the reported results are hallucination free: hallucination is a property of text that a model generates, and no reported number is generated by a model, so none of them can be hallucinated by definition.
What can be wrong in a deterministic pipeline is the code, in which errors remain possible, as in any other empirical work and despite our best efforts and continuous committment; this is why the code and all verdicts are released, for every number to be regenerated and checked by the community (Reproducibility statement).
As to how hallucination can be measured at all, likely the details might have been exposed in a more clear manner: every item carries the label published by the benchmark's own authors, and every verdict, from the panel and from the frontier judge alike, is scored against it. No label is produced by any model we evaluate. "Grounded" and "ungrounded" describe what the judge is shown, not whether a label exists:
- on the six grounded sets, the judge sees the reference, and the label is the benchmark's own annotation of whether the candidate is supported by it: human span annotation on RAGTruth, the human support labels of LLM-AggreFact on WiCE, XSum, CNN, and ExpertQA, and, on MedHallu, the labels fixed by its construction (a published answer against a hallucinated one the benchmark generated);
- on the two ungrounded sets, the judge sees no evidence and must rely on its own knowledge, whereas the label remains the benchmark's own: human atomic-fact annotation against Wikipedia on FActScore, and the authors' correct and incorrect reference answers on TruthfulQA.
Indeed, measuring how often a model's output is unsupported, against benchmarks labelled in this way, is precisely what the hallucination-detection literature does. The misuderstanding that raised the criticism is likely due to the fact that the paper states the provenance of the labels only in Appendix J and in the Ethics statement, and that the task definition in §2 can be read as defining the label by what the judge sees. The revision will therefore state it in §2 and will add the label source of each dataset to Table 14.
Author relied on AI tools for the result, but they have only API access.
This point rests on another misunderstanding, below clarified.
As above reported, AI tools do not enter our work as producers of our results: their outputs are the very data we study, and all of them (except the frontier reference's) are generated under a reproducible (up to the small nondeterminism of GPU serving) procedure that the reviewer has access to and can freely run (following raim-verdicts/QUICKSTART.md or raim-verdicts/FRESH_BOX.md in the supplementary material).
The frontier reference (i.e. the judge the proposed panel aims to replace) is the only part of the data whose generation required paying for a commercial API, and the only part that is not exactly reproducible since the provider might change the model behind it and, even at the temperature of 0 we use, does not hence guarantee identical outputs over time; its inference code is nonetheless released as well.
In any case, with the data fixed (as in the snapshot provided in the supplementary material), all the results are deterministically generated by the released Python code, with no LLM or API entering the loop.
We are confident to have clarified all the points raised by the reviewer, and we trust the work to be reassessed on that basis, while remaining available for any further question.
Response to Reviewer 9YRN (1/2): on paper contribution, and on the references read
We thank the reviewer for their time in evaluating our work.
The critical weakness the reviewer attributes to our work, There is nothing new to advance AI or machine learning, shows that we did not convey clearly enough what our work contributes and how it advances on prior work, a positioning that, for space, sat almost entirely in Appendix L. In the revision, we will move part of it into the introduction (new paragraph Relation to prior work, §1), a point Reviewer
uHiialso raises. We claim no novelty in the aggregator structure itself: the stacker is a standard logistic regression, chosen so that any gain is attributable to the judges, not to the estimator.Our main contribution is, instead, a rigorous study of how a panel of cheap LLMs can be employed for hallucination detection in place of a single frontier LLM judge, and of how this route compares with the related ones (escalation and specialisation). Indeed, the provided systematization made other reviewers find the paper valuable: "asks a practical question and puts a price on the answer" (
tuNS); "evaluation protocol is rigorous" (tuNS); "a trustworthy mixed result" (p13k); and, note that it reports "negative results instead of presenting aggregation as universally effective" (uHii). In detail, our main contributions are the following:How many of the papers listed in the reference section that the authors have read?
The paper cites 88 works, and we understand the scepticism expressed by the reviewer on the matter, in an era where LLMs are ubiquitous. However, twenty references identify what we run: the reports of the eleven models (the ten judges and the frontier judge) and the nine sources of the eight benchmarks. Fourteen are the classical statistical and aggregation literature: five we use or compare against (Cohen's κ, Holm's correction, Youden's index, stacking, and Dawid–Skene), and nine on which our account rests, from Condorcet's jury theorem to the descendants of Dawid–Skene and the study of ensemble diversity. The other 54 are related work (LLM judges and panels, correlated errors, cascades, trained detectors), each discussed in Appendix L. As the AI use statement says, every reference was retrieved and read in the original, and every published value beside ours checked against its source.