- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper composes OpenHalDet, a unified benchmark for hallucination detection across various generation scenarios, including QA, RAG, Maths, Science, Code, Agentic and Multilingual tasks. OpenHalDet standardize a uniform task interface to adapt to differently-formatted datasets, implemented the evaluation pipeline, and conducted evaluation on Llama and Qwen3 families of models. The results provides a comprehensive view on the effectiveness of heterogenious hallucination detectors under diverse task modalities, along with insights on inference-time compute tradeoff across methods, and the contribution of labels or hidden states to detector performances.
Critical strengths
S1. The paper provides comprehensive testing across many dataset-model-detector triplets.
S2. The paper provides interesting (non-positive) insights on the effect of access to hidden states for hallucination detection.
S3. The paper publishes artifact that is potentially useful for evaluation of future works.
Critical weaknesses
W1. Hallucination is not clearly defined beyond in-context learning tasks (Context-based QA, summarization). Without context, hallucination reduces to wrong answer, and I doubt wrong-answer detection is aligned with the purpose of the tested methods.
W2. The hallucination label is generated with gpt-4o-mini without verification or correlation analysis. The reliance on gpt-4o-mini also increases the cost and reduces the feasibility of the proposed work to academic community.
W3. The inference-time cost tradeoff is analyzed without emphasis to detector modality (white/black box), which reduces the value of the analysis. Looking into the per-color cluster of dots in Figure 2, the result is not inspiring.
Questions for authors
Q1. How do you define hallucination without a context? How does the definition still fit in the setup of tested methods?
Q2. Is there any agreement between gpt-4o-mini and human annotation on hallucination?
Q3. Is there significant transformations, done by the proposed pipeline, on the curated data that is necessary to bridge the datasets and detectors of varying modality?
8 comments
Response to Reviewer cDmb (2/2)
W3: Cost analysis without emphasis on detector access level (white/black box)
We added the access level to the cost analysis. Each cell gives the number of detectors, their cost per 100 examples and their AUROC (Llama-3.2-3B). A range covers all detectors in the cell.
| Access level | No extra generation | One extra generation | Five extra generations |
|---|---|---|---|
| Black-box (4 detectors) | 0 detectors | 1 detector: 10.9 s, AUROC 58 | 3 detectors: 435 to 444 s, AUROC 77 to 79 |
| Gray-box (5 detectors) | 1 detector: 4.5 s, AUROC 77 | 1 detector: 173.9 s, AUROC 75 | 3 detectors: 435 to 444 s, AUROC 64 to 85 |
| White-box (8 detectors) | 6 detectors: 4.6 to 84.3 s, AUROC 53 to 69 | 0 detectors | 2 detectors: 434 to 453 s, AUROC 73 |
- Cost depends on the number of extra generations, not on the access level. In every access level, a detector with five extra generations costs 434 to 453 s. A detector without extra generations costs under 85 s.
- With the same number of extra generations, the access levels differ in accuracy. Without extra generations, gray-box Perplexity reaches 77 AUROC and the six white-box detectors reach 53 to 69. With five extra generations, the best gray-box detector reaches 85, the best black-box detector 79 and the best white-box detector 73.
Changes in the paper. The cost table (Table 25) now groups detectors by the number of extra generations and colors each row by access level. Table 26 summarizes cost by access level. Figure 2 is redrawn with the new SAR cost.
Q3: Transformations applied to curated data
Appendix C describes every step. In short, the pipeline does two things to connect datasets and detectors. Neither of the two changes the content of a dataset.
- Datasets: one shared format (Appendix C.2, C.3). Each example keeps its original text and is stored in fixed fields: instruction, context, question, task-specific items (answer options, tool specifications or test cases) and reference answers. The task type only decides which fields go into the prompt.
- Detectors: saved model signals (Appendix C.4). For each prompt we generate the response once. We save the response, the token probabilities, the hidden states and five extra samples. Each detector reads the cached signals it needs within its access level. All detectors are evaluated on the same primary responses, labels, and splits. No dataset is changed to fit a detector.
Dear Reviewer,
We would be grateful if you could let us know whether our responses address your concerns. For W1, we gave the two definitions of hallucination used in the literature and reported grounded and ungrounded datasets separately. For W2, we verified the GPT-4o-mini labels against exact matching, unit tests, and human annotation across eight datasets, with 89 to 99% agreement on GSM8K, ARC-Challenge, xLAM-Agent and TriviaQA. For W3, we added the cost breakdown by access level. If any point remains open, we would be very glad to clarify before the discussion closes.
Response to Reviewer cDmb (1/2)
Thank you for the detailed review and the concrete questions.
Definition. Eq. (2) in our paper calls a response A truthful when A is semantically aligned with T∼PT∣Q(⋅∣Q), where Q is the full input. If Q has no context, a hallucination is a response that is not factually correct. If Q has a context, a hallucination is a response that the context does not support. These are the two established categories, factuality and faithfulness (Huang et al., 2025). A wrong answer without context is therefore itself an established type of hallucination, a factuality hallucination.
Fit with the tested methods. Several of the detectors were evaluated on closed-book answer correctness in their own papers (Appendix B, Table 6). For example, Semantic Entropy and ICR Probe were evaluated on TriviaQA without context. Semantic Entropy was also evaluated on the math word problems of SVAMP. A benchmark of these detectors therefore has to cover this setting. On math, code and tool calling, OpenHalDet tests whether the same detectors still work, with task-specific correctness labels.
Results. Grounded datasets: the 7 datasets with a source passage or document in the prompt (SQuAD v2, HotpotQA, CoQA, HaluEval-QA, RAGTruth, XSum, Belebele). Ungrounded datasets: the other 10.
Changes in the paper. Section 2.1 states the two instantiations of Eq. (2). Table 1 marks the grounded datasets. New Table 19 reports all 17 implementations on both groups.
We verified the GPT-4o-mini labels on eight datasets against a second label source that does not use GPT-4o-mini (Llama-3.1-8B outputs).
--judge_model), so researchers can use a different model to label new generations.Changes in the paper. New Appendix D.1 reports the label verification (Table 10) and the re-run of 16 detectors on code with unit-test labels (Table 11).