acceptodds
Under review as a conference paper at ICLR 2027

How Do Uncertainty Estimators Align with Hallucination Occurrence in LLMs?

Abstract

Large language models (LLMs) can hallucinate, but does model uncertainty reliably reveal when they do? Although uncertainty estimators are increasingly used to identify unreliable generations, their relationship with hallucination remains poorly understood and is often taken for granted. We systematically evaluate 46 uncertainty estimators across complementary hallucination settings, covering both intrinsic hallucinations, where outputs are unsupported by the provided context, and extrinsic hallucinations, where claims are unsupported by expected model knowledge. Across four benchmarks and multiple LLMs, we find that the association between uncertainty and hallucination varies widely and is often weak, depending on the hallucination setting and the model under evaluation. These results challenge the use of uncertainty as a direct signal of hallucination and clarify when it provides useful information.

Then back it, or bet against it.

Related papers

Open the market on this paper to see 7 more related papers.