- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper argues that 1) hallucinations are due to "representational frustration" (attention-weighted disagreement between directions). 2) We can track this using the Bethe free energy of an MRF representation of the attention. 3) Therefore, we can use that BFE (or actually, a weighted combination of layer wise BFEs) as a UQ metric. They show that it gives good AUROC and ECE (when translated to a probability)
My main concern is that, the results don't really agree with this story. The attention-weighted disagreement can be directly tracked, and it does worse than their score. So - what is the ABS adding that the attention-weighted disagreement misses, and why?
My secondary concern is that it isn't clear how the correctness score for the AUROC is calculated. Santilli et al (2025) show that many ways of calculating correctness are correlated with response length, leading to errors in ranking methods. I would expect that the ABS score would also be highly dependent on length (longer q/a -> more opportunities for disagreement), so I would like to verify how the AUROC is calculated (it isn't specified in the appendix).
Third, a conceptual question. You are treating the attention as a Markov random field, but it isn't -- it's a DAG. Why throw away the direction/causal structure? Isn't this likely to explain away directional disagreement?
Finally, I think the paper could benefit from some qualitative analysis, and potentially also some datasets with "different" types of uncertainty (ambiguity, math reasoning). It would be really nice to see visual examples of the sort of disagreement/"frustration" this method is designed to detect. The reason I suggest datasets with different types of uncertainty, is it's not clear to me that trivia/recall type questions would naturally have this sort of frustration. TruthfulQA (which is included in the appendix but not as part of the main multi-model comparison) seems more likely to have it (as the questions have somewhat dual meanings), as do ambiguous questions.
While I have some concerns and would like to better understand what is going on - the method seems to do well. I'd be open to raising my score if I had some stronger insight into why ABS works better than raw frustration, and if I could see how the AUROC is calculated.
Santilli, Andrea, et al. "Revisiting uncertainty quantification evaluation in language models: Spurious interactions with response length bias results." Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). 2025.
Critical strengths
- The method appears to perform better than other UQ methods on a variety of QA tasks.
- AFAIK the idea of "frustration" is new and interesting to me.
Critical weaknesses
- Unclear how AUROC is calculated, which may introduce confounding in results.
- Unclear conceptually why ABS outperforms raw frustration
Questions for authors
- How is correctness calculated for AUROC?
- Why do you believe ABS outperforms raw frustration?
- Would you be willing to add any qualitative analyses or examples of frustration?