- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents HeadAxis, a hallucination detection method that operates on pooled attention head value contributions across generated positions. HeadAxis matches or exceeds prior methods in white-box hallucination detection on four hallucination detection benchmarks over three backbone models across model families.
Critical strengths
S1. The flow of the language is consistent.
S2. This work operationalize the value contributions of attention heads as a richer subspace for hallucination detection, which is mechanistically sound.
Critical weaknesses
W1. The proposed method improves the detection performance by a small margin to competing methods like ITI and RAGLens.
W2. The distinction between eq. 4 and eq. 5 is not empirically demonstrated. I wonder if just pool the value vectors would constitute a good detector.
W3. Experiments do not include larger models from 13B-70B. The universality of the advantage is not shown.
Questions for authors
Please address W1-3.
2 comments
Thank you very much for your response. My concerns are resolved, and I would like to increase the rating.
Thank you for your review and for the constructive feedback. All three points led to additions that we believe strengthen the paper.
In addition, HeadAxis is conceptually simpler than RAGLens: it needs no sparse autoencoder trained for each scoring model, only linear probes on activations from a single forward pass. Detection performance is only one part of its advantage over such baselines.
Eq. 4 versus Eq. 5: You are right that we did not empirically demonstrate this result. We ran the comparison and added it as Appendix G.1. Normalizing each position before pooling (Eq. 5) performs clearly worse than pooling before normalizing (Eq. 4): the difference is 2.2 AUROC points and is significant (p < 0.01). Regarding your question, pooling the value vectors alone does give a reasonable detector (.883 AUROC, see Appendix G.2), but attention weighting adds a further 2.3 percentage points.
Larger models: We now evaluate LLaMA-2-13B and LLaMA-2-70B on RAGTruth and RAGognize’s LLaMA-2-7B responses (Appendix M). At 13B, HeadAxis achieves the highest AUROC and AUPRC on both datasets, ahead of ITI-Detect, Lookback Lens and RAGLens by at least 1.5 AUROC points on RAGTruth and 3.7 on RAGognize; these margins are larger than at 7B. At 70B, HeadAxis again achieves the highest scores on both datasets, ahead of all three baselines by at least 3.2 AUROC points on RAGTruth and 3.1 on RAGognize.
We hope these additions address your concerns and that you will consider revising your score. We are happy to run any further experiments you think would be useful.