- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper introduces a new method called HD-Fuse, that detects when an AI model might be hallucinating. It uses token log probabilities from one generated response without requiring access to internal model states or multiple generations. It combines five confidence measures and features that track changes in token probabilities through an ensemble of statistical detectors (a technique called a likelihood-ratio test (LRT)). A split-conformal calibration layer is introduced to provide statistical false-positive-rate guarantees. Tests on HaluEval QA and TruthfulQA across four open-weight models and report the best average AUC among the compared methods (0.835). The paper also includes a DeepSeek API experiment, component studies, cross-validation, and cost measurements. The method requires labelled calibration data for each model and benchmark.
Critical strengths
- The method proposed in the paper requires only a single generated response and token-level output log probabilities and It does not require access to any internal model hidden states or multiple generations. This makes it useful for logprob only API settings, which are studied in the paper.
- The paper evaluates HD-Fuse across two public benchmarks and four open-weight models. It also includes a production-API experiment and component ablation studies. Results show improved average hallucination detection performance over several existing baselines.
Critical weaknesses
- In Table 3, the authors report performance for the thermodynamic trajectory components individually and for the full HD-Fuse ensemble. However, they do not show how the full ensemble performs when the trajectory-based components are removed.
Questions for authors
It would be nice if it is clarified how the 250 calibration prompts were used? Were the examples used to calibrate p-values kept separate from those used to fit the detectors and choose ensemble weights?