- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper starts with a strong motivation explaining two complementing white box methods for hallucination detection, one being to look at the models' internals over the “question” and one over the “Answer”. They put a strong emphasis on trying to reduce cost and time therefore they use a serial method that has an “early stop” mechanism that ends in the first time there is a strong enough signal for an hallucination. The results are promising, demonstrating good generalization beyond the baseline and notable improvements in several cases.
Critical strengths
- The paper studies a timely and important problem. The analysis in Figures 4 and 5 shows that each stage (prefill and decoding) might catch hallucinations that the other stage will miss. For example, the question alone can give a signal that the model does not know the answer, while some errors become known only when the model starts to generate the response.
- The method is efficient -- it improves detection while also reducing the time needed to detect hallucinations. It reachs the best AUC in 4 out of 6 cases and beats all the probe baselines in all 6 cases. On Qwen3 with Triviaqa it reaches 0.85 AUC, compared to 0.79 for the strongest single generation baseline.
Critical weaknesses
The main weakness in my opinion, are two fold. (1) The proposed method largely combines techniques from existing approaches. As such, the contribution is primarily integrative rather than methodological, with limited innovation beyond the synthesis of prior work. (2) The empirical evaluation is not comprehensive enough. Experiments involving only two LLMs and three datasets fall short of the standards typically expected for empirical papers in this area, making it difficult to assess the generalizability and robustness of the findings.
In short, while the paper presents promising results, it primarily demonstrates which types of errors are detected at each stage, without sufficiently explaining why the internal representations at different stages capture distinct hallucination signals. A deeper analysis of the underlying mechanisms, particularly what makes these representations complementary, would strengthen the paper and enhance its contribution.
Questions for authors
- How did you select prefill and decode thresholds? What was the criteria optimized in cross validation for choosing them. Were the thresholds selected separately for each model X dataset combination?
- Figure 7 shows about 0.88 AUC for decode with lookahead, but table 2 reports 0.78. Could you explain exactly which samples and scoring way were used in each evaluation?
4 comments
Why do the two stages capture different signals?
The two probes read representations that encode different things. The prefill probe reads the last prompt token, before any answer exists. Its signal grows monotonically with depth (Fig. 3a), indicating that the model's internal processing of the question gradually forms an estimate of whether it has the relevant knowledge. The decode signal, in contrast, is concentrated in position rather than depth: it peaks at critical tokens and drops sharply at the final token (Fig. 3b, c), consistent with truthfulness information residing in exact-answer tokens. The prefill probe thus asks "does the model know?", while the decode probe asks "is this particular answer right?"
This explains each stage's blind spots. A question-level signal cannot foresee errors that depend on the sampled trajectory. When the model only partially knows an answer, whether it errs depends on what it generates. Such cases form the ambiguous band of prefill scores (hallucination rate 33–50%), and decode-only hallucinations cluster there (median prefill score 0.65). Conversely, we hypothesize that once the model fluently commits to an answer, the representation at the commitment is dominated by the committed content, so the knowledge-gap signal is no longer reliably readable there. This is consistent with confident entity confusion being the largest category of prefill-only cases (Fig. 5b). When the answer is empty, there is nothing for the decode probe to read at all. Both cases are caught only at prefill.
Which signal dominates depends on how a task induces errors. In knowledge-recall tasks (TriviaQA, Movies), errors stem mainly from knowledge gaps, so the prefill signal carries much of the load: on TriviaQA, prefill recovers 89% of decode-missed hallucinations at τ = 0.5. In WinoBias, errors arise when the model resolves the coreference during generation, so decode dominates at every threshold (Fig. 4). The cross-domain results point the same way: probes transfer between the two knowledge-recall datasets (AUC 0.73 / 0.72) but fall to chance on WinoBias (0.50 / 0.49), indicating that what the representations encode is specific to the task type.
This analysis has been added to the revised paper as a new Appendix F ("Why the Two Stages Capture Different Signals"), and a summary sentence pointing to it has been added at the end of the "Stage-Exclusive Failure Modes" paragraph in Section 4.2. All new content is highlighted in blue.
Q1: How were the thresholds selected?
Response for Question 1. For the main table, τ_prefill and τ_decode were selected separately for each model × dataset combination from the grid in Table 8, by 3-fold cross-validation on the random sampling parts of training split, choosing the pair that maximizes end-to-end AUROC; test data are never used for selection. The localization threshold (τ_pos = 0.9) and the lookahead window (w = 5) are shared across all settings. This description has been added to Appendix G.5 (System Hyperparameters) of the revised paper, highlighted in blue.
Q2: Why does Fig. 7 report 0.88 while Table 2 reports 0.78?
Response for Question 2. Both numbers use decode-stage scores only; they differ in which samples are included.
- Fig. 7 isolates the lookahead mechanism. It is computed only on samples in which the localization probe detects a critical unit, and each sample is scored by the hallucination probe at the confirmed position.
- Table 2 reports the same decode-stage detector on all test samples, including those in which no critical unit is detected.
No critical unit detected. In the decode-only setting, 188 of 200 samples have a detected critical unit, and the remaining 12 do not. All 12 are hallucinations: the model hedges, leaves the answer empty, or never commits to an answer, so the localization probe finds nothing to anchor on. With no answer span to read, the decode probe assigns them low scores and ranks them below correct samples. If generation ends with a candidate that has not yet been confirmed, the system uses that last candidate position.
Effect on AUC. Restricted to the 188 samples with a detected unit, the AUC at w = 5 is 0.88 (Fig. 7). Including the 12 samples without one lowers it to 0.78 (Table 2). The gap therefore reflects a genuine blind spot of the decode stage rather than an inconsistency: hallucinations that never commit to an answer are invisible to the decode probe. These are precisely the boundary-knowledge failures that the prefill stage catches (Fig. 5), which further motivates the cascade.
We have revised the explanation in Section 4.4 ("Experimental Analysis of Decode-Stage Lookahead") of the paper accordingly, highlighted in blue.
Overall, I appreciate the authors' efforts and the additional results. While the rebuttal partially addresses my concerns, my central concern regarding the methodological novelty remains. I therefore maintain my original rating.
Thank you for your valuable time. We appreciate your comments and suggestions, which have helped improve our paper.
W1: The contribution is integrative rather than methodological.
Response for Weakness 1. We would like to clarify our contribution as not only a synthesis of prior work. It has three parts.
(i) An empirical finding not reported before. Prefill-stage and decode-stage signals are complementary rather than redundant. Each stage systematically misses failure modes that the other catches (Fig. 5), and the split of responsibility between them is controllable (Fig. 4).
(ii) Components derived from this finding, not taken off the shelf. Prior prefill probes read one fixed layer; ours exits adaptively across depth. Prior decode probes either use fixed positions or, like HaMI, select critical tokens only after the full response is generated; ours localizes critical tokens online and confirms span boundaries with a lookahead window.
(iii) The combination outperforms its parts. The cascade improves over both components in isolation (0.64 and 0.78 → 0.85 AUC), and it outperforms single-generation HaMI, which also selects critical tokens, in all six settings while operating in real time.
We also add a mechanistic explanation of the complementarity below, which we will include as a dedicated subsection.
W2: Limited models and datasets.
Response for Weakness 2. We thank the reviewer for this suggestion. We have added two datasets, NQ-Open (open-domain QA) and HotpotQA (multi-hop QA), which are the two benchmarks most widely used in recent hallucination-detection work, and one model, Llama3.2-3B-Instruct, which extends the evaluation to the small-model regime relevant to our on-device deployment setting. All baselines from the main table are re-run on every new setting. These results have been added to the revised paper as Appendix E (Table 4). All new content is highlighted in blue.
End-to-end AUC comparison between our cascade method and other methods on more datasets. Our method achieves either the best (bold) or second-best (italic) performance across most settings:
8B = Llama3-8B-Instruct, 3B = Llama3.2-3B-Instruct.
The new settings support two conclusions: