- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2(+1)
Read review
Paper summary
This paper studies hallucination detection in diffusion language models by considering token commitment and changes in uncertainty. The paper observes Early Factual Commitment and proposes two simple detection signals named Late Mask Entropy (LME) and Token Informativeness (TI). Experiments are conducted on LLaDA, Dream, and DiffusionGemma to evaluate the performance of the proposed method. The results show good AUROC performance without training an additional neural detector.
Critical strengths
-
Late Mask Entropy is simple and shows good performance on LLaDA and Dream. It achieves an AUROC of 88.26 on HotpotQA.
-
The experiments include different diffusion models and remasking strategies. The results show how uncertainty changes differently across decoders.
Critical weaknesses
-
The paper claims that Informativeness measures information gain. However, the proposed definition does not measure the information gain defined in the paper. Equation 2 uses the same remaining masked positions, while Equation 4 subtracts mean entropies over different masked sets. Removing committed tokens from the average adds an extra term to the score. Therefore, a commitment can have a high Informativeness score even if the predictions of all remaining tokens stay the same.
-
TRE already uses token-level entropy and temporal weighting from a single diffusion decoding trajectory to detect hallucinations without training. The proposed LME and TI use different uncertainty signals, but the paper does not compare with TRE to show the performance gains. Table 2 shows that the simpler LME detector outperforms TI in four of six settings on LLaDA and four of six settings on Dream. TI is more robust under random remasking. However, the paper does not compare its Top-5% selection with random or entropy-matched step selection while keeping the final-entropy term the same.
-
The proposed method has a different meaning when applied to DiffusionGemma. This model does not use the same masked-token commitment process. Therefore, the paper uses entropy at fixed answer positions in place of masked-region entropy. However, this does not follow the commitment-level definition used to motivate TI. The performance on DiffusionGemma may come from general changes in entropy, and does not clearly show the effect of the proposed commitment information gain.
-
The paper compares the first step at which factual and hallucinated answers can be identified. However, it does not separately consider the effect of answer length, tokenization, or the position of tokens that determine the answer. These factors can change this first step even if factual correctness stays the same. Therefore, it is not clear if earlier commitment is related to factual correctness or mainly comes from the decoding order.
Questions for authors
-
Can the authors clarify why Equation 4 compares different masked sets, while Equation 2 defines information gain over the same remaining positions? It would be helpful to compute TI using the same unresolved positions before and after each commitment.
-
Can the authors compare TI with random step selection and selection based only on commitment confidence or masked-set size? This would help show if Informativeness captures information beyond the remasking policy.
-
Can the authors clarify what a commitment event is in DiffusionGemma? It is not clear how entropy at fixed answer positions has the same meaning as the original TI definition.
-
Can the authors show if Early Factual Commitment still holds when factual and hallucinated responses have the same length and answer-token position?
5 comments
I thank the authors for the rebuttal. My concerns have been partly addressed. The fixed-position ablation is helpful to clarify the composition effect in Eq. (4). However, I believe the basis for the theoretical derivation is still not technically sound, information gain and the composition term should be modified and more carefully designed.
The new step-selection ablation is also helpful. However, the smallest masked-set selection slightly outperforms TI on both datasets, while lowest-confidence selection achieves comparable results. The gain of informativeness-based selection is not distinctively shown, especially since the combination weights are recalibrated for each strategy.The definition is still inconsistent between commitment based on first modification and entropy threshold crossing. And the response to Early Factual Commitment does not provide the requested controlled analysis of answer length, tokenization, and answer-token position, or any of that ablation, which can be useful to seperate confounding effects.
Overall, I agree the proposed approach is simple and shows promising empirical performance. However, I think the issues of theoretical interpretation, performance gain, and consistency across architectures require further clarification.
We thank the reviewer for the prompt follow-up and thoughtful comments on interpretability and empirical performance. We view the simplicity of our approach as an important strength: it extracts uncertainty signals from a single generation trajectory without training an additional neural detector. This also motivates future work on using intermediate uncertainty signals to support decisions during generation. We address the follow-up concerns below.
On the calibration set and combination weights. All step-selection strategies use the same calibration set. In our original ablation, the combination weights were calibrated separately for each strategy, allowing each detector variant to combine its selected-step entropy with the final-step component under the same calibration-data budget.
To address the reviewer’s concern about the influence of weight recalibration, we additionally evaluate the selectors using the same frozen combination weights under confidence-based decoding. The results below show that TI’s advantages over alternatives remain observable without strategy-specific weight fitting.
| Step-selection strategy | TriviaQA AUROC (%) | HotpotQA AUROC (%) |
|---|---|---|
| TI: informativeness | 85.48 | 84.50 |
| Random | 74.75 | 77.60 |
| Highest commitment confidence | 70.18 | 70.56 |
| Lowest commitment confidence | 84.75 | 83.67 |
| Largest masked-set size | 68.84 | 69.86 |
| Smallest masked-set size | 86.28 | 84.65 |
On the effectiveness of LME, (smallest-masked-set selection), and lowest-confidence selection. We acknowledge that smallest-masked-set selection achieves the highest point estimates under confidence-based decoding, while lowest-confidence selection also performs competitively. These findings are consistent with the motivation for LME: selecting the smallest masked sets targets late decoding steps, where confidence-based decoding tends to concentrate unresolved uncertainty.
To examine how these comparisons depend on the generation policy, we also evaluate the selectors under random remasking with a (10% steps budget):
| Step-selection strategy | TriviaQA AUROC (%) | HotpotQA AUROC (%) |
|---|---|---|
| TI: informativeness | 73.30 | 76.08 |
| Random | 70.60 | 72.42 |
| Highest commitment confidence | 68.03 | 75.11 |
| Lowest commitment confidence | 66.64 | 65.02 |
| Largest masked-set size | 64.33 | 63.02 |
| Smallest masked-set size | 50.28 | 60.16 |
Smallest-masked-set and lowest-confidence selection perform substantially worse in this setting. These results support a more qualified interpretation of our contribution: late-step selection is particularly effective under confidence-based decoding, while selecting steps using observed entropy changes provides an effective alternative when the generation policy changes. We will revise the manuscript to make this dependence explicit.
On Early Factual Commitment. As requested by the reviewer, we conducted a controlled study of Early Factual Commitment using LLaDA-8B-Instruct with 128 decoding steps under confidence-based remasking. We compare correct and hallucinated responses only within strata sharing the exact decoded-answer length in model tokens, (L), and the exact answer-token position, (p). This holds token count and answer-token position fixed within each comparison. We retain strata containing at least eight correct and eight hallucinated responses. The four eligible strata in each dataset correspond to and . We report the matched difference in mean commitment step, , where a positive value indicates earlier commitment for correct answers.
| Dataset | Retained examples | Matched in steps (95% CI) | Matched AUROC, % (95% CI) |
|---|---|---|---|
| TriviaQA | 707 | +1.41 [+0.70, +2.32] | 69.90 [65.14, 74.47] |
| HotpotQA | 642 | +1.83 [+0.97, +3.05] | 71.98 [66.43, 77.69] |
After controlling for these factors, correct answers commit earlier by an average of 1.41 step on TriviaQA and 1.83 steps on HotpotQA in the matched analysis. These results support the presence of Early Factual Commitment within the evaluated strata after controlling for answer-token count and position.
Thank you for your careful assessment and feedback!
We appreciate the reviewer’s careful assessment and constructive feedback. Below, we address the questions raised and provide additional clarification.
W1 Q1.
Thank you for raising these concerns. We acknowledge that Eq. (4) includes a contribution from changes in the masked-position set, in addition to changes in uncertainty at the remaining positions. We have included additional results below. Please see the “On Eq. (4) versus Eq. (2)” section of our top-level response, where we explain this distinction and report an ablation that computes entropy changes over the same positions at both endpoints.
W2 Q2.
Thank you for raising the thoughtful question! Below we include results of Ours-TI against various step-selection methods, including random selection, low / high commit confidence, and low / high masked-set size, to choose 5% (7 steps) out of the total 128 steps. We vary only the step-selection rule, keeping the candidate steps, remasking strategy, final-step component, and the calibration set fixed. We also include mean calibrated weights of the averaged steps, wavg, and final step wfinal.
| Dataset | Step-selection rule | �0� | AUROC (%) | Δ vs. TI | | :--- | :--- | ---: | ---: | ---: | ---: | | TriviaQA | TI: informativeness | 0.68 | 0.32 | 85.62 | — | | - | Random (20 seeds) | 0.23 | 0.77 | 77.93 | −7.68 | | - | Highest commitment confidence | 0.18 | 0.82 | 78.98 | −6.64 | | - | Lowest commitment confidence | 0.65 | 0.35 | 85.11 | −0.51 | | - | Largest masked-set size | 0.19 | 0.81 | 78.70 | −6.92 | | - | Smallest masked-set size (LME) | 1.00 | 0.00 | 85.97 | +0.36 | | HotpotQA | TI: informativeness | 0.50 | 0.50 | 83.81 | — | | - | Random (20 seeds) | 0.18 | 0.81 | 75.79 | −8.02 | | - | Highest commitment confidence | 0.10 | 0.90 | 73.95 | −9.86 | | - | Lowest commitment confidence | 0.49 | 0.51 | 83.13 | −0.68 | | - | Largest masked-set size | 0.01 | 0.99 | 72.65 | −11.16 | | - | Smallest masked-set size (LME) | 0.51 | 0.49 | 84.27 | +0.46 |
TI improves over random selection by 7.68 and 8.02 AUROC points on TriviaQA and HotpotQA, respectively. It also outperforms selection by highest commitment confidence and largest masked-set size.
The comparisons with lowest commitment confidence and smallest masked-set size are closer. This is consistent with the motivation behind LME under confidence-based remasking: higher-confidence positions are preferentially committed, leaving a progressively smaller set of unresolved positions. Their competitive performance may therefore reflect Early Factual Commitment and uncertainty signals related to those that make LME effective in this setting. We have updated our manuscript to include this result.
W3 Q3.
Our DiffusionGemma adaptation uses a pristine/modified partition of the canvas. Because the canvas is initialized with random tokens rather than the MASK token, we track each position’s modification history. Positions that have never been modified belong to the pristine region, which serves as an operational counterpart of the masked region in our entropy computation. Positions that have been modified at least once belong to the generated region. This is similar to our settings for LLaDA-2.1-mini.
Accordingly, the event corresponding to commitment in this adaptation is a position’s first recorded modification (or when a position’s predictive entropy first falls below the entropy bound of 10−3, which differs from the irreversible mask-to-token commitment assumed in the original formulation. We have updated these definitions and implementation details in our manuscript.
W4 Q4.
We thank the reviewer again for your insightful question! Empirically, we observe that answer-bearing tokens in factual responses tend to become confident earlier in the trajectory, allowing the factual answer to become identifiable before the surrounding response is fully generated. In hallucinated responses, uncertainty about the key content persist, delaying its commitment.
As a result, this mechanism could produce different commitment times for answer-bearing tokens even when responses have the same length and answer-token position. Others, (such as [2]), have reported early stabilization of correct answer predictions and continued late-stage changes in incorrect GSM8K predictions.
[2] Li et al., "Diffusion Language Models Know the Answer Before Decoding".