- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes DigitTrace, a compact activation-based approach for detecting incorrect LLM responses. Instead of relying on high-dimensional neuron-aligned representations, DigitTrace characterizes the distribution of activation magnitudes using leading-digit frequencies, Benford-reference statistics, and activation moments. These features are accumulated across generated tokens and extracted from six activation streams at selected transformer layers. The resulting representation is fed into an ensemble of sparse logistic regression probes to predict answer correctness.
Critical strengths
- A compact and interpretable alternative to neuron-aligned representations.
- Comprehensive experimental evaluation and analysis.
Critical weaknesses
- The independent contribution of leading-digit features is relatively limited.
- The empirical evidence does not sufficiently establish the distinctive advantage of leading-digit representations over alternative distributional summaries.
Questions for authors
- The central motivation emphasizes leading-digit distributions and Benford-inspired statistics. However, Table 2 shows that activation moments alone achieve 76.16 AUROC, compared with 76.68 for the complete DigitTrace representation.
- Although the paper demonstrates that leading-digit features are predictive, it remains unclear why decimal leading digits should be preferred over other compact distributional representations, such as logarithmic magnitude histograms or quantile-based statistics.
6 comments
Additional Evidence
The fixed definition also makes cross-model transfer possible. In a new experiment, we applied a probe trained on Qwen3-8B directly to Qwen3-14B answers, and vice versa, without using any target-model labels. Over 16 cells (two directions × eight datasets), the transferred probe averages 63.87 AUROC. Supervised detectors such as MIND and SAPLMA take inputs whose size depends on the model, so they cannot be transferred this way. We therefore compare with HaloScope, which is not trained on correctness labels. Even though HaloScope is fitted directly on the target model’s own answers and uses target labels to choose its subspace size, score direction, and threshold, the transferred DigitTrace still outperforms it by 4.13 points on average.
Overall, DigitTrace is also highly robust. Across the 24 main cells (three models × eight datasets), it is the only one of the eight detectors that stays above chance in every cell, and it has the lowest mean standard deviation across the 50 splits (4.11). It also performs well on every kind of task: its worst rank is fifth, making it the only detector never placed in the bottom three, and its largest gap to the best detector in any cell (8.70) is the smallest of all eight.
In summary, leading digits are a deliberate choice within the family of log-magnitude binnings: their edges are fixed and data-free, they come with Benford's law as a reference, and every coordinate can be read directly. For detection, the three feature families carry different evidence and each contributes on different tasks, and together they make the full DigitTrace both accurate and stable. More broadly, DigitTrace offers a new, unconventional way to build representations, with competitive performance. We hope these new results and clarifications answer your questions, and we would be grateful if you would raise the score. We are happy to continue the discussion and hope to earn your further support.
Dear Authors,
Thanks for your rebuttal, my main concern about the effectiveness of DigitTrace remains:
Many baselines outperform DigitTrace, which makes DigitTrace not sound even though its performance is stable.
Yours, Reviewer
Answers to Q1 and Q2
Thank you for recognizing DigitTrace as a new way of constructing representations, and for appreciating the breadth of our experiments. This is exactly the value we hope the paper offers: not just a performance number, but an in-depth, well-tested understanding of a new signal, built from extensive, rigorous, and transparently reported experiments. To answer your two questions, we analyzed our existing results in more detail and ran additional experiments on the same 50 splits.
1. Independent contribution of leading-digit features (Q1). Although the three feature families have similar average scores in Table 2, each carries different evidence.
2. Why decimal leading digits rather than log-magnitude histograms or quantiles (Q2). The log-magnitude histograms and quantile statistics you mention belong to the same family as leading digits. In fact, leading digits are a special case of a log-magnitude histogram. We chose this member of the family deliberately, because it comes with a principled reference that LLM activations in fact lie close to. Our reasons are as follows.