- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2(+1)
Read review
Paper summary
This paper proposes U-Space/U-Lens, aiming to move beyond the limitation of traditional uncertainty quantification methods that produce only a single scalar score. It constructs an interpretable latent subspace based on four predefined semantic dimensions—ambiguity, incompleteness, conflicting evidence, and general uncertainty—and reads out token-level uncertainty along the reasoning trajectory. The semantic signal is further combined with predictive entropy to form the final trace-level uncertainty score. Its main contribution is an interpretable semantic-direction construction method that requires neither correctness labels nor additional training, together with an internal-representation analysis of when and why uncertainty arises.
Critical strengths
- The motivation of this paper is very good. Attributing uncertainty along different dimensions is a highly worthwhile direction to explore.
- The method has a certain degree of interpretability. The technical approach of constructing label-free interpretable latent directions through semantic anchors is itself insightful.
- The experimental coverage is relatively broad, and the exploration of the method’s generality is fairly proactive. Although the length-related experiments are debatable, the experiments themselves are well designed. The authors recognize that merely showing correlational activation heatmaps is insufficient and therefore further attempt causal interventions, which is commendable.
- Computational efficiency and deployment friendliness are clear advantages.
- The presentation quality of the paper is good. The figures and tables are all well designed.
Critical weaknesses
-
The methodological novelty and the primary evaluation objective are not truly aligned. The paper claims that U-Space decomposes uncertainty into four interpretable dimensions and emphasizes its goal of answering when and why uncertainty arises. However, in the main experiments, the authors ultimately aggregate the four dimensions into a single score and use conventional correct/incorrect discrimination metrics as the primary evaluation criteria. As a result, the paper’s most distinctive contribution, namely “structured uncertainty attribution,” is not directly validated. The current validation of the category semantics mainly relies on only 12 manually constructed matched prompt pairs per category and several qualitative examples. A more appropriate experimental design would treat uncertainty attribution itself as the primary task and correctness prediction as a downstream application.
-
The authors divide uncertainty into four dimensions, but the orthogonality of these dimensions is imposed by the algorithm rather than being an intrinsic property of the dimensions themselves. For example, in Appendix C, the authors obtain different uncertainty directions using matched-prompt activation differences, and the pairwise cosine similarities among several directions are 0.51, 0.60, and 0.65, indicating substantial correlations. Moreover, after enforcing orthogonality algorithmically, do the resulting category directions still preserve their original semantic meanings?
-
The paper motivates the necessity of length-controlled evaluation by observing that incorrect answers are substantially longer than correct answers. Prior work cited by the paper has shown that different correctness evaluation methods may exhibit substantial length bias [1]. String-matching-based methods are highly sensitive to response length, whereas LLM-based evaluation criteria are much less sensitive to length. I would like to know how much of the observed length–correctness association remains if the same set of samples is relabeled using an LLM-based evaluator.
-
The current experimental results are not sufficient to establish that the advantage of U-Lens over existing methods has been evaluated fairly and reliably. Many baselines perform substantially worse in this paper than the levels commonly reported in their original papers or other standard evaluations. For example, Semantic Entropy achieves an average AUROC of 0.790 across 30 model–task combinations in the original paper, whereas it achieves only 0.646 in this paper; similarly, P(True) decreases from approximately 0.698 in the original paper to 0.567 here [2].
-
There is an inconsistency between the code and the paper that may directly affect the reported results. The paper defines the U-Space category direction by separately normalizing the centroids of the positive and negative anchors, i.e., However, in src/uspace.py, the code normalizes only the individual anchor directions; after computing the positive and negative centroids, it does not normalize the two centroids separately before taking their difference. This means that the U-Space actually constructed by the code is different from the formulation described in the paper, which may in turn affect Acone, U-Lens, token-level attribution, steering, and all other results that depend on this basis.
[1] Santilli, A., Golinski, A., Kirchhof, M., Danieli, F., Blaas, A., Xiong, M., Zappella, L., & Williamson, S. (2025). Revisiting Uncertainty Quantification Evaluation in Language Models: Spurious Interactions with Response Length Bias Results. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 743–759.
[2] Farquhar, S., Kossen, J., Kuhn, L., & Gal, Y. (2024). Detecting Hallucinations in Large Language Models Using Semantic Entropy. Nature, 630(8017), 625–630.
Questions for authors
- Could the authors provide evidence that the main conclusions are robust to the correctness evaluator? I would like to know whether the length–correctness association and the relative advantage of U-Lens persist when the same outputs are relabeled using an LLM-based evaluator or another less length-sensitive correctness criterion.
- Could the authors clarify whether the four orthogonalized U-Space axes still preserve category-specific semantics after orthogonalization?
- Could the authors explain why several baselines perform substantially worse than the results reported in their original papers?
4 comments
Thank you again for your time and thoughtful feedback on our submission.
As the discussion period is approaching its end on November 18 (AoE), we wanted to kindly follow up to see if our previous responses and the revised manuscript have adequately addressed your concerns. If any points remain unclear or if you have any further questions, please let us know. We would be more than happy to clarify them promptly before the deadline.
Best regards, Authors
The authors have addressed most of my concerns, particularly regarding reproducibility, and I have increased the Soundness score to 2. As a side note, I am also working on uncertainty attribution research. I believe the problem with current uncertainty quantification methods is that they struggle to identify what specific risks are present and what interventions should be taken, which greatly limits the usefulness of uncertainty in supporting practical decision-making. I had hoped to find some inspiration in the authors' work, but they still follow the traditional UQ evaluation paradigm, which is somewhat disappointing. Nevertheless, overall, this is a good paper.
Thank you for revisiting our work and increasing the Soundness score! We share your concern regarding current uncertainty estimates and their limited practical value, which is precisely why we proposed our interpretable U-Space approach. We debated evaluation approaches extensively but chose not to introduce a new paradigm, as our length-controlled evaluation already highlights another deficit in current evaluations (the potential length shortcut) affecting many UQ methods. Comparability with existing methods was another factor, though we remain keen to explore alternatives that better capture practical usefulness. Intrinsic ground truth for model uncertainty remains hard to capture, but we did consider controlled task difficulty as a proxy, especially in domains where difficulty can be increased gradually. Overall, we see our readouts through verbalizable concepts as a promising step toward more detailed uncertainty attribution. Our steering results suggest that the identified directions causally influence model outputs, opening a promising avenue for intervention, while leaving open which interventions are appropriate for each uncertainty type. We hope our work offers something useful for your research and would welcome your suggestions for evaluating these aspects more directly. If our clarifications have addressed your remaining concerns and you deem our work useful for the scientific community, we would appreciate it if that could be reflected in the overall recommendation as well.
Thank you for the thoughtful review. We appreciate that you find the attribution of uncertainty to distinct dimensions worthwhile and are especially grateful for raising the inconsistency between the code and the paper.
W1: Attribution vs. aggregated evaluation. This touches on a key difficulty of uncertainty quantification. Uncertainty itself has no ground truth, so it is almost always evaluated as a proxy for answer correctness, a label that exists only at the output (Beigi et al., 2024). It is therefore not obvious how to test whether a model is uncertain at a given point of its reasoning, or why. We use correctness because it is the established protocol and allows a fair comparison with existing estimators, but we agree that it does not test the attribution itself. A first step toward such a test is to use inputs whose source of uncertainty is fixed by construction. We ran a test, specified before any trace was generated, on the Known-Unknown Questions dataset (Amayuelas et al., 2024), whose unanswerable questions are annotated as ambiguous, unsolved, about the future, or controversial. The matching category is identified with an AUROC of 62 to 65 across the three models, against about 50 for random bases and 55 to 59 for counting the anchor words, with both margins significant on every model. Notably, the source becomes visible over the course of the reasoning rather than in its final state, which is what the token-level readout is designed for. We added the test to Appendix E: Interpretability of Contrastive Activation Differences. We see this as an encouraging but partial answer to an open question and would be glad to discuss how attribution during reasoning could be evaluated more directly.
W2 and Q2: Decodability after orthogonalization. Each orthogonalized axis still decodes to the vocabulary of its category. We decoded every column of Uℓ through the J-Lens over the full vocabulary and added the result to the new Appendix D: Axis and Orthogonalization Ablation. On all three models, each axis keeps the anchors of its own category at the 98th to 100th percentile of the vocabulary, while the anchors of the other categories fall by 15 to 22 percentile points. Orthogonalization thus makes each axis more specific to its category.
W3 and Q1: Length-confound of correctness evaluator. We relabeled every response of seed 42 with an LLM judge, Qwen3-32B, a model we do not evaluate. The judge sees the question, the reference answer and the final answer of each response, but never the reasoning trace, so the length of the trace cannot influence its verdict. It agrees with our graders on 93.9 to 99.7 percent of the responses per model and benchmark. The association between length and correctness does not weaken. The AUROC of generation length for predicting an error is as high or higher under judge labels in 11 of 12 model and benchmark combinations. The lead of U-Lens over the strongest baseline under length control also persists and grows slightly, from 1.3, 1.2 and 4.2 to 2.0, 1.8 and 4.8 AUROC points. We added this analysis to Appendix H: Extended Results.
W4 and Q3: Baseline performance delta. Thank you for raising this. Part of the gap concerns the sampling temperature. The submission sampled Semantic Entropy (SE) at 0.5, the setting recommended by Kuhn et al. (2023), and the temperature sweep in our response to Reviewer UVBE shows that this is not the strongest setting for our models. The revised paper therefore samples at each model's own temperature. Another difference lies in the setting. The 0.790 of Farquhar et al. averages short-form QA with sentence-length answers, whereas our responses are reasoning traces with a median length of 3.8k to 14.9k tokens, mostly on hard multi-step benchmarks. SE was not designed for such traces. Thus, we adapted it further in its favor. We first identified where each model states its final answer and adapted SE so that its entailment model, which can only read a limited number of tokens, receives the portion of each answer where that statement appears. This raises Semantic Entropy from 64.6 to 67.8 AUROC on average, and on TriviaQA, the benchmark closest to the setting of Farquhar et al., it reaches 79.5 to 84.1. U-Lens still leads it by 3.2 AUROC points on average and by 3.3 under length control, both significant. The same difference in setting applies to P(True), which here judges answers to hard multi-step problems reached after long reasoning rather than short factual answers.
W5: Equation and code. Thank you for checking the code this closely and catching this. You are right, the code averages the normalized anchor directions of each pole and normalizes only the difference of the two centroids, whereas Eq. 1 additionally normalized each centroid. The error was in the equation. All results in the paper were produced with the released implementation and are therefore unaffected. We corrected Eq. 1 in the revised version.