- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper propose a probe transfer method for semantic entropy for LLM to avoid retraining. It's contribution include an affine map fitted by ridge least squares. and a decomposition of transfer outcomes, transferred error = E xor F xor D. It reports corrective versus harmful flips and the net accuracy change. It evaluates AUROC of the transferred probe of 21 ordered pairs from six open source models on 3 dataset.
Critical strengths
- A clean accounting of transfer outcomes, separating source-probe error, transfer flips and label disagreement (Eq. 6 to 12) with sufficient exp supports and negative cases are shown.
- A label-free, cheap method. the label-free layer choice nearly matches oracle layer choice with about 11.7 to 11.9 times lower cost.
Critical weaknesses
- There might be selection on the evaluation data or an unequal tuning budget issue. No seeds or intervals appear in the text or table. The ridge strength = 10⁴ was selected by transfer AUROC on the NQ test set (Appendix B.1) and reused elsewhere, while native probes keep default regularisation (Table 3).
- It is unclear if the transfer uses the target model’s own uncertainty, or only the fact that some questions are hard for every model. The acc is only compared with the source probe’s prediction, not with a target-trained probe or a majority-class guess, and I found no shuffled-pair control or pseudo-label baseline.
Questions for authors
- = 10⁴ was chosen on the NQ test set. Can you choose on a held-out split, tune the native probe's regularisation the same way, and give AUROC with 95% CI over test items?
- Can you add native-target and majority-class accuracy rows to the decomposition tables, and state the class balance of the high v.s. low labels? Can you also add a shuffled-pair control, a pseudo-label baseline ?
- How were the 2000 inputs per dataset drawn (which split, which seed)? Are the inputs and the 500 test items the same for every model and pair?
Response to Reviewer 3
We thank the reviewer for the careful review and for recognizing our error decomposition. We address each point below.
On λ selection, native regularization (W1, Q1). Yes. In the submitted version, λ was chosen from a 5-value grid by transfer AUROC on the NQ test set and reused for all settings. We have now re-selected it on NQ without test labels, using two procedures: a label-free one (held-out reconstruction error on the non-test inputs, choosing the target layer and λ jointly, as in our layer selection) and validation AUROC on a 70/30 split of the non-test inputs. In both cases, the map is refit on all 1500 non-test inputs and evaluated once on the test set. Both procedures select λ = 10⁴, the value used in the paper; the label-free procedure selects it in all 21 pairs.
We also tuned the native probe's regularization by stratified cross-validation within its own training labels, at every budget, and now report AUROC with 95% paired-bootstrap CIs over the 500 test questions (general response, points 1–2). Transfer remains close to the native probe with default regularization, but tuning substantially strengthens the native probe at larger budgets: at n = 1500, it reaches .825 [.805, .846] AUROC, against .773 [.751, .794] for transfer. We will revise our claims to reflect this gap. At smaller budgets, tuning does not consistently improve the native probe. The practical benefit of transfer is that it needs no target SE labels, and it compares favourably at matched labeling cost (125 labels).
On confidence intervals (W1). We resample the 500 test-question indices with replacement (2,000 times), jointly across all pairs and methods. These intervals quantify uncertainty over test questions, rather than variability across training runs.
On shared difficulty vs. target-specific uncertainty (W2). Source and target SE labels agree on most inputs (about 71–75% on average), and this is where transfer helps. On inputs where they disagree, corrective and harmful flips largely cancel. We therefore interpret our results cautiously: the evidence for beneficial transfer comes primarily from inputs on which the models' uncertainty labels agree, and we will state this explicitly.
On accuracy baselines and class balance (Q2). We added these (NQ, n = 1500, mean over 21 pairs):
High-entropy labels make up 58–63% of the test labels for four of the five target models and 41% for Qwen3-8B. The majority class is chosen from the 1500 non-test labels. The transferred probe beats the majority class in 18 of 21 pairs. The native probe, trained on 1500 target labels at the same layer, is more accurate, consistent with our AUROC results. We will add these rows to the decomposition tables.
On the shuffled-pair control (Q2). To test whether transfer relies on question-level correspondence, we refit the alignment map on deliberately mismatched pairs, keeping everything else fixed (same layers, λ = 10⁴ and source probe). Target states were randomly permuted relative to source states over the 1500 non-test questions, with 5 seeds. On NQ (n = 1500, mean over 21 pairs, 95% bootstrap CIs over test questions), transferred AUROC falls from .773 [.751, .794] to .498 [.490, .507], i.e. chance level, and every pair's mean lies between .47 and .53. Transfer therefore depends on how the same question is represented in both models, not on their overall statistics.
On the pseudo-label baseline (Q2). We train a probe on the target model's hidden states (same layer as the transferred probe) using the source model's SE labels as pseudo-labels, with regularization tuned on those labels. On NQ, transfer outperforms this baseline at every evaluated budget. At n = 1500, the baseline's mean AUROC is .763 [.741, .785], compared with .773 [.751, .794] for transfer; the difference is +.010 [+.006, +.014] (95% paired-bootstrap CIs over test questions). This supports an advantage over directly training a target probe on source SE labels. We will add the full results for all budgets to the revision.
On data (Q3). We follow the data-generation code of Han et al. (2024b). For each dataset, 2,000 questions are sampled without replacement (seed 20) from an evaluation split: the NQ-Open validation split, the SQuAD v2.0 validation split, and, for TriviaQA, a held-out 20% split (seed 20). The 2,000 questions are then split once, with a fixed seed, into 500 test and 1,500 training questions. All models use the same 2,000 questions, prompt and split, so every pair shares the same 500 test questions; we verified that the question ids are identical across all six models.