- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The authors train linear probes on the hidden states of several open-weight language models to perform binary classification between prompt types along six dimensions that they define. These dimensions are evaluation awareness, self-assessed capability, perceived risk, computational effort, audience expertise, and intentionality.
The authors measure how well linear probes can classify between prompts instantiating each side of each category. They also perform some steering on these linear directions to see how it affects generation.
Critical strengths
None
Critical weaknesses
1. Experimental Soundness
The framework of the paper is not novel, and it therefore should be evaluated on its experimental merits.
The experiments are limited and raise questions. Some models seem to have a test-set size of n=7, n=4 and n=2 at times; large (30B) models are evaluated on GSM8K and SimmpleQA, rather than more scale-appropriate benchmarks. Positive examples provided in the appendix contain incorrect answers, and accuracies on SimpleQA are not reported. The supplementary material contains a padding bug which could potentially contaminate results by decoding based on a padding token. Some models reach below-change accuracy by a good margin (e.g.
2. Presentation and Scope
The text largely consists of dense, potentially automated text describing low-level effects that often do not match the data they describe. Example:
Intentionality is load-bearing for accuracy. Suppression degrades accuracy monotonically"
while in fact this monotonicity only holds below zero. Many claims are as such. At the same time, a large amount of relevant prior work is uncited and directly erodes the novelty of the paper. A few relevant examples:
- Contrastive Activation Addition, Panickssery et al 2024
- "Steering Evaluation-Aware LMs to Act like They Are Deployed" Hua et al ICLR 2026
- Situational Awareness Dataset, Laine et al NeurIPS 2024
Without comprehensive prior literature review, the novelty of the paper remains limited, especially when coupled with the unsound experiments as reported above.
Questions for authors
- All accuracies in Table 10 are multiples of 1/7, which is different than all of the other models. Does Qwen3-235B-A22B use a different test set than the rest of the models, consisting of seven examples?
- For SimpleQA, all Qwen results up to 30B are multiples of 1/32; 235B and Llama-4 are multiples of ¼. I see n = 16 earlier in the paper. Is large-model decodability based on 4 SimpleQA questions? Similarly, the supplementary material seems to suggest n = 2 for the 235B and llama-4 models. Is this accurate?
- Are the questions used for steering the same as those used to train the probes for the n = 100 run?
- The supplementary material code appears to have a bug, by which text is left-padded rather than right-padded, with the offset still determined by the token length of the prompt; thus, the read token may be in the middle of a prompt or simply be a pre-prompt padding token. Does this match the setup that experiments were run in?
- Where do below-chance results come from? (e.g. 0.6B at 0.39 - 0.48; Llama-4 audience 0.14 - 0.43. Both of these are binary classification).
- Is the eval or audience data copied from the other in Table 7?
- Is the main steering experiment present in the supplementary material, or intended to be released?
- How does the performance degradation from injecting steering vectors compare against injecting random-direction vectors of the same norms?
- Do steering results hold on MMLU-Pro?
- The included steering runs hit the token truncation cap every time for 0.6B and 14B models. Was a longer truncation cap considered, and how much of steering effects is due to this sort of truncation?
- The example given in lines 1286 - 1289 is incorrect. So is the example in lines 1330 - 1332. Both simply become confidently wrong; there are no accuracies reported for SimpleQA, suggesting that steering could simply lead to confidently wrong conclusions. Are there SimpleQA accuracy scores both for baseline and steered models?
- Does the causal paraphrase match what the Qwen model was post-trained on?