- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper takes three common steering directions (one for truth, two for following the given passage), applies them to five open models, and asks two questions: does the effect beat a random vector of the same size, and what else changes? Context steering does beat random, but which version works best differs by model, and it makes models answer questions the passage can’t answer, and sometimes lowers truthfulness. The usual truth direction does not beat random at the settings validation picks, and mostly just makes the model decline to answer. A better-built truth direction, applied at later layers, helps only on Llama, and even there it makes the model get more answers wrong when the passage is correct. Takeaway: a gain on the metric you tuned for is weak evidence on its own.
Critical strengths
-
The paper makes a convincing case that steering work should routinely report matched random-vector baselines and ablations (layer sweeps, dose comparisons, extraction-source checks) alongside the behaviours the selection metric doesn’t capture, rather than only the gain on the target metric. Given how many papers have reported truthfulness and context directions on the strength of a single tuned metric, this is a welcome step back and the kind of plausibility checking the area has needed. The controls are also important, they change conclusions: the calibrated truth direction’s MC1 gain sits inside the random-vector band, and the negation test explains why the validation-chosen layers fail.
-
The authors check their own work carefully. They flag 14% of ConFiQA test items as possibly defective and re-score without them, have two annotators blind-check the automatic judge and report agreement, admit they could not reproduce ContextFocus’s published gain, and state plainly when a setting was chosen on test data. This is the same standard they ask of others, applied to themselves.
Critical weaknesses
-
The evidence is strong for one model and thin for the others. Llama 3.1 8B Instruct gets 50 random vectors; the remaining models get 5–10. The “five models” framing is really one well-tested model plus four lightly tested ones. The random vectors are also the simplest kind (isotropic), which the authors concede is a weak null in anisotropic activation space.
-
The truthfulness metric is shaky. The paper uses MC2 candidate sets for MC1, so chance is already ~0.45 and the numbers are not comparable to published scores, and “I have no comment” is a true candidate on 80 of 616 questions, so the metric can be gamed by declining (acknowledged in the paper). This weakens both the negative result (the standard truth direction doesn’t help) and the positive one (the later-layer direction helps on Llama). The natural remedy, judging free-form answers, has only moderate human agreement on informativeness and was not applied to the later-layer t_G answers at all, so the one positive truth result is the least independently checked.
Questions for authors
- Would the main conclusions survive stronger nulls? In particular, if random directions were drawn with the covariance of the activations (or restricted to the top principal subspace) rather than isotropically, would the context directions still exceed every matched random vector on the four lightly tested models?
Thank you for the review, and for the question on stronger nulls, which led to the most informative new experiment.
1. Would the conclusions survive stronger nulls? In rank, yes; in margin, only partly. For each model we drew 20 random directions from the covariance of the unsteered hidden states at the steering layer and 20 from its top 50 principal components, scaled them to the length of the stronger context direction, and evaluated them on the full test set. The learned direction exceeds every one of the 40 on all five models, so the literal answer to your question is yes. But on four models the margin is small: the best structured vector comes within 4 points of the learned direction on Llama Instruct, Llama base, Qwen 2.5 and Mistral, where the best isotropic vector stays at least 10 points behind. A paired comparison on the same items still separates the learned direction from the best structured vector on Llama Instruct, but not on the other three. Only on Qwen 3.5 do structured vectors behave like isotropic ones. On Mistral the structured vectors that help most are partly aligned with the learned direction; on Qwen 2.5 and Llama Instruct the best top-50 vectors are almost orthogonal to it. We report this as a result in Section 4, and the abstract no longer says without qualification that context steering exceeds all matched random vectors.
2. Evidence was thin outside one model. Every model now has 25 isotropic random vectors for each calibrated direction, scored on the same test items as the learned directions. Llama Instruct keeps the two 50-vector families of the submission in addition. The stronger context direction exceeds all of them on every model. The calibrated truth direction does not exceed them on MC1 on any model.
3. The truthfulness metric. We ran three checks (Appendix I, Tables 14 and 15).
The positive truth result is therefore now stated for Llama Instruct, with Llama base as a weaker, qualified case.
One correction on the free-form check: the judge was applied to the later-layer answers (Section 7 reports that it labels fewer of them informative than unsteered answers; Table 11 gives the values, together with a new coherence label, under which more of them are coherent than unsteered answers). What is missing is a human audit of those labels, and we agree that this leaves the positive result less independently checked than the others. The limitations say so.