- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies why a linearly decodable direction in the residual stream sometimes steers generation and sometimes does not. It argues the readout/control verdict is set jointly by (i) concept structure (generation-mode concepts such as tone/register vs. topic concepts) and (ii) the extraction pipeline (separability-gated head-level selection vs. an unselected residual difference-of-means).
Critical strengths
- I think experiments part are good. Random baseline directions go through the exact same pipeline, two independent judges are used, and the constraint experiment needs no LLM judge at all. The same-subject comparison with token ablation (Table 1) is the cleanest evidence in the paper.
Critical weaknesses
- The title claim, that the same concept flips from readout to control depending on the pipeline, gets one paragraph with no numbers, and that comparison changes both where the vector is injected and whether layers are selected. The main result, that style steers more easily than topic, is fairly expected, and it fades in the largest models (Qwen3-14B, Gemma-2-27B), which undercuts calling concept type a fundamental determinant.
- The presentation are somewhat not that careful (figure 1/2, alg section). Tightening the presentation would improve paper's quality.
Questions for authors
N/A