- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates how language models choose between contextual information and parametric memory when the two sources conflict. The authors extract authority-related directions using prompts with different authority cues and evaluate their causal effects through activation steering and activation interchange. Experiments on Qwen, Llama, and OLMo suggest that these directions can influence source selection within individual tasks, while their cross-task transferability remains limited.
Critical strengths
The paper makes a useful distinction between representational decodability and causal effectiveness, rather than inferring model mechanisms solely from linear probing or steering results. The evaluation also covers multiple model families and includes random and covariance-matched controls, which strengthens the empirical analysis.
Critical weaknesses
My main concern is that the paper does not sufficiently explain how the model actually chooses between context and memory. Showing that certain activation directions can influence the final prediction does not necessarily reveal the underlying selection mechanism. In particular, the paper provides limited insight into how these directions emerge, which computational components produce the relevant signals, and how these signals contribute to the final decision. The current contribution appears closer to a causal evaluation of activation steering than a mechanistic explanation of source selection.
Figure 3 raises an important concern. Increasing the intervention dimensionality substantially improves mediation, but randomized and shuffled-label controls achieve comparable or even stronger effects. This suggests that improved intervention performance may not originate from authority-specific information, but instead from the increased dimensionality of the manipulated representation. Although the authors acknowledge this limitation, it weakens the interpretation of the results as evidence for a specific authority mechanism.
The experiments primarily focus on colors, object materials, and state/country facts, with many evaluations relying on next-token prediction over fixed candidate sets. While these settings provide experimental control, they are considerably simpler than context-memory conflicts encountered in realistic language model applications. Real-world scenarios often involve longer contexts, multiple conflicting sources, and more complex reasoning.
Questions for authors
see Weaknesses