- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates why the exact same final request can lead to refusal in a single-turn setting but compliance after a multi-turn conversation. Using Llama-3.1-8B-Instruct with fixed final requests and Crescendo attack histories, the authors combine history controls, residual-state interchange, activation steering, cross-layer pinning, and attention-head interventions. Their main contribution is a causal framework linking conversation history, response-opening internal state, refusal or compliance. They show that the full interaction between both user and assistant, especially the assistant’s most recent reply, materially affects behavior; much of this effect is carried by the model’s internal state at the beginning of the answer. They also find that the effective components change across layers, and that a strong refusal direction can substantially alter behavior but cannot by itself recover the full effect of conversation history.
The paper validates these claims through multiple controlled and causal experiments. Transferring single-turn response-opening states into multi-turn attack contexts substantially restores refusal, while transferring multi-turn states into single-turn contexts increases compliance. Attention interventions further identify heads that read explicit refusal wording from the previous assistant response, and timing experiments show that interventions at the start of generation are much more effective at restoring genuine refusal than later interventions, which mainly alter answer content. The authors also evaluate capability and over-refusal costs, and report preliminary similar phenomena on Gemma3-4B and Qwen3-8B, though the full quantitative analysis is limited to Llama-3.1-8B-Instruct.
Critical strengths
Strong causal mechanistic design. The paper fixes the final request and varies only the conversation history, then combines history controls, state interchange, steering, cross-layer pinning, and attention-head interventions. This allows the authors to go beyond correlation and identify internal states that causally influence refusal versus compliance, making the mechanistic contribution substantially stronger than simply demonstrating a multi-turn jailbreak effect.
Multiple complementary experiments support the main claims. Reversal, induction, rescue, attention-source, and intervention-timing experiments consistently point to the response-opening state as a key decision stage, while also showing that a single refusal direction cannot explain the full history effect. This convergence of evidence makes the central conclusions more convincing and consequential for understanding multi-turn safety behavior.
Critical weaknesses
Limited external validity. The full quantitative mechanistic analysis is conducted almost entirely on Llama-3.1-8B-Instruct with Crescendo. The results on Gemma3-4B and Qwen3-8B are only preliminary and lack systematic quantitative validation. It is therefore unclear whether the identified mechanisms generalize across model families, scales, or other multi-turn attack settings.
The main mechanistic results rely heavily on a selected subset. Many of the central state-interchange, rescue, and cross-layer analyses are conducted on 64 trajectories selected because their behavior changed with conversation history. Although the paper provides larger-scale replication for some directions and attention interventions, the key state-transfer results are not validated on an unselected evaluation set. This makes it difficult to determine how sensitive the reported effect sizes and mechanistic pathways are to the selection procedure.
Questions for authors
The 64 trajectories used for the main mechanistic analyses were selected because their behavior changed with conversation history. Do the core response-opening state interchange results remain qualitatively similar on the full 219 evaluation trajectories, or on another unselected subset? This would materially affect my assessment of how selection-sensitive the central mechanistic claims are.