- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies turn amplification, an attack that increases interaction length and inference costs through persistent clarification-seeking and delayed task completion. The authors induce this behavior through activation steering, LoRA fine-tuning, and targeted bit flips, and develop an interaction-level auditing framework to evaluate attack effectiveness and potential countermeasures.
Critical strengths
-
Novel perspective with practical relevance. Under usage-based billing, LLM service providers may unnecessarily prolong user conversations to increase revenue, which is a plausible real-world risk. The paper extends the study of cost-amplification attacks from single-turn generation to entire interactions and systematically investigates this issue.
-
Systematic empirical evaluation. The experiments cover multiple models, datasets, and two user engagement modes. Together with multiple attack implementations and ablation studies, they provide solid evidence for the feasibility of turn amplification.
Critical weaknesses
-
Limited evidence for capability preservation. Accuracy is computed only over valid responses, while simulated users sometimes provide intermediate reasoning or even final answers. These factors limit the support for the claim that the target model’s capabilities are preserved.
-
Some counterintuitive results remain insufficiently explained. For example, the Defensive System Message strengthens the turn amplification induced by Prefilling, but this effect is not adequately discussed.
Questions for authors
-
Could the authors report the overall correct-completion rate across all questions and evaluate a user simulator that does not provide solution steps or final answers, to further validate capability preservation?
-
For Llama3-8B on Alpaca under Mode 1, why does the Defensive System Message increase the average number of turns under Prefilling from 3.3 to 6.4 (Tables 1 and 3)? Is this effect consistent across repeated runs, and what might explain it?