- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates the security risks of tool calls in voice agents. The authors identify a limitation of relying on teacher-forced loss for optimization and candidate selection. A lower loss does not always lead to successful execution and may cause successful attack candidates to be discarded. To address this issue, the authors propose ActionWhisper, which combines speech-difference initialization, two-phase argument curriculum, and executor-grounded candidate selection to improve attack success rates. The authors also introduce Action-Suite-120, a benchmark containing 120 executable attack cases. Experiments on four Audio LLMs and two agent frameworks compare ActionWhisper with existing baselines.
Critical strengths
-
This paper highlights the risk of audio adversarial attacks causing incorrect tool calls in voice agents. Such risks may be overlooked when evaluating only the model's generated responses.This is a relevant security concern worth investigating. The proposed execution-grounded candidate selection strategy also provides a practical way to evaluate and retain successful attack candidates.
-
The paper identifies a limitation of relying solely on teacher-forced loss for adversarial audio optimization. A lower loss does not necessarily correspond to successful execution of the target action and may even cause successful attack candidates to be discarded during selection. This observation is interesting and provides useful insight into the mismatch between optimization objectives and actual execution outcomes.
Critical weaknesses
-
Lack of innovation. The paper focuses on audio adversarial attacks that induce incorrect tool calls in voice agents. Although this is an important problem, the paper does not provide enough evidence to show how common or serious this issue is in existing attacks. The proposed method mainly combines existing techniques, including gradient-based optimization, staged loss weighting, and executor-grounded candidate selection. It appears to be an engineering improvement for a specific attack scenario rather than a fundamentally new method.
-
Limited experimental scale. The evaluation includes only 120 attack cases, with limited diversity in tasks and argument combinations. This makes it difficult to assess how well the findings generalize to other scenarios. In addition, the main experiments use only a single random seed. The paper does not report repeated trials, confidence intervals, or statistical significance tests.
Questions for authors
-
How common is the loss-execution mismatch in existing attacks? The paper argues that where a lower teacher-forced loss leads to unsuccessful tool execution. However, it is unclear how frequently this occurs across different models and attack methods. Could the authors provide quantitative evidence of this phenomenon and its impact on attack success rates?
-
How much of the improvement comes from executor-grounded selection? The main baselines do not use the same candidate selection strategy as ActionWhisper. Would ActionWhisper still outperform these methods if all baselines used the same strategy as ActionWhisper?
-
The evaluation uses 120 attack cases and a single random seed. Could the authors provide results across multiple random seeds or statistical significance analysis?
Dear Reviewer RKvV,
We are writing to follow up on our response to your three questions. In brief:
We would value your view on whether this evidence is sufficient, and we are happy to provide anything further you would find helpful.
Best regards, The Authors