- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper mainly investigates how personalized configuration leads to LLM Agents performing unauthorized and dangerous operations without explicit malicious instructions. The authors proposed CONTRA, a LLM-based tree-search red team framework, which automatically modifies the configuration files of the Agent, such as its identity, personality, user preferences, long-term memory, and automated tasks, to search for configurations that can induce dangerous behaviors and evaluate their safety in a simulated environment. The authors constructed SkillSafetyBench, which contains 532 real Skills and 1,869 dangerous target operations. The experiments found that 74.2% of the Skills have at least one configuration that can induce dangerous behavior, 41.7% of the target operations can be successfully triggered, and some vulnerabilities can be transferred to the real tool execution environment. Further, the authors proposed Skill-Hardening, which reduces the attack success rate by adding security instructions and tool-level protection mechanisms. The core contribution of this paper is to view the Agent's configuration and personalized mechanism as a new security attack surface, through automated red team search to discover potential risks, and to use the discovered vulnerabilities to reverse-engineer and enhance the security of Agent Skills.
Critical strengths
- Studying agent safety through personalization-induced unauthorized actions offers a fresh and practically relevant perspective.
- The evaluation covers 532 skills, with additional cross-model tests and real-execution validation.
- Using failure cases to harden skills reduces ASR from 46.9% to 27.5%, demonstrating practical value.
Critical weaknesses
- 11.2% of successful configurations were judged malicious, which conflicts with the premise of benign configurations. Results excluding these cases are needed.
- The search may also modify tasks and simulated tools, making it difficult to isolate the effect of configuration changes.
- Ablations against random search and search without feedback are missing, leaving the necessity of individual components unclear.
- The defense is mainly retested against known targets; its generalization to unseen targets and other attack methods remains unclear.
Questions for authors
- How do the main results change after excluding the 11.2% of successful configurations judged malicious?
- What ASR does CONTRA achieve when tasks and simulated tools are fixed and only configuration files can change?
- How does CONTRA compare with random configuration search or search without judge feedback under the same budget?
- Does Skill-Hardening generalize to unseen harmful targets or other attack methods? How much improvement comes from tool wrappers versus textual safety instructions?
We thank the Reviewer for their feedback. We are glad the Reviewer finds our perspective on personalization-induced unauthorized actions fresh and practically relevant, and appreciates the scale of our evaluation, including cross-model tests and real-execution validation, as well as the practical value of Skill-Hardening. We address each concern and question below.
W1 and Q1: We agree that the headline results should only include configurations that satisfy our benign-configuration requirement. We have made the two following changes to the paper:
W2 and Q2: We agree that this control is needed to isolate the effect of configuration changes. We rerun CONTRA with the task and simulated tools frozen at initialisation, so that only the configuration files change.
W3 and Q3: We would first like to clarify how judge feedback enters CONTRA. The orchestrator does not see the judge’s output when proposing modifications. The feedback is used only to select which configuration to modify next, via the heuristic score h (Section 4.1). Search without judge feedback therefore corresponds to selecting parent configurations uniformly at random from the archive. We have clarified this in Section 4.1.
We agree that these controls are needed to attribute the gains. We therefore evaluated the following variants on the top-10 skills subset, using the same budget of 125 configurations per target action and the same success criterion:
As can be seen in the table, every component of CONTRA is beneficial to an effective search. Due to computational cost, we plan to extend these ablation studies to a larger set of 25 skills for the full submission.
W4 and Q4: Skill-Hardening is designed as a targeted defense against a specific discovered failure, not as a general defense against arbitrary harmful behaviors. We have clarified this in Section 5.4. This is supported by our experiments using unseen actions. We evaluated 10 successfully hardened skills against other harmful actions of the same skill. Only one hardened skill also defended against the unseen action, confirming that each harmful action must be hardened individually. However, hardening for different actions can be chained by applying Skill-Hardening sequentially to the same skill, so that the skill accumulates safeguards for every action CONTRA discovers.
Regarding other attack methods, for the same target action, hardening transfers well. Besides withstanding a fresh CONTRA search, which explores new configurations, the hardened skills defended against Direct Instruction in 7 of 10 cases and against Prompt Injection in all 10 cases.
Tool wrappers vs. safety instructions. We took 10 skills for which CONTRA was previously successful and full Skill-Hardening defended the target action, and re-attacked them with only one of the two components applied. With only safety instructions, the ASR is 70%, and with only tool wrappers it is 50%, compared with 100% before hardening and 0% with both components. Both components therefore contribute, with tool wrappers having the larger effect, and neither suffices alone.
Given the computational cost, both experiments currently use 10 skills. We will extend the evaluations against other attack methods and of the individual hardening components to more skills in the final version.