- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes OEP, an attack against agent memory that leverages edge-case experiences to mislead the agent's self-evolution. The attack is designed by injecting locally valid but non-transferable experiences into the agent's memory, considering that the injection should bypass a memory filter. The payload is designed as an adversarial triplet that articulates the consequences if the injected target method is not taken. The proposed attack has been tested on three datasets.
Critical strengths
- The paper studies a timely problem. Compared to prior work that identifies the "misaligned experience reply" phenomenon that hinders agent self-evolution from memory, this work proposes a method to amplify the "misalignment".
Critical weaknesses
-
Over-strong assumption: Agents typically execute a task and then store its abstracted execution as an experience in memory. The user only submits the task query. However, in this work, the user submits the adversarial experiences.
-
The method is non-principled, as the edge-case construction was left to an LLM without explicit formulation of distribution shift.
-
Novelty: The proposed method merely amplifies task distribution shift. Simple methods such as confidence checks may easily defend against the attack by prompting additional inspection when the past experience is deemed not applicable.
-
Experiments: The proposed method was tested on simple tasks (Math, MedQA, and Tooluse) with simple agentic paradigms, not comparable to prior work testing on more complex tasks (Autonomous driving, MIMIC, and WebShop).
-
The proposed attack was not tested against prompt injection detection.
Minor issues
- Line 248: Please capitalize 's' in "safety-aligned".
- Xiong et al. (2026) and Xiong et al. (2025b) refer to the same paper
Questions for authors
- The proposed method is claimed to be compared with Zhan et al. (2024), Dong et al. (2025), and Chen et al. (2024). But I couldn't find the corresponding results.