acceptodds
Under review as a conference paper at ICLR 2027

Agent Memory Eviction Has a Blast Radius: Distribution-Free Tail-Risk Certificates

Abstract

Large language model (LLM) agents rely on persistent memory for long-term tasks, and limited storage makes memory eviction inevitable. One eviction action can remove evidence needed by many future queries, a magnitude that harmful-decision frequency does not record. We define the blast radius of an eviction action as the number of future queries that lose required evidence because of it, and introduce a distribution-free framework that treats each conversation as one calibration unit, allowing arbitrary dependence among its actions. Across independent and identically distributed (i.i.d.) conversations, the framework certifies an eviction threshold for catastrophe probability (CAT), the probability that some eviction harms at least a chosen number of queries, jointly with the harmed-query rate, and remains valid when attribution drift makes risk non-monotone in the threshold. We prove that, even when no eviction harms any query, no valid conversation-level bound certifies mixture conditional value-at-risk (MIX-CVaR) at tail level from fewer than about times the conversations CAT needs. On LongMemEval, certifying only the harmed-query rate at leaves the concentration of harm uncertified, and % of test streams contain an eviction that harms multiple queries; certifying CAT at jointly guarantees this share, which is % on test streams, at the cost of deleting % instead of % of memory. On memories extracted by Mem0, the joint rule certifies deleting % of memories with % of held-out streams affected. At the thresholds certified by CAT () at and , question-answering accuracy changes by about one point on average; above them, answers to queries that lost evidence turn from correct to wrong times for every reverse changes.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.