acceptodds
Under review as a conference paper at ICLR 2027

Causal Memory Policy: Making Memory Utility Identifiable by Intervening on Retrieval

Abstract

Memory-augmented large language models must decide which memories to retain, and recent systems do so by estimating each memory's effect on task performance. However, these estimates rely entirely on retrieved memories. When a memory is never retrieved, store-level interventions produce identical outcomes, leaving its utility unidentified. This is a retrieval-level positivity violation, invisible to diagnostics that examine only memory operations. We introduce Causal Memory Policy (CMP), a causal framework that restores identification by intervening on retrieval itself, reserving a fixed number of context slots for memories sampled with known propensity scores. CMP estimates memory utility via self-normalized inverse propensity weighting under a balanced assignment design with fixed sampling propensities. We prove the causal factorization of memory utility through retrieval, the unbiasedness and exact variance of the estimator, and the optimal decision rule under irreversible operations. Empirically, identification fails for of required memories on LongMemEval and on LoCoMo, and the failure persists in a deployed memory system. CMP improves discrimination between required and non-required memories from to AUC. Finally, we show that identified memory utility alone is insufficient for retention decisions: per-query utility reaches AUC on the query for which it is estimated. Code is available at: https://anonymous.4open.science/r/cmp-release-D0C3/.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.