acceptodds
Under review as a conference paper at ICLR 2027

How Much Must a Ridge Learner Remember to Delete Data?

Abstract

An offline ridge learner retains a finite-bit summary; a decoder receives deleted records and approximates the retained-data optimum without accessing the retained records. How do regularization, accuracy, and deletion size determine the necessary memory? For bounded grid inputs, , and a fixed deletion fraction, the worst-case memory is bits within one factor , for sufficiently small additive or relative error . When and the deletion budget vanishes, the additive law becomes within a precision logarithm. For bounded noiseless teachers, a joint rank law is matching when is bounded. A determinantal response envelope extends its upper bound to every budget with an overhead. A routing construction proves that an overhead is necessary along explicit families, despite a common teacher, original optimizer, and legal requests. Thus the law persists within polylogarithmic factors for , while extensions beyond that scale can fail. The lower bounds allow pointwise randomized success; deterministic summaries attain the upper bounds. Residual importance sampling gives a polynomial bit encoder for a general-label DPP bound. Controlled and frozen-feature experiments assess accuracy and storage. These guarantees concern optimization utility, not distributional certification of unlearning.

Then back it, or bet against it.

Related papers

Open the market on this paper to see 7 more related papers.