Curvature as Decoder State: Exact Cache–Update Frontiers for Strongly Convex Unlearning
Abstract
Machine unlearning depends on what task-dependent state survives deployment and what a later deletion request reveals. We separate pre-request decoder state from post-request delivery and study reconstruction of a fixed retraining procedure under an explicit serialized interface. For smooth strongly convex objectives, parameters plus a revealed deletion gradient leave an exact -dimensional compatible-target ball, while exact curvature on orthogonal directions removes precisely dimensions from the high-rate description length. A request-oblivious cache that must hedge future directions instead preserves symmetric degrees of freedom, distinguishing the state-only and request-time coefficients. Ridge regression realizes these statements through an exact Woodbury downdate: retained rows and exact sufficient statistics require no additional transcript under their stated interfaces, whereas parameters alone require bits on a compact family. A fixed float64 audit covering cells, paired requests, and state/interface evaluations confirms that sufficient statistics are dominated by parameters on all nine identifier-only surfaces but become nondominated when requests expose deleted values. Gaussian-design tests recover the predicted request scaling and curvature fluctuations for retained sample size , while the selected curvature caches in our main comparison reduce delivery by – only by increasing serialized state and requiring repeated requests to amortize it. The resulting frontier prices curvature as decoder state, not free compression, and makes no zero-memory, universal finite-bit, or end-to-end neural-converse claim.
Then back it, or bet against it.
Related papers
Open the market on this paper to see 7 more related papers.