acceptodds
Under review as a conference paper at ICLR 2027

When Does Typed Memory Help LLM Agents? A Subspace Perspective

Abstract

LLM agents increasingly rely on typed external memory, but it remains unclear when typing should outperform a strong flat retriever. We define a type as a subspace of a frozen representation space and typed memory as a complementary decomposition of stored content. At matched effective rank, typing provides no intrinsic capacity advantage over an unconstrained target-aware selector; its benefit must instead arise from inductive bias. When the target covariance has effective rank , blockwise spectral selection over label-free recovered subspaces incurs statistical dimension rather than , plus recovery and cross-block leakage costs. This gain belongs to the estimator rather than to physically separate stores: a flat retriever given the same blocks can obtain it without routing overhead, so store-specific benefits arise primarily from heterogeneous drift and per-type reliability. We instantiate these principles in , which learns write-time routing, complementary subspaces, per-type reliability and decay, and the effective number of types; provides the closed-form estimator covered by the analysis. Across seven text, image, and video benchmarks with a frozen encoder and matched rank , achieves versus for target-aware flat and for similarity-flat memory, with a benchmark-bootstrap improvement of over target-aware flat. Its gain is largest in the low-data regime: points at , at , and at . A label-free drift-heterogeneity index correlates with the cost of shared decay (Spearman , ). A risk-certificate heuristic, Type-If, also separates most negative controls from all seven benchmarks, although its decisions are sensitive to the convention constant. All empirical results use one backbone with a frozen encoder at matched effective rank.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.