acceptodds
Under review as a conference paper at ICLR 2027

Query-Side Gains and Accumulation Limits in Online In-Weight Memory

Abstract

We study when online LoRA writes into a frozen 9B chat model yield usable memory, measuring readout, selection, and application against frozen controls. Under per-task isolation, InMind reaches 0.424 indirect application versus 0.312 for its frozen question comparator (historical judge protocol, not the new local judge). A pre-registered three-seed rerun meets its criterion under the primary judge; historical second-judge parsing failures leave that replication unresolved. One-shot transfers retain the margin on fresh tasks and PrefEval. A prespecified repair adds a same-inference-budget frozen hypothetical-key front end (0.328 application against 0.432) and an empty-query ablation of the same adapters (0.496 retrieval against 0.584): the application estimate is positive (+0.104 at n=125) but imprecise, and neither primary test is significant, raw or Holm-corrected. Historical coherent accumulation retrieves 0.192 versus 0.178 for frozen questions, despite a 0.705 stem-hit recall proxy. A new same-adapter control (20 personas, 146 queries) retrieves 0.212 with the correct query versus 0.082 with an empty one (equal-persona difference 0.147, conversation-cluster sign-flip p=0.0078): question conditioning within the accumulated trained state, but low absolute retrieval and no frozen arm. Paraphrase writes reverse a likelihood index's preference from exact strings to held-out paraphrases, a replicated write-format effect. A fixed-snapshot Mem0 repair isolates a query intervention (0.024 to 0.232, local Qwen judge), with ingestion workloads unmatched. Writes buy query-side readout under isolation; usable memory under accumulation is not established.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.