acceptodds
Under review as a conference paper at ICLR 2027

ExperienceIndex: Artifact-Grounded Memory

Abstract

Knowledge‑intensive tasks in domains like law, science, and technology require answering many questions by reasoning about a shared corpus of artifacts (e.g., court cases, scientific literature, or software libraries). As humans interact with these corpora, they naturally accumulate experiential knowledge about artifacts, enabling them to quickly identify the complete set of relevant artifacts for each new task. However, existing AI agents lack appropriate memory solutions to build or reuse such *artifact-grounded experience*, leading to lower answer quality and higher online cost. Existing memory solutions extract and reuse information from prior task-solving traces, but they primarily focus on user preferences, factual attributes, or abstract reasoning patterns rather than persistent artifact‑specific knowledge. We introduce **ExperienceIndex**, a novel experience layer for AI agents that captures and reuses knowledge about artifacts based on prior reasoning traces. ExperienceIndex stores two complementary forms of experience: (i) single‑artifact experiences that summarize an artifact's contribution to prior tasks and (ii) artifact‑pair experiences that encode structural relationships discovered during past reasoning. Integrated as lightweight middleware, ExperienceIndex uses an experience retrieval mechanism to guide agents toward the complete set of relevant artifacts for new tasks, improving both answer quality and efficiency. Across diverse corpora and agentic solutions with different search frameworks, ExperienceIndex delivers consistent gains, raising answer quality by up to 11.0 points and reducing online dollar cost by up to 50.5%. We further demonstrate two benefits: (i) cross‑task generalization, where experiences accumulated from text‑to‑SQL tasks transfer to factoid QA tasks over the same artifact corpus, and (ii) teacher-student learning, where experiences from a stronger model enable a weaker model to reach comparable performance. These results highlight ExperienceIndex as a general, modular approach for enabling agents to build and leverage persistent, artifact‑grounded experience.

Then back it, or bet against it.

Related papers

Open the market on this paper to see 7 more related papers.