- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The central question discussed in this paper is, agent not only needs to remember prior experiences, but "when" to use these experiences, and how to improve future memory selection based on the actual utilities of existing memories.
The paper proposes CaseMem that includes the memory construction & retrieval using structured records, task grounding of memories to current tasks, and outcome-driven memory reuse.
On the MemoryArena shopping benchmark, CaseMem with qwen3-32b outperforms baselines and the authors also evaluated on Locomo, longmemeval-S and AMA-bench, showing that CaseMem is competitive with relatively low memory-construction cost.
Critical strengths
-
Sound setup and the system design is a practical approach. the paper makes it clear that memory retrieval doesn't necessarily mean that this particular memory fits the current task, and this is an important insight for real-world agentic systems.
-
this approach shows a method that could maintain competitive performance on memory benchmarks while keeping a low memory construction cost.
-
solid experiments with task grounding and controlled baseline comparisons.
Critical weaknesses
-
The paper argues that retrieval -> task grounding -> outcome feedback -> improved reuse could be a closed loop, as it says in Section 4.1 “Grounding experiments disable ledger updates, and feedback experiments disable grounding.”However, grounding uses a fixed predefined compatibility procedure, but this procedure doesn't participate in ledger learning. So it is still unclear whether the compatibility procedure could really be learned from historical experiences, and be used in future task solving. This weakens some of the claims in this work.
-
There might be a credit assignment problem: one task could use multiple pieces of memory but only produce a single final reward. The credit assignment in this paper is done by "behavioral similarity", but Appendix E4 shows that the AUC for this behavioral proxy is only 0.36. This is not very significant.
Questions for authors
See Weaknesses.
4 comments
Follow-up to Reviewer Dy4J
Thank you for raising the questions about experience-derived procedures and credit assignment. We wanted to highlight two new findings directly relevant to them.
Procedure n43 was distilled from a failed episode and later promoted through outcome feedback, appearing on 114 of 120 rounds without rewriting its content. We also evaluated the compatibility procedure as a selectable record in the joint grounding–ledger experiment.
For credit assignment, our equal-exposure control achieves comparable reward to behavioral credit (0.193 vs. 0.196), showing that the main controlled-store result does not depend on the behavioral similarity proxy.
We would appreciate your feedback on whether these on whether these results address the two concerns raised in your review. Thank you!
Updated my score
I appreciate the response. I've raised my score.
Thank you for taking the time to consider our responses and additional experiments. We really appreciate your feedback!
Response to Reviewer Dy4J
We thank the reviewer for the detailed review and focusing on whether a procedure learned from experience can influence later decisions. We now show the relevant steps and have removed the dependence on the behavioural credit proxy.
W1. Can a procedure be learned from experience and reused?
Experience-derived procedures can change future selection. In a naturalized store of 120 LLM-distilled records, n43 was written from a failed episode (source reward 0.40). Its failure stays as provenance, not a negative starting utility. Outcome feedback promotes it from outside the static pair to the first retrieval slot at round 8, and it is then supplied on 114 of 120 rounds; in that development stream the adaptive selector scores 0.217 versus 0.152 for static retrieval (Appendix H). Separately, two distilled natural records score 0.249 and 0.242 when supplied individually on a disjoint-source store, close to a hand-written procedure at 0.252.
Selection and grounding also run together. In a new joint experiment, the compatibility procedure is one of six selectable records and is grounded whenever supplied:
Under the released MemoryArena setting, the binder uses the agent's own recalled purchase, and binding still improves over an unbound reminder with Qwen (+0.018 [+0.005, +0.032]).
These studies establish experience-derived promotion, grounding from remembered state, and joint execution. They do not yet demonstrate automatic typed-slot induction and outcome-driven discovery of that newly written grounded procedure in a single run.
W2. Does the conclusion depend on unreliable behavioural credit?
No. Our uptake audit finds that the behavioural similarity proxy is a poor indicator of which supplied memory the agent follows (AUC 0.36). A direct equal-exposure control gives similar reward (0.193 vs. 0.196), so we recommend the simpler rule and report which credit rule each original experiment used. The positive result relies on linking the supplied set to its current outcome: substituting earlier-round outcomes reduces reward by 0.044 [0.003, 0.086] and 0.053 [0.019, 0.086] in the two controlled variants. This establishes outcome-associated preference learning, not causal attribution to each record.
We also test individual memories from identical saved task states: the second-ranked record beats the first on 16 of 33 bundles (4 losses, 13 ties). These counterfactual comparisons suggest a way to improve credit assignment, rather than a component of the reported ledger.
We believe the joint experiment, the experience-derived procedure trace and the equal-credit control directly strengthen the two points raised in the review, and we would welcome reconsideration of the assessment.