- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes MemorAnDA, a conversational memory architecture, which separates reusable history organization from question-specific access to original evidence. A query-agnostic construction stage produces semantic, temporal, and state-transition views linked to original dialogue records through durable source IDs. At query time, direct and view-based retrieval generate candidates, and a source-aware selector assembles original records under an evidence-token budget without additional generative retrieval calls. Experiments report improvements over LightMem across 2 benchmarks and 3 matched build/reader model groups.
Critical strengths
(S1) Tables 1 and 2 report consistent overall improvements over LightMem across all six benchmark–backbone combinations. At the primary 8K configuration, gains range from 7.60% to 10.20% on LoCoMo and from 1.40 to 9.80 points on LongMemEval-S, demonstrating the practical effectiveness.
(S2) Table 12 provides an important controlled comparison beyond the main baseline results. This supports the usefulness of compiled retrieval cues on LoCoMo with GPT-4o-mini and rules out increased evidence length as the sole explanation in this setting.
(S3) The paper reflects substantial effort in system implementation and experimental evaluation. The presentation is clear and well organized, making the framework and experiments easy to follow.
Critical weaknesses
(W1) Table 3 shows higher accuracy than LightMem, but MemorAnDA also uses 2.76–3.09× the query tokens. The paper is clear about this trade-off. I would like to see both methods tested with similar reader budgets to understand how much of the gain remains.
(W2) It is hard to tell how much the proposed selector helps. Section 4.4 changes the retrieval routes but keeps the selector fixed. Would a simpler approach (scoring sources, removing duplicates, and filling the token budget) work just as well? Since the selector is listed as a main contribution, this comparison matters.
(W3) The expanded atomic control in Section 4.4 only covers GPT-4o-mini on LoCoMo. On LongMemEval, the paper reports better evidence coverage without consistent gains in answer accuracy. I would like to see the same equal-budget comparison across more backbones and both benchmarks to understand when compiled navigation helps.
(W4) What MemorAnDA adds beyond existing source-linked retrieval methods is a concern. Section 2 discusses methods that prepare retrieval cues in advance or preserve the original dialogue, but the experiments do not include a close baseline with both capabilities. Beating raw-only retrieval shows that compiled cues help, but it does not tell us what the proposed architecture adds to this existing approach.
Questions for authors
(Q1) In Section 4.3, Table 3, how does MemorAnDA compare with LightMem when both use similar reader-token budgets?
(Q2) With the same candidates and token budget, does the selector in Section 3.4, Eq (1), outperform simple source ranking, deduplication, and budgeted packing?
(Q3) Does the equal-budget Atomic-480 comparison in Section 4.4 also show gains on LongMemEval and with the other backbones?
(Q4) Section 2 discusses precomputed retrieval cues linked to source evidence. How does MemorAnDA compare with a close baseline using this design under the same reader and evidence budget?