- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Membox, a memory system for long-term dialogue. Topic Loom organizes original dialogue into boxes based on topic continuity and extracts features for retrieval. Trace Weaver links events across boxes to provide additional evidence at question-answering time. The paper evaluates the system primarily on LoCoMo, with cost and semantic accuracy analyses and supplementary experiments on DialSim.
Critical strengths
- Preserving local exchanges while connecting evidence across episodes addresses practical challenges posed by extraction omissions and fragmented evidence in long-term dialogue memory.
- Box achieves promising answer quality with lower memory-construction token usage than the locally reproduced Mem0/A-MEM baselines. The semantic accuracy gains from Trace provide further evidence of the system’s potential.
Critical weaknesses
- The results support the effectiveness of Box as a system, but I would appreciate clearer evidence of the additional benefit of adaptive topic segmentation over conventional retrieval of raw-text chunks. As the paper notes, topic segmentation and cross-memory association are established components. Comparisons with simpler alternatives and closely related approaches would help clarify the contribution of the proposed combination.
- I appreciate the retrieval-depth and expansion analyses and the semantic accuracy gains from Trace. However, the benefit of organizing events into traces beyond providing additional context remains unclear to me. For example, in Appendix Table 7, two GPT-4o-mini configurations using approximately 3,140 QA context tokens yield F1 scores of 53.95 for Box and 54.00 for Trace. Although this comparison does not cover all settings, comparisons with simpler ways of supplementing evidence would help clarify the added value of Trace.
Questions for authors
- How much additional benefit does adaptive topic segmentation provide over conventional retrieval methods that also retain the original dialogue? A comparison with standard chunking would help me better understand the specific contribution of Topic Loom.
- Building on the reported retrieval-depth and expansion analyses, could the authors compare Trace with simpler ways of adding evidence, such as directly retrieving relevant events, at comparable cost? This would strengthen my confidence in the value of organizing events into traces.
- The related work discusses methods for topic segmentation and cross-memory association, such as LightMem. Could the authors further clarify Membox’s key differences from these approaches and provide experimental comparisons? This would help me better understand the added value of the combined design.