- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes T-MEM, a long-horizon multi-party conversational memory framework that uses Temporal Evidence Discovery to recover temporally localized evidence missed by global retrieval and Temporal Memory Structuring to organize messages into evidence forests with UPDATE/EXPAND relations that capture state evolution. Experiments on GroupMemBench and EverMemBench report consistent improvements over existing long-term memory baselines across two LLM backbones, supported by ablations, evidence-recall analysis, robustness tests, and efficiency evaluation.
Critical strengths
-
The paper focuses on a real problem in long-term conversations: finding the right past messages and understanding how decisions changed over time.
-
The method performs clearly better than the tested baselines on both benchmarks, and the ablation results generally support the main design choices.
Critical weaknesses
-
The method is fairly complicated and combines many existing components, so the overall technical novelty is somewhat limited.
-
The forest-vs-flat comparison is not fully clean because the forest condition also receives stronger temporal reasoning instructions in the prompt.
-
The experiments are limited to two relatively clean benchmarks, so it is unclear how well the method would work on noisier real-world conversations.
-
The reproducibility issue is serious: the submitted code is a post-hoc reconstruction from the paper rather than the actual code used to produce the reported experimental results.
Questions for authors
-
Can the authors provide the exact original code, prompts, configurations, and raw outputs used to generate Table 1, Table 2, and Figures 2–6, and explain why the submitted repository is instead described as a clean-room reconstruction derived from the manuscript?
-
Can the authors rerun the flat-vs-forest comparison with exactly the same answer prompt, removing the forest-specific UPDATE/EXPAND reasoning instructions, to show that the gain actually comes from the forest structure rather than from extra prompting?