- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper proposes SMDI, which derives three memory units from the same source turn: Facet-Unit, Summary-Unit , and Expansion-Unit. Each form is retrieved independently with hybrid sparse/dense retrieval plus a cross-encoder, projected back to source turns through provenance links, and fused at the source level by summing reciprocal ranks. A coarse stage fuses projection and cross-encoder ranks, and a fine stage adaptively weights three branches using score separation and Spearman rank consistency. The top-3 source memories are passed to the LLM.
Critical strengths
- Memory construction, multi-path retrieval, source projection, two-stage reranking, and generation are all described, with pseudocode and hyperparameters in the appendix.
- The ablation is more granular than typical. Single-form, two-form combinations, reranking branches, and cumulative stages are all examined, with both retrieval and generation metrics.
Critical weaknesses
- The strongest baseline, MemGAS (Xu et al., ICLR 2026), already constructs multi-granularity memory units (session, turn, summary, keyword), associates them with a Gaussian mixture model, and adaptively weights granularities with an entropy-based router, followed by LLM-based filtering.
- The paper devotes one sentence to MemGAS and then presents single-form interpretation as an open gap, without explaining why the proposed multi-form scheme is not an equivalent restatement of multi-granularity memory.
- Figure 4 reports 76.9M input tokens for SMDI versus 52.9M for MemGAS (+45%), dismissed with one sentence, and the construction cost of deriving three units per turn through DeepSeek-V4-Flash is not quantified.
Questions for authors
The contribution is therefore better characterised as a well-tuned multi-view retrieval pipeline than as a new methodology.
4 comments
Differences between the multi-form and the multi-granularity memory
SMDI's multi-form scheme differs from MemGAS's multi-granularity memory in memory derivations and retrieval-evidence fusion. MemGAS associates and adaptively weights session, turn, summary, and keyword representations. SMDI derives factual, thematic, and contextual interpretations through Facet-Units, Summary-Units, and Expansion-Units. Independent multi-form retrieval supplies unit-level rank evidence that source memory projection integrates into source candidates for coarse-to-fine memory candidate reranking (Sections 2.2-2.4).
The ablation in Section 3.3, Table 3 quantifies the effect of combining these interpretations. Using all three forms increases Recall-all@3 from 78.80 for the strongest single form, Expansion-Unit, to 82.20, and Recall-all@10 from 93.20 to 97.00. The full model also outperforms each two-form combination. Scores are percentages.
| Memory forms | Recall-all@3 | Recall-all@5 | Recall-all@10 |
|---|---|---|---|
| Facet-Unit only | 50.40 | 58.40 | 63.60 |
| Summary-Unit only | 59.40 | 65.80 | 67.40 |
| Expansion-Unit only | 78.80 | 86.40 | 93.20 |
| w/o Facet-Unit | 80.00 | 88.20 | 96.20 |
| w/o Summary-Unit | 81.40 | 89.80 | 96.00 |
| w/o Expansion-Unit | 60.00 | 67.20 | 69.00 |
| Full model | 82.20 | 90.20 | 97.00 |
Appendix E.1, Table 9 further characterizes the retrieval results underlying this comparison. Pairwise Jaccard@3 ranges from 0.387 to 0.505, showing partially overlapping source-memory sets across forms. Source memory projection uses provenance links to aggregate their unit-level rank evidence into common source candidates (Section 2.3, Equation (1)).
| Compared memory forms | Jaccard@3 | Jaccard@5 | Jaccard@10 |
|---|---|---|---|
| Expansion-Unit vs. Facet-Unit | 0.387 | 0.323 | 0.280 |
| Expansion-Unit vs. Summary-Unit | 0.425 | 0.351 | 0.316 |
| Facet-Unit vs. Summary-Unit | 0.505 | 0.438 | 0.397 |
The gains also extend to answer generation. Appendix E.2, Table 10 reports the corresponding single-form and full-model generation ablation on LongMemEval-M and LoCoMo. The full model improves GPT-4o-J over the strongest single form by 4.00 points on LongMemEval-M (53.80 to 57.80) and 4.72 points on LoCoMo (41.78 to 46.50).
| Memory forms | LongMemEval-M GPT-4o-J | LoCoMo GPT-4o-J |
|---|---|---|
| Expansion-Unit only | 53.80 | 36.02 |
| Facet-Unit only | 42.60 | 41.78 |
| Summary-Unit only | 44.20 | 37.94 |
| Full model | 57.80 | 46.50 |
These results support the use of complementary multi-form derivations for source-memory retrieval and answer generation. Source memory projection integrates their retrieval evidence into the source candidate set for coarse-to-fine memory candidate reranking.
Trade-off between performance gains and computational cost
Existing cost discussion: Section 3.4, Figure 4. It compares token consumption and generation F1 on LongMemEval-S and includes memory organization and response generation in the token accounting. Below we reproduce its input-token counts alongside the LongMemEval-S F1 values from Section 3.2, Table 2.
| Method | LongMemEval-S input tokens (M), Figure 4 | LongMemEval-S generation F1, Table 2 |
|---|---|---|
| MemGAS | 52.9 | 20.38 |
| SMDI | 76.9 | 22.13 |
SMDI incurs additional token consumption compared with MemGAS. Figure 4 reports 76.9M input tokens for SMDI and 52.9M for MemGAS, an increase of 24.0M tokens or 45.4%. SMDI also achieves higher question-answering accuracy across all three benchmarks. As Section 3.2, Table 2 shows, GPT-4o-J accuracy increases by 4.60, 12.40, and 5.43 percentage points on LongMemEval-S, LongMemEval-M, and LoCoMo, respectively. We will expand the cost discussion to present the additional token consumption alongside these performance gains. Scores below are percentages; differences are percentage points.
| Dataset | MemGAS GPT-4o-J | SMDI GPT-4o-J | Difference |
|---|---|---|---|
| LongMemEval-S | 60.20 | 64.80 | +4.60 |
| LongMemEval-M | 45.40 | 57.80 | +12.40 |
| LoCoMo | 41.07 | 46.50 | +5.43 |
The construction overhead arises from generating fine-grained Facet-Units and processing them again to construct Summary-Units. MemGAS generates session summaries and keywords. SMDI first performs Intra-Memory Facet Decomposition: the LLM reads source dialogue and generates multiple Facet-Units containing factual claims, temporal information, and provenance metadata. Cross-Memory Topic Summary then reads the Facet-Units grouped by subject within each session and generates a Summary-Unit for each group. These stages consume input tokens for both source dialogue and extracted facts, and output tokens for both Facet-Units and Summary-Units. Neighboring Memory Contextual Expansion constructs Expansion-Units through text concatenation without a separate LLM call.
In the revised version, we will report the per-history LLM call counts and input/output tokens separately for Intra-Memory Facet Decomposition and Cross-Memory Topic Summary. We will also report embedding and indexing time separately to quantify the construction overhead by stage.
Thank you for the authors' detailed response. Although the additional experiments further demonstrate the effectiveness of individual components, I remain concerned about the limited methodological novelty of this work.
First, recent long-term memory studies, including MemGAS [1], HiGMem [2], and MemReranker [3], have already explored multi-granularity memory organization, adaptive retrieval, hierarchical memory selection, and memory reranking. In comparison, SMDI's three memory representations are largely based on established techniques such as fact extraction, summarization, and contextual expansion. Its multi-path retrieval, source projection, and coarse-to-fine reranking also primarily combine existing retrieval and ranking strategies. The distinction between Multi-Form and Multi-Granularity emphasized in the rebuttal does not sufficiently establish a substantial methodological contribution.
Second, while the ablation results demonstrate performance improvements from combining different components, they mainly validate the effectiveness of the engineering design rather than establish fundamental methodological novelty. Direct comparisons with recent relevant approaches such as HiGMem and MemReranker are also missing.
Furthermore, SMDI incurs approximately 45% more input tokens than MemGAS. Although the authors provide additional explanations, the construction overhead of individual stages and its trade-off against performance gains remain insufficiently quantified.
Overall, I consider this work closer to a well-engineered multi-view memory retrieval and reranking pipeline than a fundamentally novel long-term memory approach. The rebuttal does not sufficiently resolve my concerns regarding methodological novelty. Therefore, I maintain my original rating.
[1] From Single to Multi-Granularity: Toward Long-Term Memory Association and Selection of Conversational Agents.
[2] HiGMem: A Hierarchical and LLM-Guided Memory System for Long-Term Conversational Agents.
[3] MemReranker: Reasoning-Aware Reranking for Agent Memory Retrieval.
Relationship to MemGAS and concrete methodological differences
Thank you for recognizing the method description and the detailed ablations. We clarify SMDI's contribution through multi-form memory derivations, source memory projection, and coarse-to-fine memory candidate reranking.
MemGAS (Xu et al., ICLR 2026) is a direct reference for our task and evaluation. It combines session/turn/summary/keyword representations, GMM associations, entropy-based granularity weighting, and Personalized PageRank retrieval. SMDI studies long-term conversational-memory question answering on the same benchmarks.
SMDI combines multi-form retrieval, source memory projection, and coarse-to-fine memory candidate reranking. Its design has three concrete parts:
Multi-form retrieval finds relevant units, source memory projection combines their retrieval evidence at the source-memory level, and coarse-to-fine reranking determines the final source memory ranking. We will expand the MemGAS comparison in the introduction and related work, explicitly describe existing multi-granularity methods, and explain these methodological differences using the terminology above.