- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes UnfoldMem, which is a multi-agent framework for multimodal long-term conversational memory. The framework separates memory exploration from evidence interpretation. Specifically, a main agent iteratively selects memory access tools and formulates sub-questions, while temporary sub-agents interpret relevant conversational and visual evidence within isolated contexts. UnfoldMem combines session-level summaries with fine-grained text and image retrieval to support adaptive memory exploration. Experiments on two benchmarks, MemEye and Mem-Gallery, demonstrate improvements over existing RAG and agentic memory baselines.
Critical strengths
The paper addresses multimodal long-term memory utilization, particularly the challenges of retrieving and interpreting evidence distributed across multiple conversation sessions. Separating memory exploration from evidence interpretation provides a reasonable approach to managing growing context during iterative retrieval. The proposed method shows strong empirical performance across several benchmarks and analyses multiple settings to demonstrate the main claims. The additional case studies provide useful insights into the framework's behavior and limitations.
Critical weaknesses
Thanks for submitting the paper. The proposed method is insightful and significantly improves performance, however, there are several concerns:
- The proposed primarily combines established techniques, including session-level summaries, embedding-based retrieval, iterative tool selection, and sub-agent delegation. Its main contribution lies in separating memory exploration from evidence interpretation, but the necessity of this architecture remains unclear. In particular, could a single agent achieve comparable performance by iteratively formulating sub-questions, retrieving evidence, and interpreting the results? In addition, the ablation studies in Table 4 evaluate session summaries and memory access tools but do not directly examine the central main/sub-agent separation. A controlled single-agent baseline using the same memory representations, retrieval tools, and exploration budget would help determine whether the improvements arise from architectural decoupling or the underlying memory access mechanisms.
- Session summaries and the ask tool are closely interdependent: summaries guide session selection, while ask provides access to the selected sessions. Removing either component weakens the same session-level access pathway, making their individual contributions difficult to isolate. This may explain their nearly identical performance drops on Mem-Gallery (86.4 to 61.7 and 61.2, respectively). Although fine-grained search contributes more substantially on MemEye, its removal has a relatively small impact on Mem-Gallery (86.4 to 83.1). The authors should clarify how these results support the distinct contributions of each component across different memory settings.
- Despite achieving the highest overall score on MemGallery, the proposed method performs substantially worse on answer refusal (64.9) than all reported baselines. And all three ablated variants outperform the full system on this task. The authors should investigate whether this degradation reflects premature answering, over-reliance on partial evidence, or other limitations of the iterative exploration process.
- UnfoldMem relies on intermediate sub-agent responses to guide subsequent retrieval decisions. Errors in sub-question formulation or evidence interpretation may therefore propagate across iterations and misdirect further exploration. Appendix D.2.1 illustrates a case of retrieval drift toward an incorrect storyline. However, the paper provides limited analysis of how intermediate errors affect subsequent retrieval decisions or whether additional exploration can correct them.
- Several agentic memory baselines perform substantially worse than simpler RAG methods, particularly M2A and MMA on Mem-Gallery. Because these methods differ in memory representations and retrieval interfaces, it is unclear whether these gaps reflect limitations in their memory mechanisms or difficulty adapting to the benchmark. The authors should clarify the adaptations they made to these baselines and further analyse their unexpectedly low performance. In addition, the related work discusses M3-Agent and SimpleMem as representative approaches to active memory utilization, but neither is included in the experimental comparison. In particular, M3-Agent supports multi-turn reasoning with iterative memory access, making it directly relevant to the paper's claim that existing active navigation methods suffer from coupling retrieval and evidence interpretation. The authors should explain their exclusion and, if feasible, compare against these methods to better establish the advantages of UnfoldMem over existing active navigation approaches.
Questions for authors
- Could the authors provide a controlled comparison with a single-agent iterative navigation baseline using the same memory representations, retrieval tools, and exploration budget? This would help clarify whether the performance gains come from the proposed main/sub-agent separation rather than iterative retrieval or context management alone.
- Could the authors explain why closely related active memory navigation methods, particularly M3-Agent, are not included in the evaluation? If feasible, a comparison with M3-Agent would help establish the advantages of UnfoldMem over existing approaches.
- Could the authors further investigate the substantial performance degradation on Answer Refusal in Mem-Gallery, particularly why all three ablated variants outperform the full system on this task?
- Could the authors clarify the implementation and benchmark adaptation of M2A and MMA, especially the reasons for their substantially lower performance than simpler RAG baselines? Additional diagnostics on retrieval success and output validity would help assess the reliability of these comparisons.