- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper proposes Deep-Dream. It preserves source documents and exact text locations, while organizing concepts, relations, observations, and versions into a revisable access layer. It allows the agent to navigate and read source text over multiple steps. The system also uses delayed entity alignment. It merges candidate entities or redirects links after more context becomes available. The authors report results on several memory benchmarks. However, the experiments mainly compare different reading pipelines within the system. They do not establish the independent value of the new designs through fair external comparisons and sufficient component ablations.
Critical strengths
- The paper separates original evidence, entity interpretations, and retrieval results. Exact source locations and access traces make it easier to audit the evidence behind an answer.
- The authors disclose budget differences, the lack of gains in the graph retrieval ablation, and deletion failures. These details help readers understand the limits of the results.
Critical weaknesses
-
The novelty is not clearly established. Graphs have been widely used for memory organization, associative retrieval, and dynamic updates. Examples include A-MEM (NeurIPS 2025), AriGraph (IJCAI 2025), G-Memory (NeurIPS 2025), and GAM (ACL 2026). In particular, Zep already preserves lossless Episodes, links semantic records back to their sources, and tracks relation history using both system time and fact validity time. Preserving source text, source links, and history is therefore not enough to establish novelty on its own. Although the paper cites some closely related work, it does not clearly explain what new capabilities delayed alignment and version access add.
-
Missing direct comparisons with key external baselines under a shared setup. Table 1 compares the paper’s own reading configurations. It cannot establish an advantage over existing memory methods. Table 2 combines results with different answer models, judges, evaluation protocols, and data subsets. It therefore does not establish a reliable advantage over Zep, HippoRAG 2, A-MEM, or Hindsight. The current experiments cannot determine whether the gains come from the memory design, model capabilities, source access, or inference budgets.
-
The effects of individual components are not sufficiently isolated. Source reading adds tools, more iterations, and roughly 12 times the token usage. Delayed alignment is bundled with batching and parallel execution. Version links and provenance checks lack separate ablations. The offline graph ablation shows no consistent recall gains, and entity merges are not evaluated against ground-truth labels. It therefore remains unclear which new mechanisms are effective and whether these storage and access designs provide measurable benefits beyond engineering integration.
Questions for authors
- What is the distinct contribution over the graph-based memory methods listed above? In particular, what capabilities do delayed entity alignment and version links add beyond Zep’s source tracing and relation history?
- Could the authors directly compare Deep-Dream with Zep, HippoRAG 2, A-MEM, and Hindsight using the same answer model, judge, data subset, source access, and call/token budgets?
- Could the authors separately ablate graph navigation, version links, delayed alignment, and provenance checks? Could they also evaluate entity alignment against ground-truth labels and test both current-state and historical-state queries? These experiments would help show which mechanisms drive the gains, rather than extra reading compute or batching improvements.
- Figure 1 and Figure 3 appears to be an unedited AI-generated SVG and is visually unappealing. I suggest that the authors revise it to improve its visual quality.