- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
Long-term language agents need to recover related experiences from partial cues, compose them across relations, and selectively retain information as new experiences arrive. In this work, PRAM stores structured facts in associative matrices and retrieves relational trees for a frozen LLM through a learned soft-token bridge. Separate streaming experiments study selective retention.
Critical strengths
- Representing memory through associative matrices with encoded relations and time is an interesting idea, offering a compact representation of structured associations.
Critical weaknesses
-
Supported query operations need clarification. MetaQA explicitly uses bidirectional storage, but the general construction does not explain whether incoming facts automatically receive reverse associations and inverse relation codes. In Figure 1, storing Leo as Mia’s mentor supports retrieving Leo from Mia; answering “Who has Leo as a mentor?” requires reverse access. More complex queries also remain unclear: A -> B -> X <- C requires finding a shared target satisfying both paths, whereas the described tree expansion unions retrieved neighborhoods. How are inverse relations and such intersection constraints handled during storage and retrieval?
-
Evaluation does not establish an advantage over existing memory methods. The paper lacks direct comparisons with established memory systems discussed in its related work. Its LoCoMo performance is also weak: PRAM achieves 38.0% accuracy, substantially below the reported dense-RAG baseline’s 58.4%. Furthermore, category 3 is excluded without explanation, narrowing benchmark coverage. Together, these limitations leave the framework’s practical value insufficiently supported.
-
Fact construction is insufficiently described. The paper evaluates memory over an LLM-extracted fact collection without specifying the extraction procedure or assessing what conversational information it preserves. Consequently, preservation of emotions, motivations, outcomes, and causal context remains unverified.
Questions for authors
see weakness