- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper introduces Hippocam, a hierarchical memory and continual-learning architecture for LLM agents. It organizes ongoing work into nested intents, compresses completed intents into task-relevant outcomes, recursively consolidates older prefixes into increasingly abstract representations, and preserves the underlying interaction history in a tree that can be progressively recalled when finer detail is needed. The paper validates Hippocam across learning, transfer, and long-horizon memory benchmarks. On ALFWorld, ScienceWorld, and StreamBench it reports 97.8%, 81.9%, and 81.7%, respectively, with Hippocam best or tied-best on two of the three.
Critical strengths
- This work creates a natural cycle in which experience is retained, reused, updated, or allowed to recede over time. This architecture is well suited to the main challenges facing long-running LLM agents today: limited context capacity, interference from irrelevant past information, loss of important details during summarization, and difficulty turning past experience into useful knowledge for future tasks.
Critical weaknesses
- The proposed use and disuse mechanism is supported more strongly as an intuitive explanation than as a demonstrated causal mechanism. The transition analysis shows that knowledge associated with intervening use is more frequently supplemented or updated, which is encouraging, but use is measured through indirect proxies and the authors correctly note that the observed association does not establish causality. More importantly, the quantitative analysis does not establish the corresponding disuse effect: most items with no detected use remain unchanged between adjacent consolidations, while evidence for gradual fading comes mainly from qualitative traces.
Questions for authors
N.A.
2 comments
Thank you for your thoughtful review and valuable feedback. With the discussion deadline approaching, we would greatly appreciate hearing if you have any remaining concerns following our response and additional analyses. We would be happy to address them promptly.
Thank you for your thoughtful review and constructive feedback. We appreciate your recognition of Hippocam's potential for long-running agents. We hope our response below addresses your concerns.
Weakness: Empirical Evidence for Use and Disuse
Response: We clarified that use and disuse are emergent behaviors of Hippocam's architecture (Section 2.6), and added empirical evidence for both.
For use, we manually traced knowledge supplementation and updating to identify whether each change arose from use or observations (Table 16). 74.4% of knowledge supplementation and updating involved changes derived from use, showing that most updates come from use.
Table 16. Sources of knowledge supplementation and updating. Paired values denote Supplemented / Updated; Use (%) includes Use-only and Mixed events.
For disuse, we clarified that disuse emerges as consolidation abstracts and prunes prior experience. Although PALIM preserves useful knowledge, items may still be shortened or discarded, especially under token budget constraints (Algorithm 2). Most knowledge remained unchanged in Appendix A.6 because ToolBench ran only six consolidations without reaching the token budget. We added an analysis of 23 ALFWorld consolidations (Figure 7), where knowledge items were shortened 151 times and discarded 40 times, with 41 items shortened as early as the 11th consolidation without reaching the token budget.