- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces G-Dreamer, a long-term memory management framework for LLM agents. The method organizes memory into cases, patterns, and anchors, and introduces three lifecycle operations: consolidation, selective forgetting, and re-consolidation. The goal is to mitigate the degradation of memory utility as interactions accumulate. Experiments on ALFWorld and WebShop show that G-Dreamer can maintain competitive task performance while reducing the size of active memory.
Critical strengths
1: The paper addresses and important problem in long-term agent memory. It investigates whether stored experience remains useful as memory grows.
2: The story is well organized and the overall framework is clearly presented. I like the Introduction part with clear motivation, making the paper easy to follow.
Critical weaknesses
1: The main performance results do not fully support the paper's claims. Table 1 shows that G-Dreamer does not consistently outperform the strongest baselines. On ALFWorld, it achieves 72.7% with Qwen3-8B, below Case-pattern (74.3%), and 71.9% with Qwen3-14B, below A-MEM (75.1%). On WebShop, the improvement with Qwen3-8B is relatively small, while the Qwen3-14B result (44.7) falls substantially behind ReasoningBank (53.0). The efficiency improvements are valuable, but the results provide stronger evidence for a performance-efficiency trade-off than for consistently better task performance.
2: The evaluation setting is rather limited for a paper on long-term agent memory. First, regarding the scope and number of tasks, ALFWorld and WebShop are well-established benchmarks, but I would like to see whether the method also works on more challenging, long-horizon tasks, such as software engineering. Second, the experimental setup itself raises some concerns. On ALFWorld, the model generates a complete action sequence in a single response, which is then evaluated through symbolic replay. In addition, each task family is evaluated as a separate 500-task stream, with memory initialized from scratch. This differs from interactive agents that adjust their actions based on environmental feedback and reuse experience across different types of tasks. The WebShop experiments are also limited to only 50 tasks, which seems rather small for evaluating long-term memory.
3: The ablation study is insufficient to understand which components actually contribute to the improvements. Related to the W2, reconsolidation is a central component of the proposed framework, but the experiments do not directly test scenarios where previously valid knowledge becomes outdated or contradictory. Such experiments would help show whether the framework can actually identify and revise unreliable memories. Moreover, Table 2 only compares Case-only, Case-pattern, and the full G-Dreamer. It does not isolate the individual contributions of selective forgetting, reconsolidation, and adaptive scheduling. As a result, it is difficult to tell which components are responsible for the additional improvement over Case-pattern.
4: I'm also somewhat concerned about the robustness of the method. The framework relies on quite a few manually tuned hyperparameters, particularly for memory forgetting, pattern activation, and maintenance scheduling. It is unclear how sensitive the performance is to these choices and whether the same settings would work well on unseen tasks without further tuning. A hyperparameter sensitivity analysis would help address this concern.
Questions for authors
1: How much of the improvement comes from forgetting, reconsolidation, and adaptive scheduling individually? Would simpler memory pruning with a fixed memory budget achieve similar results?
2: How frequently are existing patterns actually revised during the experiments, and how often do these revisions improve subsequent task outcomes?
3: Can the authors evaluate memory snapshots collected at different stages on a fixed test task set?