- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper addresses a critical issue in continual learning for agents and systematically investigates the transfer of experiences from external memory to model weights using the ENGRAM framework. The proposed method features a novel design—specifically, decoupling training admission from memory release and introducing a verification gate to prevent the premature deletion of experiences. Experiments span multiple agent benchmarks, and the importance of each module is validated through ablation studies and controlled memory-release experiments.
Critical strengths
Clearly Defines Key Issues in Agent Experience Consolidation
This paper addresses a significant yet under-explored challenge in long-term agent learning: determining when to incorporate external experiences into model parameters and when it is safe to discard external memory. Decoupling training admission from memory release represents a valuable contribution to existing memory-based agent evolution methods.
Proposes a Verification-Driven Memory Release Mechanism
The paper introduces a verification gate that determines whether the model has genuinely assimilated an experience by comparing a model updated without retrieval against a baseline model utilizing retrieval. Compared to strategies that simply delete memory after training, this mechanism adopts a more cautious approach; controlled experiments demonstrate that it reduces the retrieval footprint while maintaining strong task performance.
Critical weaknesses
Reliability of Memory Release Verification Requires Further Validation
This paper uses behavioral consistency on reserved probes as the criterion for successful empirical transfer. However, performance gains on specific probes do not necessarily indicate that the model has acquired a generalizable skill. Particularly in complex interactive tasks, it remains to be investigated whether a limited set of probes can adequately cover the full scope of a skill's capabilities.
Heavy Reliance on Skill Representations and Long-term Evolutionary Processes
ENGRAM assumes the existence of a predefined skill taxonomy and ETG structure; however, issues such as skill discovery, skill granularity, and the construction of inter-skill relationships in real-world open environments have not been fully addressed. Furthermore, the accumulation of adapters for different skills across multiple rounds of consolidation warrants further analysis to determine whether it leads to parameter interference or catastrophic forgetting.
Questions for authors
Q1. The verification gate uses reserved probes to determine whether memory can be released. Given that the number of probes is limited and may not cover the skill's entire behavioral space, how do the authors ensure the reliability of the release decision? Have the authors conducted sensitivity analyses regarding different probe counts or probe selection strategies?
Q2. The skill taxonomy and ETG play a significant role in ENGRAM's performance. Does the method remain stable if the granularity of skill definitions changes?
Q3. During multi-round consolidation, is there a risk of conflict between the LoRA adapters of different skills? Have the authors observed adapter interference or issues with forgetting during long-term training?
Q4. Current experiments rely primarily on existing benchmarks; do the authors plan to evaluate ENGRAM's long-term operational capabilities in more open-ended and dynamically changing environments?
2 comments
Hi Reviewer emYH,
We sincerely thank you for reviewing our paper and for helping us improve our work. With only a short time remaining in the discussion period, we would be very grateful to know whether our responses have addressed your concerns. In particular, we are eager to learn whether our latest response has resolved any remaining issues. We would be happy to continue the discussion if anything remains unclear.
Reply to reviewer emYH
Thank you for the positive assessment and the precise questions. Here are our reply regarding your questions.