- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper studies how language-model agents can learn to retain information across context boundaries through ordinary filesystem operations. Motivated by coding models’ familiarity with file operations, they introduce CAMG, a suite of RL environments spanning shopping, coding, research, and ML-engineering tasks, each equipped with shell access and a persistent workspace. CAMG-RL trains a shared policy using asynchronous PPO with response-level advantages and token-level clipping. The trained models achieve the highest average success rate on CAMG and competitive performance against larger frozen models on external benchmarks.
Critical strengths
- Carefully controlled evaluation across diverse tasks. CAMG provides four environments with explicit data separation and external contamination checks. Tool-renaming, call-format, and documentation controls strengthen the interface-prior analysis.
- Strong empirical support and statistical reporting. Memory-content interventions show that saved information contributes to later success. Paired confidence intervals, repeated training runs, and replication of AgeMem’s original recipe strengthen the main comparisons.
Critical weaknesses
- The gains are not shown to come from memory. There is no RL baseline on the same environments without a memory workspace, and no full-context upper bound. On Coding, CAMG-RL ties with AgeMem, which never uses memory successfully. The average is also largely driven by the synthetic Shop environment.
- The mechanism relies heavily on environment scaffolding. The environment triggers checkpoint writes, validates them before resetting context, and sometimes penalizes failures, qualifying the “task reward only” framing. The continuation-only variant also trails CompactionRL, suggesting that the advantage depends on additional memory files rather than checkpointing alone.
Questions for authors
- How do you distinguish difficulty learning AgeMem’s tools from integration issues? Does CAMG-RL’s advantage persist after resolving tool-call parsing failures and aligning context handling?
- How do you separate the gains from memory learning from improvements in general task competence? Could you compare CAMG-RL against a memory-free RL baseline trained on the same environments with the same training budget, alongside a full-context reference?
3 comments
Thank the authors for the responses. The additional experiments and explanations are clear. I raise my score.
Thank you for your positive reassessment. We appreciate your constructive feedback and are glad that our additional experiments and clarifications have addressed your main concerns.
Thank you for the detailed responses and additional experiments, which partially address my concerns, particularly regarding performance beyond Shop and AgeMem’s use of workspace files on Coding. However, the long-context RL baseline uses automatic compaction and different context settings, leaving the contribution of memory learning insufficiently separated from general task competence. The additional AgeMem analyses also do not establish whether CAMG-RL’s advantage persists after resolving parsing issues and aligning context handling. I therefore appreciate these clarifications but maintain my original score.