- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper studies state arbitration in long-horizon agent memory: which state governs an agent’s action when both historical and current records are available. It introduces an evidence-to-action audit separating retention, retrieval, materialization, and arbitration, and uses paired interventions to distinguish early-declaration anchoring from the read-time influence of lifecycle representations.
The declaration experiments show that early explicit statements can suppress the influence of subsequent behavioral evidence. In the primary lifecycle experiment, marking jointly visible records as ACTIVE/SUPERSEDED improves current-state action accuracy by 28.6 and 31.3 percentage points on Qwen-72B and Llama-70B, respectively.
Validation includes alternative metadata representations, native memory-manager audits, structured-action transformations of external benchmarks, and stable-state and reversed-label controls. The main contribution is a conditional empirical analysis of how supplied lifecycle relations affect action, rather than an end-to-end method for reliably identifying and managing evolving states.
Critical strengths
The problem is well defined and interesting. Separating evidence availability from the choice of which state guides an action gives a useful way to diagnose stale-memory failures.
The paired experiments are convincing within their stated scope: record content, order, instructions, and tasks remain fixed while lifecycle labels change. This supports the claimed read-time effect.
Critical weaknesses
My main concern is practical significance. The primary gains depend on correctly materialized states and supplied lifecycle relations. The native LangMem result is also conditional on 24 successful histories out of 120. The paper establishes that correct labels help, but not how reliably a system can obtain and use them across all cases.
The design recommendation is less clear than the empirical finding. In Table 4, the current-only diagnostic substantially outperforms presenting both records with lifecycle labels. Historical records could remain in storage without entering every action prompt. Given the same correct state assignment, the paper does not establish when labeled joint readout is preferable to filtering.
Questions for authors
-
Can the existing native experiments show a net benefit across all attempted histories, including those with missing or incorrect lifecycle relations, rather than only the successful subset?
-
How should the current-only results in Table 4 affect the proposed design recommendation? Do any evaluated tasks show a benefit from retaining historical records in the action context?