- Rating
- 2
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This project presents BeliefMem, a memory framework for LLM agents operating under partial observability. The authors identify self-reinforcing errors as a limitation of conventional memory systems, where uncertain observations are stored as deterministic conclusions and may subsequently bias agent behavior. To address this issue, BeliefMem maintains multiple candidate conclusions with associated confidence scores and dynamically updates them as new evidence arrives. Experiments on LoCoMo and ALFWorld demonstrate improvements over several existing memory baselines.
Critical strengths
Important and well-motivated problem. The paper provides a meaningful discussion of self-reinforcing errors in agent memory. Understanding how incorrect experiences persist and influence future decisions is an important direction for self-evolving agents.
Promising methodological design. Maintaining multiple candidate conclusions with explicit confidence scores, rather than committing to a single interpretation, is a reasonable and potentially useful approach. The dynamic confidence update mechanism adds some methodological novelty.
Encouraging empirical results. The method achieves competitive improvements across the evaluated benchmarks, suggesting that preserving uncertainty can benefit long-term memory utilization.
Critical weaknesses
Misalignment between evaluation and core motivation. LoCoMo primarily evaluates long-term conversational memory and question answering, rather than agent self-evolution or self-reinforcing errors. It lacks the closed-loop interaction required to investigate how incorrect memories influence subsequent actions and observations. Although ALFWorld provides an interactive setting, the experiments do not sufficiently establish the claimed self-reinforcing error mechanism.
Insufficient analysis of noise from competing hypotheses. Preserving multiple candidate conclusions may introduce conflicting or misleading information during retrieval, potentially degrading downstream decisions. While the paper examines retrieval size, it does not systematically investigate how the number of conflicting candidates or their confidence distributions affect task performance. More targeted ablations are necessary.
Incomplete discussion of related work. The paper would benefit from a more comprehensive comparison with recent studies on persistent memory corruption, poisoned experience retrieval, and error propagation in self-evolving agents. The distinction between BeliefMem and these approaches should be clarified.
Unclear recovery mechanism under incorrect high-confidence beliefs. When an initially incorrect belief already dominates an agent's actions, the agent may avoid behaviors that could generate contradictory evidence. BeliefMem primarily updates confidence after receiving new observations, but does not explain how corrective evidence can be actively obtained in such situations.
Questions for authors
Could the authors provide a closed-loop evaluation demonstrating how incorrect memories influence future actions, reinforce themselves, and are eventually corrected by BeliefMem?
How does performance change when varying the number of distracting hypotheses and assigning incorrect or closely competing confidence scores?
How does BeliefMem differ from existing work on persistent memory poisoning and self-reinforcing agent errors?
If an incorrect high-confidence belief prevents the agent from exploring alternatives, what mechanism enables BeliefMem to escape this feedback loop?