- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper introduces SeeFar, which separates accumulated evidence, committed facts, temporal records, and relational state in an agent's memory. Asynchronous updates are intended to reduce latency in the foreground conversation. SeeFar is evaluated on question answering, factual recovery, and persona-oriented behavior across five backbones.
Critical strengths
-
The paper provides a clear and interpretable organization of accumulated evidence, committed facts, temporal records, and changing relationships in SeeFar's persistent agent memory.
-
Table 3 reports large single-hop QA improvements across all five backbones, including scores of 66.01 versus 17.33 for DeepSeek. Such gains would be substantial if supported by equivalent evaluation conditions and faithful baselines.
Critical weaknesses
-
The headline comparison raises concerns about category alignment and baseline fidelity. Table 3 reports lower single-hop than multi-hop F1 in all 25 baseline rows, whereas SeeFar shows the opposite ordering across all five backbones. This pattern differs from the results reported in the original LoCoMo paper and requires verification. In particular, it remains unclear whether all baselines use the same category IDs and questions. This pattern does not necessarily establish a category mapping error. Appendix A.10 also does not clearly specify the memory operations and budgets retained by the baseline wrappers. These issues make the claimed improvements difficult to assess or reproduce.
-
The provided ablations do not explain the principal single-hop QA gains, as Table 4 reports results on persona and conflict outcomes rather than single-hop QA. In addition, Section 4.5 reports overlap between the 200 threshold-selection questions and the 841-question evaluation set. Focused QA ablations and an evaluation separated from threshold selection are needed to assess the robustness of the reported gains and the contributions of individual components.
Questions for authors
-
[Clarification] Could the authors verify the category mapping in Table 3 with sample baseline outputs? Could the authors also clarify the memory operations and budgets retained by the respective baseline wrappers?
-
[Suggestion] Do the reported single-hop gains persist when evaluated on questions separated from threshold selection? How much does each proposed component contribute to single-hop QA performance in focused ablation studies?