- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper extends MemAgent-style chunked memory reading with a skim-then-read setup. It works in two passes.
- Preview: the model writes a short, question-independent preview of every chunk, and neighboring previews are grouped into pages.
- Select and read: a selector (a LoRA on the same 7B model) uses the previews and the question to pick which chunks to read. The reader then updates its memory over the selected chunks, with the neighboring previews in its prompt.
The authors find that PGM-Selective yields small improvements on HotpotQA (vs ReMemR1 and MemAgent) + on LongBench v2 (vs ReadAll).
Critical strengths
- The paper is short and easy to follow, with a very clear Fig 1.
- The problem is well-motivated. Single-pass memory readers have to decide what to keep before seeing what comes later.
- Selection seems o really help at the longest lengths, and the paper does a good job counting the preview pass in its token costs.
Critical weaknesses
- The paper's main claim is that previews help the reader decide what to retain but the numbers don't fully support this. PGM-ReadAll, which has previews and reads everything, averages 75.00 on HQA, slightly below MemAgent (75.78), and is clearly worse at 448K (67.97 vs 72.66). The gains come from selection, which on HQA mostly means throwing away distractor documents.
- Since selection is doing the work, the key missing baseline is a cheap retriever choosing chunks at the same reading ratio (~45%), with the same reader: BM25 or dense top-k over raw chunks or over the previews. The random-chunks baseline (43.9/41.7) is too weak (and the DOS RAG baseline is unclear).
Smaller note: LycheeMemory's gate is a BCE chunk-relevance classifier trained on supporting facts with positive weight 3, which is essentially Eq. 5 here, so the related work undersells how close it is.
Questions for authors
- Can you run BM25 / dense chunk retrieval at matched reading ratio, feeding the same frozen PGM reader with and without previews in the update prompt?
- You have the memory text at every step, so the retention claim can be tested directly. Across all HQA questions, what fraction of gold supporting facts appear in the final memory for MemAgent, ReadAll, and Selective?
Dear Reviewer yEwS,
Thank you for your careful review. We respond to your concerns and questions below.
W1: Evidence for preview-guided retention beyond the gains from selection.
A1: We thank the reviewer for this observation. We agree that our original presentation did not sufficiently distinguish the roles of previewing and selective reading. Selective reading indeed contributes substantially to accuracy by avoiding unnecessary memory updates, but its benefit is not merely discarding distractors. Our new controlled experiments provide evidence for both components. First, with the reader and selected chunks fixed, removing previews from memory updates reduces Selective accuracy by 2.34, 9.37, and 4.69 percentage points at 28K, 112K, and 896K, respectively, demonstrating that previews also influence what information is retained. Second, under approximately matched reading ratios and with the same PGM reader, our learned selector achieves 78.75% average HQA SubEM, compared with 72.66% for BM25 and 57.66% for dense retrieval. It also achieves substantially higher supporting-sentence recall. These results show that PGM combines contextual guidance for memory construction with learned, evidence-aware reading selection. We will revise the manuscript to clarify these distinct contributions.
W2 & Q1: Matched-reading retrieval baselines and preview ablations.
A2: We thank the reviewer for this suggestion. We conduct additional comparisons using BM25 and dense retrieval over raw chunks, with the same frozen PGM reader and approximately matched reading ratios. All retrieved chunks are restored to their original document order and processed using the same memory-update and answering procedure as PGM-Selective. The results on HQA are reported below (SubEM, %).
PGM-Selective outperforms BM25 and dense retrieval by 6.09 and 21.09 percentage points in average SubEM respectively, consistently across all five context lengths.
We further compare memory updates with and without previews across five HQA context lengths, keeping the reader and selected chunks fixed for each selection strategy.
Preview conditioning improves all three selection strategies. Moreover, PGM consistently outperforms BM25 and dense retrieval, demonstrating the benefits of both preview-guided memory updates and learned selection. We will include the complete results and the original DOS-RAG baselines details in the revised manuscript.
W3: Relationship to LycheeMemory’s supervised relevance gate.
A3: We thank the reviewer for pointing out this connection. We agree that our discussion of LycheeMemory was insufficiently detailed. The key distinction lies in how the two methods organize and use contextual information. LycheeMemory operates on compressed KV-cache representations and performs sequential, state-dependent gating based on the evolving working memory. In contrast, PGM constructs question-independent textual previews, groups neighboring previews into pages, and makes chunk-selection decisions before detailed reading. More importantly, PGM reuses these preview pages during memory updates, allowing the reader to leverage broader contextual cues when deciding what to retain. Furthermore, PGM optimizes the selector through trajectory-level RL with answer-quality and evidence-coverage feedback, while keeping the reader fixed. We will revise the Related Work section to better reflect the connection and clarify these distinctions.
Q2: Direct measurement of supporting-fact retention in final memories.
A2: We conduct a systematic audit of final memories from MemAgent, PGM-ReadAll, and PGM-Selective, measuring the fraction of gold supporting facts retained across all five HQA context lengths.
PGM-ReadAll and PGM-Selective retain 20.75 and 20.06 percentage points more gold supporting facts than MemAgent on average, respectively. Notably, at 896K, both PGM variants retain 86.69% of gold supporting facts, compared with 60.06% for MemAgent. We will include the detailed analysis in the revised manuscript.