- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes Retain and Reveal (R&R) for bounded memory in long-context QA. A writer commits a textual memory before seeing later continuations, and the memory is rendered once as an image. A reader then answers multiple continuations from that same image. Writer rewards, reader supervision and validated skill revision are used for training.
Critical strengths
- Valuable core idea. Testing one committed memory against multiple later uses directly targets delayed relevance, and the ablation shows that distinct continuations help beyond repeated reads of a single continuation.
- Joint treatment of retention and readability. The method trains both what the writer preserves and whether it can be recovered after rendering, and the experiments include useful ablations.
Critical weaknesses
- Training and inference are misaligned. Training uses probe reads on intermediate memory, whereas inference continues recurrent writing and reads only the final memory. This makes it hard to tell which component produces the gains.
- The contribution of optical memory cannot be attributed. No new visual encoder or component is trained, and layout, skills and training signals change together. The results do not show that image memory itself is better than well-structured text memory.
Questions for authors
- Answer-match accuracy (SEM) does not show that the method retains and correctly uses evidence relations. Could you add direct evidence-level metrics?
- The motivation is general agent memory, but the experiments are long-context QA. Could you add an agent-memory setting, or narrow the claims to long-document memory compression?
- The evaluation uses 128 examples per dataset, and several gains over strong baselines are small.
- Figure 1 stacks several memory paradigms and does not highlight R&R's full mechanism.