- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes GraftMem to mitigate evidence loss from repeated memory overwriting in long-context reasoning. In this framework, the model processes document chunks sequentially and appends newly extracted evidence to existing memory instead of regenerating the entire memory. Additionally, multi-level GRPO rewards and direct cross-entropy decision supervision are used to train the agent across long-context QA benchmarks.
Critical strengths
-
The append-based memory update design is practical. Replacing full-memory overwriting with incremental evidence appending (, Eq. 5) is simple, prevents previously stored evidence from being lost during regeneration, and reduces per-step decoding length.
-
The internal ablation verifies the append mechanism. The controlled ablation in Table 4 confirms that replacing overwrite-based updates with append-based updates improves QA accuracy at longer context lengths (e.g., 224K and 448K).
Critical weaknesses
-
Problematic academic attribution and experimental comparison. First, the paper claims to introduce the update gate and early-exit mechanism, which were actually proposed by GRU-Mem [1]. The authors are merely following GRU-Mem [1] rather than introducing these gates as their own contribution. Moreover, the entire paper closely follows the experimental setup and figure/table styles of GRU-Mem [1], yet the authors only briefly mention this work without comparing against or discussing it in the experiments. This raises serious concerns regarding proper credit attribution and academic integrity.
-
Overly strong supervision assumption and risk of hallucination. Eqs. 9 and 15 supervise the update and exit gates using static chunk-position labels ( and ). Even if the model failed to extract an earlier supporting fact and the current memory is incomplete, this supervised training still forces the model to output
endat step and generate a final answer from insufficient evidence, which may easily induce hallucination. -
Lack of organic connection between the two proposed components. The two main modifications proposed in this paper—replacing overwriting with append-based updates (AcIn) and adding token-level decision supervision—appear to be independent of each other without an intrinsic connection, reading like a stitched-together combination of two separate tricks.
[1] When to Memorize and When to Stop: Gated Recurrent Memory for Long-Context Reasoning (GRU-Mem).
Questions for authors
Please refer to the weaknesses part. My main concern is that this paper is too similar to GRU-Mem, including all the experiments and visualizations, without comparison, necessary discussion, and contribution seperation. If the author can address my issue. I will raise my scores.