- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes a hybrid approach of combining kv cache eviction along with per-document LoRA to improve long context performance of LLMs. It identifies the complementary nature of both mechanisms by conducting a clean ablation and clearly motivates the proposed approach. The paper demonstrates the effectiveness of the proposed approach on the 2WikiMultihopQA benchmark.
Critical strengths
The central idea behind the proposed hybrid approach is well-motivated, and the experiments are well-designed and validate it well. The question-type analysis in Section 2 gives a concrete reason to combine the two memories, and Figure 3 confirms that reason within a clean experiment setup. Algorithm-wise, training the adapter with the compressed cache in context is an interesting idea. Figure 4(d) isolates it with a well-matched control setting. Both conditions answer with the same 90%-evicted cache, and only the training context differs, which separates the contribution from Zuo et al. (2026), who already studied document LoRA under KV eviction.
Critical weaknesses
The main weakness lies in the main evaluation results in Section 4. The results come from one benchmark 2WikiMultihopQA which averages about 5k words, which is not truly a long-context setting under today’s standards. Moreover, each document has a single question, so reuse across questions, which is the stated motivation, is never truly tested. Compactor, the selector the method itself uses, is missing from Table 2, even though it is the strongest eviction baseline in Figure 4(a).
Questions for authors
Please see the weaknesses listed above