- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies whether or not an agent can safely reuse a model's KV cache built from a different context, going in depth characterizing what happens and why. It finds that reuse can change agent responses and actions, affecting execution cost and workspace state. The authors argue that using task success alone to judge cache reuse safety may not be enough, and propose a criterion for deciding when cross-context cache reuse is permissible.
Critical strengths
-
Useful analysis beyond task success: The paper shows that under cache reuse, an agent can still complete the required task while taking different actions, changing execution cost and workspace state, highlighting that using success only as a judge may hide problems with cache reuse.
-
Careful behavioral analysis: By exhaustive comparisons between current and stale caches on the same tasks, the paper examines how cache reuse can lead to different responses and actions. The authors comprehensively describe and characterize this behavior.
Critical weaknesses
-
Proposed criterion is post-hoc: It assesses whether a cache-reused execution met the requirements, but does not predict in advance which reuse cases are safe. Its value as a deployment safeguard is therefore limited.
-
The practical impact of cache reuse remains unclear: The experiements test full-span cache substitution rather than a more realistic selective-reuse policy. They show that reuse can change behavior in some unintended ways, but not how often this can happen in practical deployments or whether reuse still saves time overall.
Questions for authors
-
Can the proposed criterion identify safe cache reuse before execution, or is it only an after-the-fact check?
-
Do the behavioral effects persist under selective reuse, and does that approach still reduce end-to-end latency?