acceptodds
Under review as a conference paper at ICLR 2027

CacheLink: Functional KV Transport for Zero-Prefill Cross-Model Context Handoff

Abstract

KV caches make long-context serving efficient by reusing past computation, but model switching breaks this reuse and forces the receiver to prefill the context again. We study zero-prefill cross-model context handoff: translating a sender cache into a receiver-compatible state so that the receiver can continue directly without prefilling same context. Existing affine transport methods show that receiver KV states can be substantially reconstructed from sender caches. However, through extensive analyses, we find that reconstruction fidelity is a poor proxy for receiver utility. Similar K/V reconstruction errors can lead to substantially different attention patterns, predictive distributions, and downstream accuracy, because conventional reconstruction objectives overlook the query-dependent functional importance of K and V in receiver attention. We thus introduce , which learns a coupled K/V correction through the receiver behavior directly. Across four independently trained sender–receiver pairs and seven evaluation panels, improves the equal-weight mean over all methods for every pair. In matched diagnostics, changes K/V squared error by less than 0.4% while substantially changing receiver attention and next-token behavior. At 32K context, it reduces handoff latency by up to relative to receiver re-prefill. Our findings verify that reconstruction fidelity alone is insufficient and that preserving the receiver computation induced by the transported cache is important for effective cross-model KV transport. The anonymized code is available at https://anonymous.4open.science/status/CacheLink-anonymous-2750the accompanying repository.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.