- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
TACIT converts an existing source model's KV cache into a cache usable by a different target model. It combines causal token alignment and positional conversion with attention-guided layer selection and closed-form affine fitting. A direction-specific mapper is calibrated once on paired unlabeled prefills and then reused. The evaluation covers heterogeneous model pairs, multiple-choice tasks, continuation, and question answering, with substantial reductions in downstream handoff latency.
Critical strengths
-
Transferring between these model families is a useful result in itself. Different token boundaries and positional schemes make this substantially harder than reuse between related checkpoints, and the breadth study includes several genuinely different cache interfaces.
-
Using attention sensitivity to weight reconstruction errors is well motivated. The separate treatment of keys and values leads to a tractable closed-form fit, and the derivation explains what the approximation retains and leaves out.
-
The crossed ablation of layer selection and fitting is the most persuasive part of the analysis. Mapper capacity stays fixed, while the weight-shuffling control helps show why assigning importance to the right cache positions matters.
-
The method offers a useful operating point when an upstream model has already read the context. Handoff is fast, the mapper is reused across tasks, and its construction is cheaper than training the evaluated translators. The full construction measurements are helpful here.
Critical weaknesses
-
I could not tell how much generation quality is lost relative to the target model. Table 4 omits native WikiText perplexity and SQuAD accuracy, and LCF actually has better perplexity than TACIT. These references are needed before concluding that the faster handoff preserves useful generation quality.
-
The benchmark coverage is narrow for the proposed shared-memory interface. C2C evaluates knowledge and reasoning on MMLU-Redux and ARC-Challenge, while the closed-form transfer study includes multi-turn CoQA. TACIT should cover comparable reasoning and multi-turn use, where specific information must survive the handoff; teacher-forced continuation alone does not establish this.
-
The abstract makes the results sound broader than the tables show. Six-task retention is measured on six directions; thirteen directions are tested only on HellaSwag. Several individual pairs also favor a learned baseline, despite TACIT winning every task average. A reader choosing one transfer direction needs this distinction.
-
The contrast with previous objectives is overstated. C2C already trains through next-token prediction, rather than only matching cache coordinates. The contribution is more specifically a closed-form attention surrogate and heterogeneous transfer pipeline; the current framing makes the conceptual departure look larger than the comparison establishes.
Questions for authors
-
Would replaying a longer tail repair the weaker predictions immediately after handoff? Table C.2 looks less favorable than the longer continuation average. I would like to see how much quality can be recovered for the additional replay cost.
-
Were the learned baselines given the same batched cache-delivery optimization as TACIT? Separating conversion from delivery time would help interpret how much of the reported handoff speedup comes from the mapper itself.
-
How should the proposed routing and readout explanation be reconciled with the large gains from value-only Selection? The interventions suggest that Selection and Fit both influence readout, rather than assigning each component one distinct role.
-
How often does causal alignment reuse one source row for several target tokens, and how does transfer quality vary with this mismatch? I would be interested in whether the weakest transfer directions are also the ones losing the most token-specific information.