- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper introduces KVFixer, a new approach for approximating KV cache deletion and repair. It removes the KV cache for the erased interval, aligns retained rows to the revised positions, and predicts corrections to the suffix states, which are differences between target suffix KV and contaminated old suffix KV.
Critical strengths
S1. The high-level idea is technically interesting and well motivated.
S2. Empirical studies extend prior text-setting evaluations to image settings.
Critical weaknesses
W1. The paper presentation is very poor and hard to follow. Terms and concepts are used without definitions or references, details are missing, and the flow is messy. E.g.,
- Section 3.2 mentions "expert" without introducing or defining it.
- Table 1 presents experiment results without introducing baselines like Delete-and-shift, Exact-row prefix control, etc in the paper.
- In deriving , what projection did you use? How did you implement ordered embedding bins? How did you construct length features?
- How was the training and evaluation data constructed / adapted? How were erased intervals derived?
It's hard to properly assess the manuscript and trust the results of the paper before addressing the presentation issue and make the paper readable to the audience.
Questions for authors
See Weaknesses.