- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies non-prefix context reuse in frozen state-space language models, where the same document follows different request-specific prefixes. StateBridge learns a short matrix of continuous input vectors for each reusable document and scans this matrix from the live recurrent state instead of processing the full document. Training combines teacher-answer distillation with document-end convolutional and SSM state matching, using augmented prefixes. Across four QA benchmarks, the paper reports F1 retention of 88.69%–101.07% on the main evaluation sets and whole-prompt TTFT speedups of 1.62×–2.71× under the tested configurations. Additional studies examine different Mamba backbones, state supervision, document length, and transfer to unseen question types.
Critical strengths
1.The learned surrogate provides a compact, executable mechanism for updating prefix-dependent recurrent states through a frozen SSM.
2.Evaluations across four QA benchmarks demonstrate useful quality–latency trade-offs, with whole-prompt TTFT speedups reaching 2.71× in the tested configurations.
3.The state-anchor ablation raises held-out HOW-question F1 from 7.14 to 37.50, providing direct evidence for the benefit of state supervision.
Critical weaknesses
1.Missing comparisons with relevant state-composition and compression methods, particularly order-preserving CASO, leave the method’s additional contribution unclear.
2.The substantial decline on unseen question types and lack of controlled prefix-transfer tests leave generalization beyond the construction distribution insufficiently established.
Questions for authors
1.How does StateBridge compare with order-preserving CASO and a document-compression baseline under the same frozen backbone, considering quality, preprocessing cost, storage, and online latency?
2.Can the authors separately evaluate prefix-distribution shift and question-type shift, with document-level confidence intervals, to clarify the observed OOD degradation?
Dear Reviewer,
I hope this message finds you well. I am writing to kindly remind you that the authors’ rebuttal has been posted and is now available for your review in the system.
We would greatly appreciate it if you could review the rebuttal and provide your assessment at your earliest convenience, as your input is important for us to move forward with a timely decision.
Thank you very much for your time and continued support.
ACs