acceptodds
Under review as a conference paper at ICLR 2027

PAY AT THE EVENT: EVENT-CONDITIONED RECURRENT STATE TRACKING AND ASSOCIATIVE RECALL

Abstract

We introduce an event-conditioned recurrent block that explicitly separates transition computation from associative storage. FLINT maintains a low-cost diagonal carry at every token while applying expressive Householder transformations only at selected events. When event gates are determined before scanning, the recurrent dependency chain can be reorganized around event boundaries, making expensive transition work proportional to the number of events. EGAM provides fixed-size associative memory through binary addressing, gated additive writes, and normalized slot reads. In a shared-backbone block benchmark, the combined block achieves faster forward execution than Gated DeltaNet-2 at known-mask density and length . Replacing memory-projection multiplications with additive and bitwise operations reduces mixer multiply-accumulates (MACs) from M to M per token and layer, with M accumulate/bit operations, excluding the MLP. Across three seeds, mean WikiText-103 perplexity changes from to . On FineWeb-Edu, a 122.54M-parameter model trained on 1.007B tokens retains validation perplexity ( to , one seed) while reducing mixer MACs from M to M. The combined task state is independent of context length and, at length , is approximately one-eighth the size of attention’s KV cache. Learned-gate and joint tasks evaluate tracking and recall within these budgets. We will release our code upon acceptance.

Then back it, or bet against it.

Related papers

Open the market on this paper to see 7 more related papers.