acceptodds
Under review as a conference paper at ICLR 2027

Drift-Localized Order Effects in Temporal Dense Retrieval

Abstract

Temporal retriever refresh must reconcile examples that add facts with later passages that revise or contradict them, but ordinary curriculum comparisons entangle their order with exposure, replay, and negative mining. We identify the residual sequence effect by materializing a 6.4-million-occurrence multiset containing primary and 20% replay triplets before training and permuting only their occurrence-to-step assignment; every occurrence retains its positive and hard negative, and the loss has no cross-example terms. A frozen six-signal drift card defines response strata, while StrataOrder schedules additive, revision, and conflict phases forward. On Reuters News, versioned API documentation, and Wiki Entities, Contriever-MSMARCO reaches 74.7 Recall@100 in the eight-window high-drift slice versus 70.1 for global random order (, 95% CI , ) and 72.4 for random order with explicit time tokens (, ). Reverse ordering jointly reduces final-state recall and current-over-stale preference and increases forgetting; phase-preserving shuffling lies between Random and full forward order. ColBERTv2 reproduces the high-drift contrast (+4.0 [2.5, 5.5]), while both architectures show only in the predeclared null slice. The resulting drift–order map turns sequence design from a generic curriculum choice into a measurable property of retrospective refresh: revisions and conflicts identify where fixed-exposure scheduling materially changes retrieval.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.