acceptodds
Under review as a conference paper at ICLR 2027

Detecting Concept Drift in Data Streams Using Instrumental Variables

Abstract

Concept drift is a common phenomenon in real-world data streams that requires models to adapt to changing data distributions. Yet, most concept drift detectors raise flags according to changes in observable distributions or predictive error rates, often monitoring proxy signals, and requiring continuous access to ground-truth labels. In addition, they do not provide insight into why or how the data-generating process changed. Although recent work frames concept drift as changes in underlying causal mechanisms, identifying these mechanisms shifts from observational data is challenging due to unobserved confounding. In this work, we track mechanism changes in continuous data streams using Instrumental Variables (IVs). Specifically, we introduce an online IV monitoring framework that assumes an initial causal graph to identify valid instruments and continuously estimates their associated causal effects using the Wald estimator. We demonstrate two complementary applications of this framework. First, the Instrumental Variable-monitored Drift Detector (IVDD) compares successive IV estimates to detect and localize changes in monitored causal relationships without ground-truth labels. Second, the Instrumental Variable-monitored Adaptive Tree (IVAT) incorporates local IV-based causal-effect estimates into online tree learning, using causal-effect heterogeneity to identify relevant subpopulations and local monitoring to guide targeted adaptation. Empirical evaluations on synthetic structural causal models and real-world streams demonstrate that our IV-monitoring approaches pinpoint changes in causal mechanisms, achieving competitive performance against state-of-the-art drift detectors in delayed-feedback scenarios. Source code is available on GitHub.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.