acceptodds
Published as a conference paper at NeurIPS 2026

Locally-Additive Regret for Delayed Non-stationary Bandit Convex Optimization

Wentao Zhang, Yifan Zhu, Yutong Zhang

Abstract

We study bandit convex optimization (BCO) when feedback is adversarially delayed and the comparator sequence is also adversarially non-stationary. This setting arises in online advertising, recommender systems, and adaptive dosing, but existing algorithms either absorb one of the two axes into a black-box global penalty or pay a worst-case cost that ignores the local interaction between delay and drift. We propose Oracle-DARS-DBCO, a delay-aware blocking algorithm whose block length and one-point smoothing radius satisfy the single identity . This identity cancels the multiplicative coupling between delay deviation and one-point estimator variance, so the regret of each segment is paid only on that segment. We prove matching upper and lower bounds on the expected dynamic regret: for convex losses and for -strongly convex losses, where is the number of stationary segments and is the worst-case delay. The matching Rademacher-sign lower bounds and show that the delay price is segment-local. On fourteen scaling experiments, the fitted log–log exponents agree with the predicted ones within , and Oracle-DARS-DBCO reduces regret by up to relative to the strongest non-restarting baseline on a piecewise-stationary benchmark.

Related papers

See more related submissions when the market opens.