The Price of Adaptivity in Bandit Multiclass Classification: Minimal Separation and Sharp Tower Asymptotics
Abstract
We resolve the existence component of a foundational open problem posed at NeurIPS 2024 concerning the price of adversarial adaptivity in bandit multiclass classification. The optimal expected mistake bound against an adaptive adversary is at most a multiplicative above the oblivious bound, where . We prove that genuine concept classes can incur a strict adaptive–oblivious gap. First, a four-function class on two points with has adaptive value and oblivious value . No class of at most three functions separates, so four is optimal. Second, for the multi-shield towers , we prove a closed-form recursion for the adaptive value of every reachable state. We obtain and , hence exactly. Third, our capping theory bounds natural amplification constructions. For atoms whose adaptivity ratios are uniformly bounded by , unions with disjoint label blocks obey at any finite nesting depth. An exact Hamming-ball formula shows that the additive localization surcharge already reaches for two overlapping layers. Every exact value has a certificate: primal–dual certificates at each game state for adaptive play, and explicit priors and sequences for oblivious play. The included standard-library script re-checks them all. We also establish necessary conditions for linear separation: , and the concept class must have at least exponential size.
Then back it, or bet against it.
Related papers
Open the market on this paper to see 7 more related papers.