Nearly Optimal Best-of-Both-Worlds Individual Regret in Cooperative Bandits
Abstract
We study the best-of-both-worlds problem of cooperative multi-armed bandits in the uninformed setting, where agents interact with a common set of arms over an arbitrary connected communication graph, and each agent initially knows only its local neighborhood. Over a horizon of rounds, each agent selects an arm, observes only its local loss, and exchanges information with its neighbors. The environment can be either stochastic or adversarial, and the agents do not know the regime in advance. The objective is to simultaneously achieve small individual regret for every agent in both regimes while minimizing communication cost. We propose a single algorithm that achieves individual regret in the stochastic regime, where is the suboptimality gap of arm , and individual regret in the adaptive adversarial regime. We establish matching worst-graph lower bounds up to logarithmic factors for both regimes. Our regret guarantees strictly improve the best known results in the stochastic regime. We further show that our algorithm requires only communication rounds per agent in the stochastic regime, while every packet has bits in both regimes. Finally, we reveal a polynomial separation between adaptive and oblivious adversaries, showing that adaptivity can make cooperative bandit learning polynomially harder.
est. 32% chance this paper gets accepted at ICLR 2027.
What do you think this paper will get?
All positions stay anonymous.