Constant Individual Regret in General Games
Abstract
Uncoupled no-regret dynamics provide a decentralized route to equilibrium. We study horizon-independent individual regret in finite -player normal-form games under full-information feedback. We show that standard Optimistic Hedge has worst-case regret at least exponential in either the number of players or the largest action-set size . This motivates ECHO-OFTRL: optimistic follow-the-regularized-leader (OFTRL) equipped with an EMA cascade for high-order optimism (ECHO), where EMA denotes exponential moving average. The algorithm is deterministic and fully uncoupled. Simultaneously, for every horizon , each player in self-play incurs regret upper bounded by . With a regret-dependent learning rate, it also guarantees regret bounded by the self-play bound plus in the adversarial setting. More generally, we relate the regret bound to the order of the prediction-error filter's zero at one.
Then back it, or bet against it.
Related papers
Open the market on this paper to see 7 more related papers.