Adaptive Maximin Learning with Intermittent Opponent Observations
Abstract
We study an unknown zero-sum matrix game against an adaptive opponent, with learner actions, opponent actions, and rounds. Rewards are always observed; opponent actions are independently revealed with unknown probability . The benchmark is the best mean payoff a fixed action can guarantee against every opponent action. Regret is the expected sum of this value minus the mean payoff of each chosen action pair. A base policy given only achieves worst-case regret and two gap-dependent logarithmic bounds. One uses revealed actions and scales as for . The other holds with the same constant for every at a strict pure saddle, a pair of actions that are unique best responses to each other. On a family with tied opponent best responses, the revealed-action bound has a matching fixed-instance lower bound for policies with logarithmic worst-case regret on every fixed matrix at every fixed . An enhanced policy combines row-reward estimates with revealed-action frequencies. It uses the same inputs, preserves the base guarantees, and attains dependence on a different two-row family for .
Then back it, or bet against it.
Related papers
Open the market on this paper to see 7 more related papers.