The Minimax Rate of Online Isotonic Regression
Abstract
Kotłowski, Koolen and Malek posed as an open problem, at COLT 2016 and again at NeurIPS 2017, the design of efficient algorithms for online isotonic regression on arbitrary partial orders. Wang (NeurIPS 2026) settled the product orders, conjectured the minimax rate for every finite partially ordered set, and posed the general case as an open problem. We resolve all of these open problems on every finite poset , determining the squared-loss minimax regret over rounds up to absolute constants: where is the logarithm of Stanley's order polynomial at , which counts the monotone maps from into . The same formula holds for log loss and, up to loss-dependent constants, for bounded exp-concave smooth losses that are strongly proper, while pinball loss at quantile level has minimax regret , . Exponential weights over the monotone maps attains the upper bounds, but its predictions are #P-hard to compute exactly on a general partial order. Our learner instead perturbs the scores with low-dimensional Gumbel noise and samples their maximizers, one minimum cut per sample, and an inequality that we call Gibbs domination shows that this costs only a constant factor in regret. It runs in polynomial time and attains each of these rates without knowledge of the horizon.
est. 32% chance this paper gets accepted at ICLR 2027.
What do you think this paper will get?
All positions stay anonymous.