acceptodds
Under review as a conference paper at ICLR 2027

Tight Heavy-Tailed Complexity Bounds for Optimizing Polyak–Łojasiewicz Objectives

Abstract

We study optimizing -smooth and -Polyak–Łojasiewicz (PL) objectives with unbiased stochastic gradients under -heavy-tailed noise (). In the unrestricted **high-dimensional** setting, we establish the noise-adaptive lower bound for attaining -suboptimal function value. Under the generalized mirror-PL condition, we propose a centered-clipped mirror-descent method that achieves a high-probability upper bound matching the lower bound up to logarithmic factors. We further provide the improved tight stochastic complexity in **fixed** dimensions.

Then back it, or bet against it.

Related papers

Open the market on this paper to see 7 more related papers.