Tight Lower Bounds for Stochastic Nonconvex–Strongly-Concave Minimax Optimization
Abstract
We study the stochastic first-order oracle complexity of finding -stationary points of the primal function in smooth nonconvex-strongly-concave minimax optimization. For sufficiently small , we establish lower bounds of under the bounded-variance assumption and under the additional assumption of averaged smoothness. Here, and denote the smoothness and averaged-smoothness constants, respectively, is the initial primal gap, bounds the oracle variance, and or in the respective settings, where is the strong-concavity parameter. Our bounded-variance lower bound improves the dependence on the condition number from in previous lower bounds to , while our averaged-smoothness lower bound is the first of its kind. In both settings, the resulting lower bounds match existing upper bounds in their dependence on and . Our proofs are based on a unified quadratic lifting construction that transfers a hardness instance for stochastic nonconvex minimization to unconstrained minimax optimization while preserving the required variance and smoothness properties.
Then back it, or bet against it.
Related papers
Open the market on this paper to see 7 more related papers.