Finding Second-Order Stationary Points of Nonconvex—Strongly-Concave Minimax Problems under Weaker Smoothness Assumption
Abstract
Most existing studies on computing second-order stationary points of minimax problems focus on the nonconvex–-strongly-concave setting under higher-order smoothness assumptions. We adopt the notion of Goldstein approximate second-order stationarity and, for the first time, extend the study of second-order stationarity to the weaker setting where the objective is only continuously differentiable with a Lipschitz continuous gradient. Specifically, we propose a first-order method, called Smoothed Minimax Cubic Newton (SMCN), for finding an -Goldstein approximate second-order stationary point of the primal function. We show that with high probability, SMCN requires at most outer iterations and first-order oracle calls, where denotes the Lipschitz constant of the gradient, is the condition number, and is the primal dimension. We conduct numerical experiments to further demonstrate the effectiveness of the proposed method.
Then back it, or bet against it.
Related papers
Open the market on this paper to see 7 more related papers.