Tight Sampling Complexity with stochastic gradient oracles in Fixed Dimensions
Abstract
We establish the stochastic-gradient query complexity of sampling smooth strongly log-concave distributions in every fixed dimension . For -strongly convex, -smooth potentials with unknown minimizers in the ball , and unbiased gradient oracles with variance at most , the minimax worst-case expected query complexity is , jointly optimal for the condition number , variance , and TV accuracy . In the noiseless setting , this tight complexity is independent of . Moreover, a gradient-only sampler generates an exact sample with worst-case expected queries. Without previous ball , exact sampling from any initial point can be implemented with expected cost {O}\\left(\\log(1+\\kappa)+\\log(1+\\sqrt{\\mu}\\|x_0-x_f^{\\star}\\|)\right), without knowing the initial distance. We also show that dependence on initial distance is generally unavoidable.
Then back it, or bet against it.
Related papers
Open the market on this paper to see 7 more related papers.