acceptodds
Under review as a conference paper at ICLR 2027

The Statistical Price of Unknown Transient Amplitude in Best-Asymptote Identification

Abstract

When several learning or optimization runs share a budget of updates, the run with the smallest current loss need not be the run with the smallest limiting loss because the runs are still improving. We study how to identify the run with the best limit (best-asymptote identification) when the th update of run produces with Gaussian noise: each pull advances only the arm it is spent on, the decay exponent and the noise variance are known, and the limits and the transient amplitudes are not. The question is how much not knowing the amplitudes costs compared with an oracle that reveals them. We give three exact answers. For a single arm, the sharp asymptotic variance for estimating is instead of the oracle's , where for and for ; unknown amplitude, therefore, has a first-order cost only when the transient decays slowly. For two arms whose limits differ by , with amplitudes in any fixed compact subinterval of and a budget cap almost surely, the exact local asymptotic minimax misidentification error over all parameter-free policies with predictable, history-dependent allocation and adapted stopping is ; it is attained by deterministic balanced sampling with full-prefix least squares, and the oracle value is the same formula with . Hence, no adaptive allocation or stopping rule can remove the nuisance penalty: matching the oracle requires times as much first-order budget. For arms, when at most one challenger may approach the best arm at the scale and every other arm keeps a fixed margin, a sublinear screening pilot followed by an independent-suffix comparison attains the two-arm value, and the optimized deterministic all-arm-prefix budget is times larger. Exact finite-prefix risk calculations and Gaussian simulations illustrate the boundary at and the screening mechanism.

Then back it, or bet against it.

Related papers

Open the market on this paper to see 7 more related papers.