How Loud Is a Gradient? An Amplitude Law for Noisy Comparisons
Abstract
A comparison oracle reports which of two points is better. Can it certify that an optimizer may stop, that is, that ? Exact comparisons cannot: they preserve only the order of values. Under Bradley–Terry noise a query returns with probability , so repeated answers measure value gaps. We show that every question posed to this oracle has a natural size, its amplitude: the least uniform change of the logit potential , modulo constants, that flips the answer. A question of amplitude needs at least comparisons, with the entropy of what must be distinguished, and it is unanswerable when opposite answers can share a potential. Computing amplitudes organizes the theory. A gradient is a small value step, of amplitude exactly for -vs- tests over -smooth objectives; for -th order smoothness, the exponent of Kolmogorov's inequality yields search lower bounds . When is known only up to a ratio , the amplitude is proportional to : -vs- verification is impossible exactly when , and its cost grows as at the edge, a rate an explicit tester attains. Value-margin tests have amplitude and need neither smoothness nor dimension-dependent sampling. The unresolved factor is dimension: at fixed confidence, known-scale verification costs between and comparisons up to constants, and nonadaptive verifiers need order .
Then back it, or bet against it.
Related papers
Open the market on this paper to see 7 more related papers.