Protected Unbiased Sparsification: A Sharp Loewner Curve
Abstract
Many learning systems replace a probability vector —token attention, data weights, expert gates—by a random vector supported on at most coordinates. Such a replacement is trustworthy only if it is unbiased, preserves prescribed linear statistics on every realization (class proportions, group masses, control variates), and remains reliable for downstream responses that are not known when is drawn. We give a complete answer to this problem in Loewner order. Writing for the effective number of protected directions, , and for the covariance of a categorical draw that remains after regressing on the protected statistics, we construct, for every budget , an unbiased exactly protected -sparse with and we prove that the coefficient cannot be improved uniformly over instances at any budget. The result lifts a concurrent unprotected coefficient to arbitrary pathwise protection through a new residual-covariance bridge: the protected problem on coordinates with budget behaves exactly like the unprotected problem on coordinates with budget . For rational inputs, an exact-rational Las Vegas sampler draws in expected polynomial time and attains the curve within a factor . Finally, the universal guarantee is essentially the strongest constructible one: optimizing a law for a single revealed quadratic query already encodes Minimum Uncut exactly, so no polynomial-time approximation scheme outputs an explicitly represented optimal law unless . A small numerical study confirms that the constructed law tracks the curve and that the minimax step is necessary.
Then back it, or bet against it.
Related papers
Open the market on this paper to see 7 more related papers.