acceptodds
Under review as a conference paper at ICLR 2027

POST-SELECTION CERTIFICATION OF GRADIENT CORESETS

Abstract

Gradient sketches make coreset optimization tractable; valid post-selection certificates require accounting for how the residual was chosen. We give an exact characterization for Gaussian sketches. For least-squares reweighting over a fixed -dimensional affine family, the selected residual’s sketch-to-exact squared-norm ratio is a scaled product of independent chi-square and beta variables. This law supplies an exact model-specific correction and identifies two distinct thresholds: relative distortion vanishes when , while uncorrected fixed-vector coverage can vanish when . For arbitrary selectors, a fresh Gaussian projection after commitment gives exact conditional intervals with rank-independent audit dimension. We also account for support-search multiplicity, numerical error, and fidelity to the deployed update. Experiments on Qwen2.5-1.5B/0.5B and GSM8K/MBPP tasks complement the theory with constrained real-model diagnostics: at 512 sketch rows, median residual distortion is 3.4% and ranking correlation is 0.95. Reweighting lowers the primary joint-subset exact residual by 23.6%, while increasing sketch optimism in 43 of 45 matched cells. Uniform bounds cover all 27 primary residuals, with six meeting the full-update tolerance. Together, these results distinguish accurate optimization from useful certification and provide calibrated routes to certifying the selected coreset update.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.