acceptodds
Under review as a conference paper at ICLR 2027

Spectral Reuse under Squaring: A Sharp Locality Threshold

Abstract

Cached curvature responses support reliable update-length decisions only with an inverse-square guarantee; a quadratic-form guarantee alone is insufficient. We identify a sharp transition governed by spectral locality: for a Loewner approximation factor and log-spectral coupling width , the optimal inverse-amplification norm over all dimensions and condition numbers is finite exactly when . We derive this optimal norm and construct an asymptotically sharp chain whose amplification grows linearly with dimension at the threshold and exponentially above it. Numerical scans of finite chains show all three regimes. For unrestricted coupling, an exact square-distortion law gives the complementary condition , where and bounds the reference condition number. Together, these bounds give an update-length interval that accounts for asymmetric inputs, damping, and nonzero spectral tails. For example selection on synthetic logistic data with local spectral coupling, this interval reduces Hessian–vector products by a factor of ( to per batch) relative to global exact screening. It also reduces selection time by ( to  ms). On 1024-dimensional digits features, global exact screening reduces total time from to  s over 32 training steps with cache refreshes. Direct Cholesky is faster in the evaluated cold-start and banded settings.

Then back it, or bet against it.

Related papers

Open the market on this paper to see 7 more related papers.