acceptodds
Under review as a conference paper at ICLR 2027

Root Multiplicity Sets the Finite-Width Edge of Chaos in MLPs and Message-Passing Networks

Abstract

How far a finite-width network's order/chaos crossing sits from its mean-field location is set by one integer, the multiplicity of the mean-field root: an correction to the Lyapunov exponent moves the crossing by . In message-passing networks at zero bias the root is double. We prove this through an exact identity, , whose constant is universal () across smooth saturating odd activations, so the finite-width crossing lies at distance of order , not , from both the linearized boundary and mean field, which coincide. For MLPs and regular graphs with uniform input the network reduces exactly to a two-state Markov chain, and we prove the critical-window law . Between and the crossing the exponent is at least , sharply; at the chain converges to an explicit diffusion, and for every . Pre-registered measurements on full networks confirm the window law: the displacement decays as at zero bias (fitted exponent ) and as at nonzero bias (), and softsign is displaced more than by the predicted factor . Bipartite graphs follow a predicted second branch without the cost, which a registered field-level test confirms. We prove, and a registered test at held-out widths confirms, a shift for ReLU, whose root is simple.

Then back it, or bet against it.

Related papers

Open the market on this paper to see 7 more related papers.