Identifiable Hierarchy Depth: An MDL Tree Cost for Structural Entropy
Abstract
Hierarchical clustering, community detection and world models need the number of levels, which their objectives do not provide. Dasgupta's cost, hierarchical modularity and structural entropy (SE) never get worse when a level is added, so their optimizers add levels even to graphs with no hierarchy. Depth becomes identifiable with two ingredients: a per-level null-model test around any hierarchy builder and score, and, for SE, a completed code whose minimizer has finite depth. For SE the failure is exact: any multiway encoding tree can be refined to a binary tree without increasing . We give SE a two-part minimum-description-length (MDL) objective , whose terms are all prefix-code lengths: is exactly the cost of coding each directed edge endpoint by its Li–Pan tree codeword, is the up-addressing cost SE leaves unpaid, and is an Elias-gamma size-list code for the tree topology. We derive the exact condition under which a coarse -way split strictly beats its binary refinement — collapse improves iff — and prove that no -optimal tree contains a null refinement, so depth is well defined. We then prove a boundary result: because the SE code fixes its probabilities by volumes, its gains are linear in cut fluctuations, so on sparse random null graphs a spurious level survives any topology cost of scale . No such tree cost makes nulls flat; the null test, part of the method, has false-positive rate per level under exchangeability, which swap-chain resamples satisfy only approximately. On planted hierarchical SBMs with vertices at hierarchy strength , the calibrated depth recovers in every seed, where pure SE returns binary dendrograms of depth – and neither multilevel Infomap nor the nested SBM recovers all three; it calls of degree-matched nulls flat (both rivals call all flat) and misses a fourth level of -vertex blocks, which it recovers at vertices, where it instead keeps a spurious sub-level on flat two-block graphs. Around Dasgupta's cost, hierarchical modularity, the map equation and plain SE, the test keeps – of nulls flat where the raw rules of all but the map equation call none flat, and with sparsest-cut bisection it recovers to in at least of seeds each; builders that merge planted levels, and the map equation, which prefers shallower trees, are not rescued. Code, raw results and preregistrations are in the supplement.
est. 32% chance this paper gets accepted at ICLR 2027.
What do you think this paper will get?
All positions stay anonymous.