What Soft Clustering Objectives Compute, When They Are Tight, and What Softness Buys: The Case of Soft Structural Entropy
Abstract
Differentiable relaxations of discrete clustering objectives are standard in graph learning: DMoN, MinCutPool, Neuromap and structural-entropy (SE) methods (LSEnet, DeSE) relax modularity, normalized cut, the map equation and SE by substituting soft volumes and internal weights into the discrete formula. The resulting bilinear plug-in is read as the discrete objective. We ask what it computes, when it is tight and what the softness buys, with two-level SE as the running case. For a row-stochastic assignment we compare the plug-in , the multilinear extension under independent rounding, and a memoryless stochastic-encoder code length . All three agree at hard assignments, and exactly: the deployed objective is a bits-back net rate. The multilinear extension is an exact relaxation (its minimum is a vertex and equals the discrete minimum), whereas the plug-in is provably loose: at the uniform assignment it equals on every graph, so a strictly soft beats every partition whenever the discrete optimum lies above that floor, and local overlap makes it loose even when it does not (5-node bowtie: against bits). Beyond SE, the multilinear extension is exact for every partition objective; Neuromap's plug-in obeys the same bits-back identity but has no floor; pairwise objectives differ from their expectation by a degree-weighted Gini refund, which makes Markov stability at even times exactly tight and bounds modularity's looseness by . In an exhaustive census plug-ins deployed for SE, DMoN, MinCutPool and Dasgupta's cost beat every partition on 12, 14, 10 and 9 of 20 instances; the map equation's never did by more than bits. On the sparse graphs we tested the looseness does not bind: on Cora, CiteSeer and planted SBMs the plug-in optima are near-hard, the multilinear objective trained with its unbiased gradient finds no better partitions, and the soft-over-hard advantage of our encoder control largely vanishes against a Gumbel-softmax hard arm. Preregistered gates are reported verbatim, including the failures (a planted-overlap null control fails at 5 and at 20 seeds).
Then back it, or bet against it.
Related papers
Open the market on this paper to see 7 more related papers.