Smoothing Does Not Compress & Hard Structured Inference
Abstract
Differentiable structured-inference layers replace hard recurrences by regularized operators. We ask whether this smoothing can reduce the representation cost of the underlying hard value function. For a broad class of finite DAGs, the answer is no in the sublinear-ray regime. We pair a finite-temperature computation with a same-wiring tropical shadow: bounded min/max deformations are replaced by hard extrema, positive scalar gates are retained, and finite constants are removed. A recursive DAG budget then bounds the discrepancy on every score ray. Consequently, any -accurate realization has the target's exact shadow and inherits its min-plus or STC lower bound without a size loss. The same budget gives finite-scale open-cone slope and relative-support floor certificates, while annealing changes only the deformation term. For -ary linear-code inference, we prove ; for the grid cycle code, , giving a barrier. CUDA double-precision experiments recover the exact width threshold and code-distance slopes, and separate deformation from representation error under annealing. Signed affine preprocessing is covered by a signed shadow with an explicit affine budget.
est. 32% chance this paper gets accepted at ICLR 2027.
What do you think this paper will get?
All positions stay anonymous.