acceptodds
Under review as a conference paper at ICLR 2027

Spurious states are labels: A multi-label code in the Hopfield-RBM duality

Abstract

For forty years, the superpositions of stored patterns known as spurious states have been treated as the defining defect of the Hopfield model. We read them as an answer: a mixture of patterns is a composite signal, and identifying its constituents is multi-label classification. A Hopfield configuration cannot represent a set of labels; its dual restricted Boltzmann machine (RBM) can. We show that the Hopfield-RBM duality analytically fixes this representation: across visible neurons, active labels sit on the hidden layer at scale with an amplitude matching the archetype-mixture overlap. Under this label assignment, the class averages of noisy training examples form an exact fixed point in mean of one-step supervised contrastive divergence. We prove a finite-size drift bound that decomposes into four vanishing error channels: thermal sampling, dataset noise, mini-batch consensus, and finite-dimensional fluctuations. For continuous mixtures combined prior to quantization (such as musical chords and hyperspectral pixels), this overlap amplitude transitions to an arcsine law via one-bit random projections. Across four benchmarks on three public datasets, the resulting configuration acts as an optimal analytical warm start: computed in a single pass without gradient updates, it surpasses random initializations by to in score, saving thousands of training steps. Finally, the induced parameter-free read-out rivals computationally intensive one-bit compressed sensing baselines at a fraction of their inference cost.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.