Variance Is Not Information: Why Priors over EEG Cannot Close the Trial-Averaging Gap
Abstract
Every headline number on THINGS-EEG2, the standard benchmark for visual decoding from EEG, is computed on responses averaged over 80 repetitions of the same stimulus. The same frozen encoder scores at 80 repetitions and at one, and two reproduced 2026 baselines keep and of their headline number at one repetition. We ask whether that gap can be closed algorithmically and answer no, in a strong sense: classical MMSE estimators recover none of it, and the provably optimal diffusion prior over EEG, which is available in closed form and hence immune to a training-quality objection, recovers none of it and at actively hurts. One measurement explains why. Ordering the response's principal directions by variance, the 32 leading directions carry of the estimated signal energy, retrieve at chance in isolation, and deleting them is free; keep- accuracy does not saturate until . The discriminative signal is high-rank and anti-aligned with variance, so any prior, estimator or likelihood-maximisation step that concentrates its estimate where the variance is allocates capacity where the information is not. Consistently, the estimator closer to the high-SNR response in NMSE loses four points of Top-1. Both findings replicate on THINGS-MEG. The same principle governs the image side: multi-view target augmentation is worth , yet an operator fitted to reproduce that target reaches cosine on held-out images while delivering of its benefit, making it nonlinear adds Top-1, and training it on the retrieval loss instead gives a family whose optimum is the identity. Reproducing a target and reproducing its value are different problems. Progress on this benchmark is measurement-bound rather than model-bound.
Then back it, or bet against it.
Related papers
Open the market on this paper to see 7 more related papers.