acceptodds
Under review as a conference paper at ICLR 2027

Separating Quantum Circuits from Classical LLMs

Abstract

Modern large language models – transformers and diffusion language models – are built around two canonical algorithmic tasks: *prediction and generation*. We prove unconditional separations between low-depth quantum computation and the corresponding bounded-resource classical language-model architectures in both regimes. Concretely, we exhibit the following: - **Distributional separation.** We give a distribution that is sampleable by circuits (i.e., a family of constant-depth quantum circuits consisting of bounded fan-in gates) that no constant-round diffusion language model () with shallow scheduling and denoising can sample within constant distance, even when allowed sublinear chain-of-thought and output-token revision/remasking events, the very features modern s rely on. - **Functional separation.** We exhibit a function computable in (i.e., a family of -depth circuits, where is the input length, followed by a single classical gate) such that any constant-depth decoder-only transformer computing the function must be *large*: it would have to have width . Together, our work initiates the study of quantum advantage in the era of large language models.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.