Certified but Not Useful: An Information-Theoretic Ceiling on LLM-Based Mathematical Discovery
Abstract
We prove an information-theoretic ceiling for verifier-mediated LLM agents: in any hidden-world, no-side-channel verifier model with disjoint success sets, no admissible policy—at any query budget—has equal-prior success probability above , where is the total-variation distance between the laws of the complete verifier signature. The ceiling depends on the interface and environment pair, not the agent; exact maxima meet it in all 423 finite worlds. It is vacuous precisely when , meaning that the complete signature distinguishes the environments almost surely; public input revealing the target is sufficient, but not necessary. A companion result gives a minimax checker-call separation between charged rebuilding and free frame restoration in an opaque marked-leaf model. A usefulness interpretation of the ceiling requires success sets that encode held-out utility. We define statistical discoverability as the probability that a research procedure returns an artifact that is both certified and useful on sealed theorems. Separately, we observe that installing a checker-certified library lowered held-out solve rate by (95% CI ; 10 of 12 paired cells negative, none positive; ), and every added failure was a completed proof the checker rejected, not truncation or timeout. The measured harm is a post-freeze utility contrast on four worlds with a fixed solver, not an estimate of discoverability or a test of the ceiling; is unmeasured in these runs. Together, the framework opens a principled path for analyzing what LLM-based agents can and cannot formally guarantee in automated mathematics.
est. 32% chance this paper gets accepted at ICLR 2027.
What do you think this paper will get?
All positions stay anonymous.