acceptodds
Under review as a conference paper at ICLR 2027

Testing Hypotheses with Knowledge Networks

Abstract

When does a prerequisite network make a hypothesis cheaper to test? We study one conjunction of binary hypothesis under supplied prerequisite rules and fresh noisy queries, with validity required at every legal state. On a directed acyclic graph allowing at most failed rules, the verification cost at a supplied legal ideal is at every confidence level , uniformly in the graph, where is a fractional cover of the low cut missing sets inside . When the mastered witness is unknown and is located through a diagnostic table , the cost is , where is the cost of hitting a witness without recognizing it: discovery and confidence add. Over all tables, diagnostic pairs for witnesses leave a discovery cost of order , while a constant factor surplus of pairs lowers it to order , even against unbalanced tables and adaptive proposals. The laws survive two relaxations. With redundant witnesses and at most failed rules, only the confidence term grows, by . With error rates unknown but bounded by a known margin, the optimized resource law is unchanged; this covers sampled outputs graded by exact checkers under a pass rate gap. The converse also requires every grade pattern satisfying the witness inclusions and diagnostic pair incompatibility to be realizable. Pairwise implications of a union closed knowledge space preserve full mastery certificates, but not partial profile ones. Preregistered experiments reproduce the additive law and the diagnostic resource law in simulation and on sampled outputs of language models, and locate where they stop: under persistent errors, and under rules read off difficulty labels.

Then back it, or bet against it.

Related papers

Open the market on this paper to see 7 more related papers.