acceptodds
Under review as a conference paper at ICLR 2027

Learning the Semantics of Logical Content

Abstract

A learner that induces logic programs from a template of candidate Horn clauses appears to face hypotheses, but most rule-sets deduce the same facts and are indistinguishable to any learner scored on its predictions. The true hypothesis class of a recursive template is therefore not the syntax but the set of realizable deductive closures , the distinct semantic meanings the template can express. Its log-count , the semantic information (capacity) of the template, is its learning complexity: when facts arrive online and the learner predicts whether the theory deduces each, Halving makes at most mistakes in the realizable case, the minimax log-loss (Shtarkov) regret is exactly once the queries separate the contents, and the agnostic minimax regret is . We compute in closed form: bits for the bandwidth- reachability template on , with the -bonacci constant solving , and bits for nonlinear transitive closure on constants. In a probabilistic reading a single content's size undergoes a sharp phase transition at one base fact per constant. One computable number thus governs counting, coding, and learning, realizing the semantic-information program of carnap1952semantic and lastras2026 as a learning rate. Empirically, on Padgett's Florentine families network the clause-sets collapse onto contents and the online code length lands exactly on bits; the same identity holds on WordNet.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.