acceptodds
Under review as a conference paper at ICLR 2027

Search Allocation Is Not Determined by Loss, Validity, or Unique Yield in a Laboratory

Abstract

Search allocation is not determined by loss, validity, or unique yield. Verifier-backed discovery is commonly scored by those three, yet none of them determines how much verified mass a search puts on a target family. In a laboratory with an exact verifier, withholding a two-variable family from pretraining yields zero verified proposals on six training seeds and on 12 further generation runs, even though every prompt contains . When the family is included, twenty-four matched initializations all visit it, yet parse-conditional allocation runs from 4.6% to 72.4%. The decisive comparison is inside that band: Seed 8 has higher teacher-forced loss than Seed 2 (0.2526 vs. 0.2428) and allocates 34.4% rather than 4.1% ( 37.0% vs. 4.6%). The gap remains under penalty 1.0 (0.4%), a healed prompt prime (7.2%), no feedback (2.0%), six structural exemplars (1.3%), and temperature 1.0 without nucleus sampling (8.5%; 13.2% parse-conditional, against 46.2% and 41.9%). At the low-allocation seed recovers 49/50 catalog keys while allocation stays 5.7%. Allocation and parse-conditional allocation are the quantities a verifier-backed report has to add.

Then back it, or bet against it.

Related papers

Open the market on this paper to see 7 more related papers.