acceptodds
Published as a conference paper at NeurIPS 2026

Meta: Recursive Self-Improvement through Emergent Depth

Zae Myung Kim, Young-Jun Lee, Seungyeon Jwa, Dongyeop Kang

Abstract

Self-improving LLM agents typically improve answers, not the by which answers are improved: their search loops and mutation rules are held fixed by design. We introduce , a framework for self-improvement in which a single universal meta-operation is applied repeatedly to build a hierarchy of meta-layers whose depth is sized by convergence rather than prescribed. Each layer observes execution traces from below, diagnoses failure patterns, and emits executable code (strategic guidance via pre-processing and reusable functions via a code library) whose effects cascade downward. Inter-layer conditioning permits up to effective strategy-tactic combinations across layers rather than . An evolutionary orchestration mode maintains a growing archive of candidate chains with fitness-weighted parent selection and cross-candidate inspiration. Across seven benchmarks (combinatorial optimization, two text classification tasks, terminal agent tasks, mathematical discovery, symbolic regression, algorithm speedup), beats prior self-improving agents on all five (of seven) benchmarks where they apply, with the largest gap on CO-Bench (0.849 test vs. Gödel Agent's 0.000 and OpenEvolve's 0.816). Layers specialize without prescription and their roles emerge at depth: generic primitives at depth 2 propagate as cross-task callables, task-aware routing emerges at depth 3, and deeper layers refine via specialization. Code and data will be released publicly.

Related papers

See more related submissions when the market opens.