acceptodds
Under review as a conference paper at ICLR 2027

-RLM: Statically Restricted Control for Recursive Long-Context Reasoning

Abstract

Long context is not synonymous with reliable reasoning: relevant evidence is easily lost, while standard Recursive Language Models (RLMs) address the problem by asking the model to generate and execute its own control code. This open-ended strategy extends effective context, but introduces malformed programs, unpredictable cost, and uncontrolled recursion. We introduce -RLM, a structured alternative that expresses recursive reasoning as a closed -calculus program over a compact library of compositional operators. The language model is invoked only on bounded leaf subproblems; decomposition, filtering, traversal, and aggregation follow a fixed plan that can be inspected before execution. This separation guarantees termination, bounds the number of model calls (leaves, plus one per internal node under neural composition) and hence their cost, and supports task-appropriate accuracy analyses for both conjunctive and retrieval settings. Across five long-context benchmarks and nine open-weight models, five-seed comparisons, -RLM improves accuracy most strongly for weak and medium models while reducing latency by on average and up to . These results show that explicit functional control can make recursive long-context reasoning faster, more reliable, and easier to analyze without increasing model scale.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.