acceptodds
Under review as a conference paper at ICLR 2027

Tests Reveal an Unstated Code: (N+1) Propagation Consistency for LLM Code Generation

Abstract

Selecting LLM-generated code without ground-truth tests relies on LLM-generated test inputs and expected outputs. Yet whether the LLM-generated tests' expected outputs or the candidate codes are the more reliable signal varies sharply across tasks. Existing methods either trust the LLM-generated tests' expected outputs as ground truth or discard them in favor of cross-code consensus. To our knowledge, no prior framework unifies these two stances as endpoints of a principled, task-adaptive continuum; existing combinations remain heuristic. Our unifying insight: the LLM-generated tests' expected outputs are the input-output behavior of an unstated -th candidate code implicit in the LLM's solution distribution, on equal footing with the explicit ones. Each of the codes defines an agreement view, and we identify codes that score consistently across all views. We propose -Propagation Consistency (), which couples Laplacian propagations via a task-adaptive scalar weighting the unstated-code view against the rest. At its two endpoints, reduces to each prior stance, making a principled unification rather than a heuristic mixture. consistently improves every inner baseline and advances the state-of-the-art Pass@ among execution-only rerankers as a plug-and-play framework.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.