PaperCompiler: Faithful Paper-to-Code Generation via Repository-Level Specification Compilation
Abstract
Faithfully translating research papers into repository-level implementations remains challenging because papers often describe methods at a high level, leave implementation assumptions implicit, and require generated repositories to preserve method logic, evaluation protocols, and cross-file consistency. Despite recent advances in paper-to-code agents, their intermediate outputs are often presented as free-form plans or summaries that downstream coding agents may ignore, reinterpret, or compress, leading to algorithmic simplification and inconsistent repository structure. To address these challenges, we introduce PaperCompiler, a paper-to-code generation framework that compiles paper-grounded evidence into explicit repository-level implementation specifications. PaperCompiler grounds implementation-relevant evidence while preserving source provenance and distinguishing paper-supported, inferred, externally delegated, and unresolved information. The resulting specifications encode non-degradation requirements, ownership assignments, cross-file dependencies, and file-level constraints. Repository generation proceeds under these compiled specifications while retaining flexibility over local engineering choices not fixed by the paper. On 90 papers from Paper2CodeBench, PaperCompiler outperforms strong baselines, achieving a 13.8% relative improvement in reference-based fidelity (3.644.15) and reducing high-severity evaluator critiques from 13.2% to 6.1%.
Then back it, or bet against it.
Related papers
Open the market on this paper to see 7 more related papers.