acceptodds
Under review as a conference paper at ICLR 2027

CiteFusion-RAG: Hybrid Fused Retrieval with Citation-First Prompting for Accurate Documentation QA

Abstract

We present CiteFusion-RAG, a retrieval-augmented generation (RAG) pipeline for question answering over technical documentation that combines hybrid retrieval with citation-first prompting. The retrieval stage fuses sparse BM25 scores and dense embedding scores with lightweight entity hints, while overlapping chunks and neighbor expansion preserve evidence across section boundaries. The generation stage instructs the language model to ground claims in labeled snippets, cite supporting sources, and abstain when the retrieved evidence is insufficient. We evaluate the pipeline on five documentation corpora (Langfuse, Mastra, Langflow, Bland, and Firecrawl), each containing 150 question-answer pairs balanced across easy, medium, and hard difficulty levels. Using answer relevancy as the primary automatic metric, CiteFusion-RAG achieves a reported macro-average of 88.43%, approximately 11 percentage points above the strongest evaluated baseline. On hard questions, it achieves 84.35%, approximately 12.1 points above that baseline. These results suggest that combining complementary retrieval signals with explicit attribution instructions can improve answer relevancy in technical-documentation QA. Broader faithfulness evaluation and human assessment remain necessary to establish claim-level correctness. Evaluation scripts, the benchmark, and a simplified reference implementation are planned for release upon camera-ready publication.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.