CiteFusion-RAG: Hybrid Fused Retrieval with Citation-First Prompting for Accurate Documentation QA
Abstract
We present CiteFusion-RAG, a retrieval-augmented generation (RAG) pipeline for question answering over technical documentation that combines hybrid retrieval with citation-first prompting. The retrieval stage fuses sparse BM25 scores and dense embedding scores with lightweight entity hints, while overlapping chunks and neighbor expansion preserve evidence across section boundaries. The generation stage instructs the language model to ground claims in labeled snippets, cite supporting sources, and abstain when the retrieved evidence is insufficient. We evaluate the pipeline on five documentation corpora (Langfuse, Mastra, Langflow, Bland, and Firecrawl), each containing 150 question-answer pairs balanced across easy, medium, and hard difficulty levels. Using answer relevancy as the primary automatic metric, CiteFusion-RAG achieves a reported macro-average of 88.43%, approximately 11 percentage points above the strongest evaluated baseline. On hard questions, it achieves 84.35%, approximately 12.1 points above that baseline. These results suggest that combining complementary retrieval signals with explicit attribution instructions can improve answer relevancy in technical-documentation QA. Broader faithfulness evaluation and human assessment remain necessary to establish claim-level correctness. Evaluation scripts, the benchmark, and a simplified reference implementation are planned for release upon camera-ready publication.
est. 32% chance this paper gets accepted at ICLR 2027.
What do you think this paper will get?
All positions stay anonymous.