acceptodds
Published as a conference paper at NeurIPS 2026

Diversity Combining for Multi-Path LLM Reasoning

Guangsheng Yu, Litianyi Zhang, Qin Wang, Xu Wang, Mingyuan Li, Shaoxiong Ji, Ren Ping Liu, Massimo Piccardi

Abstract

Multi-path reasoning methods such as self-consistency (SC) sample reasoning paths and choose the most frequent answer. However, their gains quickly plateau as increases, and existing methods do not predict when this saturation will occur. We formalize multi-path LLM reasoning as a diversity combining problem from wireless communications: each path is a noisy channel observation, and pairwise path correlation limits the effective number of independent votes, creating a finite saturation ceiling. Generalized least squares (GLS) analysis shows that, under exchangeability, the optimal symmetric linear combiner of latent embeddings is uniform, supporting majority vote as the natural default in standard SC while leaving room for weighting or pruning under heterogeneous prompt-template branches. Across 5 models and 12 benchmarks, prompt-template diversity reduces path correlation in of valid cells, with the strongest effect on open-ended QA. We derive an Adaptive-K rule that uses a four-path pilot to select , retaining – of MV@ accuracy across Math, QA, and NLU. Our code is hosted at https://anonymous.4open.science/r/DiversityCombining-4905.

Related papers

See more related submissions when the market opens.