acceptodds
Published as a conference paper at NeurIPS 2026

Semantic Residual: A Paired-Oracle Decomposition of LLM Multi-Agent Systems under Lossy Channels

Haotong Sun, Hang Yang

Abstract

LLM-based multi-agent systems (LLM-MAS) coordinate well on reliable channels but fail in poorly understood ways when communication is lossy. We measure these failures against a content-blind reference: synchronous push gossip on idempotent payloads, which admits classical bounds in diameter, conductance, and percolation. Our paired-Oracle protocol runs an LLM agent and a deterministic gossip Oracle on identical scheduler, topology, and channel realisation, so any outcome difference is attributable to per-node decision logic. On Distributed Common-Free-Slot (DCFS), a set-union task isomorphic to all-to-all rumour spreading, three signatures of a semantic residual emerge as channel reliability is swept: a phase-boundary shift identified directly from paired trials; a – rate of consensus on wrong answers despite complete knowledge, a regime classical gossip cannot enter; and a – round-count overhead at perfect channels. A mediation analysis shows that coverage and failure-mode labels are jointly a sufficient statistic for accuracy — no within-stratum residual remains — so the LLM–Oracle gap is fully captured by a -dependent stochastic mapping over four failure modes. This decomposition supports a four-tier mitigation hierarchy whose tier-wise gains match the externalised stratum's marginal share, and a five-parameter scaling law over an eight-model panel with leave-one-model-out RMSE .

Related papers

See more related submissions when the market opens.