acceptodds
Under review as a conference paper at ICLR 2027

Rethinking Failure Attribution in Multi-Agent Systems: A Multi-Perspective Evaluation

Abstract

Existing benchmarks and methods for MAS failure attribution largely assume a single deterministic root cause for each execution failure. We challenge this assumption, arguing that MAS failures often admit multiple plausible attributions depending on an observer’s analytical perspective. To address this, we propose multi-perspective failure attribution and introduce MP-BENCH, the first benchmark and evaluation protocol designed for this setting. Through extensive experiments, we show that the perceived limitations of LLMs in failure attribution stem not from insufficient model capability, but from evaluation assumptions that fail to account for the inherently multi-perspective nature of MAS failures.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.