acceptodds
Under review as a conference paper at ICLR 2027

Structured Evidence Filtering and Consensus Reasoning for Multi-Agent Fact-Checking

Abstract

Large-scale retrieval-augmented fact-checking often suffers from noisy evidence and unreliable multi-agent reasoning aggregation. To address these challenges, we propose a Structured Evidence Filtering-based Multi-Agent Consensus Framework (), consisting of two core modules. The first is a Structured Evidence Filtering (SEF) module, which leverages domain knowledge to remove irrelevant evidence and maintain semantic consistency with the target claim. The second is a Challenge-and-Validation Reasoning Approach, which treats minority dissent as a signal to activate iterative cross-examination, allowing agents to correct logical defects through evidence-grounded deliberation. Experiments on three benchmarks—CheckThat-T3, CHEF, and SciFact—show that SEF-MAC consistently outperforms competitive baselines, with Micro-F1 gains of up to 3.72 percentage points and Macro-F1 gains of up to 3.00 percentage points. Further ablation and analysis suggest that evidence filtering and consensus reasoning make complementary contributions to improve fact-checking accuracy across different evidence settings.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.