acceptodds
Desk rejected at ICLR 2027

Trace2Act: Auditing When Refuted Premises Drive Irreversible Multi-Agent Decisions

Desk rejected at ICLR 2027, so left out of the paper lists and the map.

Abstract

A final action can look correct while its transcript reveals that the stated justification depends on a premise the available record already refutes. Trace2Act introduces commitment-boundary evaluation for this failure. Given fixed evidence and an irreversible-action rubric, its deterministic aggregation rule identifies a reinforcing path from an evidence-refuted claim to commitment before any challenge or retraction. On a pooled home set of matched transcripts, answer-level factuality misses action-coupled episodes and adds positives outside the commitment-boundary endpoint; adjacent evaluators consequently expose different failure sets on identical records. A -transcript blinded endpoint audit yields Cohen's and Krippendorff's . By retaining the premise-to-action path, Trace2Act supplies an auditable criterion for evaluating how agent workflows authorize irreversible decisions.

Primary area:
datasets and benchmarks
Keywords:
evaluation benchmarks and data, Trace2Act

Related papers

Discussion (0)

Sign in to comment.