Action-Catalog Shift Reveals Stable Latent-Trace Hallucination Routing
Abstract
Hallucination routing requires both an accurate risk score and a remedy matched to each failure, yet that pairing can become coupled to the action vocabulary used during system design. We introduce catalog-conditioned generalization, a controlled stress test that substitutes benchmark- or operator-supplied actions while fixing prompts, graders, utility, access, training budget, and comparator families. TraceDispatch (TD) addresses this shift with validation-selected multi-depth anchors, learned -dimensional compression, and an order-sensitive joint risk/action head executed within one generator pass. On public unseen-family evaluations spanning HaluEval-v1/Gemma-2-27B, BFCL-v3/Mixtral-8x22B, and LiveCodeBench-v3/DeepSeek-R1-32B, TD leads OO-Router by – AUROC and – corrected-output points. Benchmark-aligned substitution retains – of AUROC and – of intervention utility; an expanded controller frontier further places TD above output-only, matched-sketch, and richer-raw-state alternatives in every aligned catalog. TD remains top-ranked across five independently supplied catalogs spanning –; on blind human gold, it reaches AUROC and intervention utility at on Llama-3.1-70B, while a human-only reconstruction of the upstream pipeline changes AUROC by just . The results establish catalog-conditioned generalization as a discriminating controller-selection criterion and show that budgeted ordered traces preserve actionable signal across changes in catalog source, model family, supervision, and serving stack.
est. 32% chance this paper gets accepted at ICLR 2027.
What do you think this paper will get?
All positions stay anonymous.