When Activation Patching Admits Many Faithful Circuits
Abstract
Activation patching can establish faithfulness without determining a unique minimum circuit. In every additive -component model with minimum -faithful cardinality , complete order- evidence admits at most minimum circuits. A patched ReLU model with patching sites attains the bound whenever and , giving an exact extremal characterization. For this construction, raising the patch-order bound to makes the full mask uniquely faithful and gives every proper mask faithfulness error at least one. At , the exact maximum is . For fixed , exponential multiplicity persists with per-component fan-in and parameter count bounded independently of and with uniform response norms through order . The extremal family and transition remain stable under component perturbations and bounded departures from additive masking. Exact noiseless deterministic identification of an unknown extremal circuit requires queries of order at most in the worst case for .
Then back it, or bet against it.
Related papers
Open the market on this paper to see 7 more related papers.