acceptodds
Under review as a conference paper at ICLR 2027

Tracing Prompt-Conditioned Control from Allocation to Realized Actuation in Frozen VLMs

Abstract

We analyze inference-time control authority through the measurable sequence (). In one paired checkpoint, Dynamic-to-Uniform composition yields equal measured accuracies. Across five training seeds, the replacement changes the Prompt-derived state while retaining a zero-median allocation response and unchanged dominant allocation indices. Direct allocation and Prompt-input replacements produce downstream continuous responses at different controller coordinates, revealing a recurrent dissociation between conditioning variation, continuous allocation, realized actuation, and decision-boundary crossing.

Then back it, or bet against it.

Related papers

Open the market on this paper to see 7 more related papers.