ViCoB: Perceptual-to-Symbolic Binding with Selective Rebinding
Abstract
Multimodal editing systems must translate perceptual intent into exact symbolic references that downstream editors can execute. Even when a model identifies the intended object, it may emit an invalid or valid-but-wrong reference. Correcting such errors requires not only recovering a plausible alternative, but also deciding **whether the existing binding should be overwritten**. We introduce **ViCoB**, a selective-rebinding interface that separates recovery from overwrite authorization. ViCoB retrieves an operation-compatible alternative from executable source, but replaces the incumbent only when inference-visible evidence supports intervention. Under fixed retrieval, where all policies receive the same recovered alternative, Always-rerank repairs more errors than ViCoB (230 vs. 188) but causes substantially more regressions (85 vs. 13), yielding lower exact binding (63.8% vs. 66.7%). Across 1,750 cases and three frozen multimodal backbones, ViCoB improves exact binding from 49.1% to 64.4%. Downstream and transfer experiments further show that corrected bindings can improve executable editing and that selective rebinding extends across SVG and DOM. These results support treating overwrite authorization as a distinct, measurable decision between multimodal perception and symbolic execution.
Then back it, or bet against it.
Related papers
Open the market on this paper to see 7 more related papers.