acceptodds
Under review as a conference paper at ICLR 2027

Intent-Conditioned Prior–Context Integration via Protected Layerwise Calibration

Abstract

Integrating parametric knowledge and contextual information requires adapting their influence to the user's intent. Given a statement naming London as France's capital, a task may require the factual answer Paris, the stipulated answer London, or both alternatives. We formulate intent-conditioned knowledge integration through continuous, state-dependent control of source reliance, rather than a single binary source assignment. We introduce EpiSetter, a lightweight two-stage framework with a frozen language model backbone. First, bidirectional coordinate interchange between prompts sharing the same question and context but differing in intent learns layerwise control directions through an empirical residual parameterization. Second, these directions are frozen, and jointly trained scalar calibrators predict bounded, intent-conditioned intervention magnitudes from hidden states modified by preceding interventions. Reference-answer supervision trains the calibration policy, while distribution-preservation regularization, displacement penalties, and protected-validation constraints seek to preserve the backbone's capabilities. Inference requires neither donor prompts nor reference answers. On OLMo3-7B, EpiSetter raises joint correctness across 417 held-out ConFiQA-QA intent pairs from 18.23% to 36.93%, improving both prior- and context-oriented answer accuracy. Its advantage over constant-magnitude control supports input-dependent calibration. Extracted-answer exact match and token F1 improve on five matched MRQA datasets, while capability tests show improved instruction following and largely retained reasoning and QA performance. These results support continuous intent-conditioned source control as a practical foundation for knowledge integration; the direction construction requires further numerical validation, and integration of complementary information from both sources remains to be established.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.