- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes KOMPAS, a black-box framework that uses linear Koopman dynamics modeling and predictive control to improve multi-turn LLM instruction following. It predicts future response attributes from historical observations and adaptively selects control instructions.
Critical strengths
The method reports consistent improvements in constraint satisfaction over uncontrolled models and existing white-box steering baselines across multiple benchmarks.
Critical weaknesses
-
The linear dynamics model ignores prompt semantics and lacks sufficient expressive capacity to reliably predict LLM output attributes.
-
The assumption of predefined attribute targets does not reflect real-world LLM usage, substantially limiting the practical relevance of the proposed method.
Questions for authors
See Weaknesses.
We thank the reviewer for recognizing KOMPAS's consistent improvements across multiple benchmarks. We address both concerns below.
W1. Linear dynamics and missing prompt semantics
KOMPAS intentionally models measurable reply-attribute dynamics, not the complete semantic process of language generation. The underlying LLM still receives the full task input, dialogue history, and textual instruction; only the controller's state is restricted to recent verifier readings. Thus, we do not assume semantics are irrelevant. Instead, their effects on the tracked attribute are observed through feedback, and the controller replans after every reply.
This is a deliberate expressiveness–accessibility trade-off. A semantic encoder would introduce additional modeling and computational requirements, whereas KOMPAS needs no hidden activations or logits and evaluates candidate instructions without additional target-LLM calls—a practical advantage also highlighted by Reviewer 5pUM.
The empirical comparison supports the lightweight choice: Table 1 shows the linear model ranks first on four of seven prediction tasks and remains competitive on the others; the more expressive learned lifting does not show a statistically distinguishable improvement over identity lifting on any of the seven. This does not rule out benefits from semantic features under abrupt topic shifts, but shows that greater model complexity is not automatically necessary for the attribute-level tasks studied. Incorporating semantics while preserving the black-box interface is a useful future direction.
W2. Practical value of predefined targets
We respectfully disagree that predefined targets are unrealistic. Many instruction-following applications impose explicit, verifiable constraints: word or sentence limits, readability levels for a target audience, required output structure, or measurable safety-related requirements. Such targets are supplied by the user or application, not artificially imposed by our method.
The key challenge is maintaining these constraints across turns: satisfaction at one step does not guarantee satisfaction later. As Reviewer M9nu noted, this interaction-level problem is real and underexplored. KOMPAS addresses it through feedback-based, prompt-level control rather than assuming a single initial instruction remains effective throughout the dialogue.
Our formulation is also not inherently restricted to a constant reference: Eq. (2) can be extended from a fixed (r) to a time-varying target sequence (r_{t+h}), without changing the overall control architecture. We present this as a natural extension, not as an experimentally validated claim. The current paper focuses on the already practical and measurable setting of maintaining predefined constraints over multi-turn interactions.