- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposed PATC, an activation steering method that leverages flow matching to construct prompt specific steering vectors. The method trains flow matching models at different resolutions, a token level to estimate behavioral steering directions and a response level to estimate steering strength, The resulting steering vector is applied throughout generation. Authors evaluate PATC on anger and anxiety using Qwen and Gemma.
Critical strengths
- The paper proposes an interesting approach to prompt adaptive activation steering by leveraging token level information to construct steering directions and using a separate response level flow to estimate steering magnitudes. The idea of aggregating token level transport information into a single cached steering vector is appealing, as it allows the method to incorporate fine grained contextual information without requiring repeated flow evaluations during generation.
- The experimental results demonstrate that PATC generally achieves a favorable trade off between steering effectiveness and generation quality. In particular, the method shows improvements in lexical diversity, repetition reduction, and task preservation compared with several existing activation steering methods. The evaluation at approximately matched achieved affect also makes the comparisons more convincing by reducing the influence of differences in steering strength.
Critical weaknesses
- Insufficient justification for the complex steering framework. The overall steering framework is relatively complex, involving several design choices whose necessity is not sufficiently justified. Although the authors provide intuitive motivations and conduct some ablation studies, several components remain insufficiently explored. For example, it is unclear why the local transport directions predicted by the flow matching model need to be corrected based on the empirical mean direction. Such corrections may potentially discard meaningful local variations. Similarly, the necessity of displacement projection and source nulling is not thoroughly investigated. More targeted ablation studies would help clarify the individual contributions of these components.
- Limited scope of experimental evaluation. The experimental evaluation is relatively narrow. Although the paper presents PATC as a general framework for behavioral steering, the experiments focus primarily on anger and anxiety. It remains unclear whether the proposed method generalizes to other behavioral characteristics, such as confidence, caution, or skepticism. Furthermore, the evaluation relies on a relatively small set of prompts, which may limit the generalizability of the findings.
Questions for authors
Could the authors provide further justification for the design choices in the steering direction construction and provide more targeted ablation studies to demonstrate the necessity of individual components? In particular, why is it necessary to correct the local transport directions predicted by flow matching based on the empirical mean direction, given that flow matching is intended to learn transformations. Plus, could the authors clarify the necessity of introducing an additional calibration gain g alongside the response level magnitude estimator?
4 comments
Rebuttal 2
Projection and source nulling ablations
“Similarly, the necessity of displacement projection and source nulling is not thoroughly investigated.”
We added a controlled ablation and a direct activation-space analysis.
| Geometry | Anger | MTLD ↑ | Rep.-3 ↓ | Full pass ↑ |
|---|---|---|---|---|
| None | 3.966 | 42.28 | 18.83 | 84.67 |
| Projection only | 4.136 | 45.39 | 16.39 | 78.00 |
| Nulling only | 4.084 | 48.79 | 4.96 | 75.33 |
| Projection -> nulling | 4.221 | 51.38 | 3.83 | 84.67 |
-
Both operations contribute: Removing projection reduces MTLD by 2.59 and full pass by 9.34 points. Removing source nulling reduces MTLD by 5.99, increases repeated trigrams by 12.56 points, and reduces full pass by 6.67 points.
-
The operations impose different constraints: Projection restricts the token-wise consensus to the fitted response-displacement subspace, while source nulling removes components aligned with the fitted source-activation subspace.
To examine how each operation changes the constructed direction, we measure the fraction of its squared norm captured by the fitted displacement and source subspaces (“subspace energy”). High displacement energy indicates greater support from observed source-to-target transformations; low source energy indicates less residual alignment with source activations.
| Geometry | Displacement energy ↑ | Source energy ↓ |
|---|---|---|
| None | 51.35% | 31.77% |
| Projection only | 100.00% | 29.12% |
| Nulling only | 42.11% | 0.00% |
| Projection -> nulling | 82.74% | 0.00% |
-
The full sequence removes source alignment while retaining displacement support: Projection alone retains 29.12% source energy because the subspaces overlap, while nulling alone leaves only 42.11% displacement energy. Projection followed by nulling achieves zero source energy while retaining 82.74% displacement energy, exceeding nulling alone on all 75 prompts.
-
Either operation alone lowers full pass: Projection only retains source-aligned components, whereas nulling only removes overlapping components without first restricting the consensus to the behaviour-supported space. Normalization then applies the full response-level magnitude to these imbalanced directions, reducing full pass by 6.67–9.34 points.
-
“None” retains tasks through weaker, lower-quality steering: The unprocessed direction matches the complete method’s full-pass rate but achieves weaker anger, lower lexical diversity, and substantially more repetition. Its full-pass result therefore does not reproduce the complete method’s steering–quality balance.
-
The interaction is specific to token-wise construction: With a pooled-flow direction, adding projection before source nulling leaves MTLD and full pass essentially unchanged.
| Pooled-flow geometry | Anger | MTLD ↑ | Rep.-3 ↓ | Full pass ↑ |
|---|---|---|---|---|
| Nulling only | 4.263 | 39.45 | 8.26 | 83.33 |
| Projection + nulling | 4.377 | 39.43 | 8.44 | 83.33 |
This indicates that the favourable interaction arises within PATC’s token-wise direction construction rather than from applying the same operations to any flow displacement.
See Table 4 and Appendix C.5, Figure 3.
Why the main evaluation focuses on anger and anxiety
“Limited scope of experimental evaluation. The experimental evaluation is relatively narrow...”
We agree that behavioural breadth matters. We deliberately designed the main study around targets for which a well-posed comparison is possible: frozen evaluators validated on participant-held-out human text, approximate matching of achieved strength, and comparison against a complete human affect profile. These controls make differences between methods interpretable; expanding to many targets evaluated only by uncalibrated model judgments would increase label coverage without providing equally reliable evidence. Without validated measures to match achieved behavioural strength, comparisons on additional targets could simply reward stronger interventions rather than genuinely better trade-offs between steering quality and task preservation.
Rebuttal 3 (Evaluation now spans three models and 75 behavioural prompts)
Evaluation now spans three models and 75 behavioural prompts
“Furthermore, the evaluation relies on a relatively small set of prompts, which may limit the generalizability of the findings.”
-
Main evaluation expanded without changing its design: We added Llama-3-8B-Instruct and expanded the behavioural suite from 25 to 75 prompts while retaining the same frozen evaluation protocol. The submitted 25-prompt suite was already balanced across opinion, planning, advice, narrative, and reflection, although this structure and its rationale were not sufficiently clear in the original description. The expanded suite preserves that design, increasing coverage from five to 15 prompts per response type. These types test distinct generation demands: defending a position, organizing actions, giving recommendations, maintaining narrative coherence, and developing an introspective explanation.
-
Results persist across response types: Across the resulting 24 model–target–strength blocks, PATC ranks first or second in 19/24 MTLD and 20/24 repetition comparisons. When stratified by response type, PATC ranks first or second in MTLD for all five types and has the lowest repetition in four of five; TruthFlow leads on narrative.
-
Broader behavioural and task coverage: Together with the 50-prompt strict suite, the evaluation now covers three model families and 125 prompts spanning both behavioural expression and task preservation. The complete prompts are provided in the Experimental Prompt Suites appendix.
We hope the additional ablations, expanded three-model and 75-prompt evaluation, and methodological clarifications address your concerns. If so, we would be grateful if you could update your rating to reflect the revised evidence. If any concern remains unresolved, we would greatly appreciate your guidance on which point requires further clarification.
We hope we addressed your concerns
Dear Reviewer,
We hope the expanded three-model and 75-prompt evaluation, additional-behaviour audit, and new component ablations resolve the concerns raised in your review. If these additions address your reservations, we would be grateful if you would reconsider your rating. If anything remains unresolved, we would appreciate knowing which concern requires further evidence or clarification.
Thank you!
Rebuttal 1
Thank you for your thorough review and the interesting questions and concerns raised! We think they have made the paper clearer and we hope we've addressed your concerns below.
Clarifying role of empirical mean direction
Thank you for raising this point. We clarify two aspects of the construction:
The mean does not determine the local displacement. Each displacement is independently predicted by the token flow: δi=Φτtok(hi)−hi.
The mean provides a behavioural reference for aggregation. Alignment with the empirical target-minus-source direction is used only to select and weight the local transports most relevant to the target behaviour. The selected vectors are not projected onto the mean, so their prompt-specific components are retained.
We have revised the method description to distinguish mean-referenced token selection from the independently predicted local transports of individual components.
Question about importance of gain parameter
Experimental scope: Added Confidence and Skepticism
We added a two-model audit on confidence and skepticism
Additional targets and models: We trained target-specific PATC flows for both Gemma-3-12B and Qwen3-14B and compared them with the corresponding unsteered model on all 25 behavioural prompts.
Evaluation breadth: The prompts span opinion, planning, advice, narrative, and reflection. Three fresh blinded judging passes independently randomized A/B placement; we report per-prompt majority decisions.
Interpretation: Confidence transfers particularly clearly to Qwen, where PATC is preferred on all 25 prompts. Skepticism is strong on Gemma and directionally positive but less certain on Qwen. The reported outputs remain fluent and complete.
Qualitative corroboration: Appendix G includes a Qwen confidence example and two Gemma skepticism examples unanimously preferred by all three judging passes.
Scope of this audit: We present these results as preliminary evidence of transfer, not as a full benchmark against other steering methods. Unlike anger and anxiety, confidence and skepticism lack the human-validated evaluators required to match methods at comparable achieved strength. A broader comparison based only on model judgments could therefore confound steering quality with differences in steering intensity.
See Appendix G, Table 19 and the accompanying examples.