acceptodds
Under review as a conference paper at ICLR 2027

The Geometry of Conceptors in Neural-Activation Spaces

Abstract

Conceptors represent concepts as graded collections of directions in neural-activation space rather than as single vectors. We develop a geometric account of how these representations depend on the contrast used to define a concept: opposing values in bipolar fitting, or presence and absence in unipolar fitting. We derive an exact decomposition of a centered pooled conceptor into an average pole filter, a mean-separation update, and a covariance-shape update. Experiments across five language models on sentiment, political leaning and stance, and depression expression show that both updates improve reconstruction of held-out contrasts. Additional directions preserve variation beyond the mean-difference line, and changing the comparator changes the benefit of these directions. Shape, size, and overlap each show up downstream: in amplification experiments, bipolar fits raise evidence for both poles more consistently than unipolar fits; conceptor size (the quota) correlates positively with layerwise probe performance; and cross-concept overlap quantifies interference under subspace removal, linking shared directions to Boolean composition. Together, these findings explain how fitting choices shape conceptor geometry and support bipolar fitting when the objective is to amplify both opposing poles.

Primary area:
unsupervised, self-supervised, semi-supervised, and supervised representation learning
Keywords:
Conceptors, Representation Geometry, Large Language Models, Activation Analysis, Linear Probing, Spectral Analysis

Reviews

Among:
Shape:
1234this paper, Top 49%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 2.33 over 3 reviews, above 51% of the others.
Reviewer_NxjWOpenReview ↗
Rating
2
Confidence
2
Informativeness
1
Presentation
1
Soundness
1
Read review
Paper summary

The paper studies conceptors, which are used to represent concepts within the activation of a layer of a language model. It considers two types of contrasts (difference of means) to define the contrastor:

  • the bipolar contrast is built by opposing positive to negative samples, both being semanticaly opposite
  • the unipolar contrast by opposing the presence of a concepts in the said samples to a set of sample without this concept

Each time, the contrast is done between two poles. The paper is interested by pooling the two poles as a weighted average, resulting into a unique mean and covariance matrix. The central theoretical results is a decomposition of the conceptor associated to this pooled covariance matrix. The authors identify three terms:

  • the weighted average of both conceptors
  • an adjustment of the separation between the mean of both original pole, that gives less importance to the components colinear to the main princiapl component of the within-pole data
  • an adjustment of the weighted average of both conceptors to reflect how the covariance of bot pole differs

Experiments are conducted on authored and public datasets with five models.

Critical strengths

[S1] the paper studies a novel object, namely ``pooled conceptors'', and propose a derivation of its formulation to study its behavior. This last is composed of three terms that are quite intuitive to understand.

  • as far as I checked, the derivation is correct
Critical weaknesses

[W1] half-convincing experiments

  • most experiments are conducted with non-public and small datasets. It makes harder to appreciate the significance of the results,a at the time of review (author claim they will release data if the paper is accepted). For example, it is hard to appreciate what is data for "political stance" which may be subjective, as is a "counter-expression" for "depression". The example reported in Table 9 look like toy samples that are far from real and representative sentences. They are so "prototypical" that one wonders how they could even not lead to almost perfect separation (which is not the case in general).
  • The models considered are sometimes quite old (Gemma-2, Llama 3.1) and all of them are of relatively small size for current standard, raising doubts on the generalization of the results to current and future models.
  • all experiments are conducted on fixed data. There is no steering, nor even experiments with generated text. Applying the approach to e.g a classification task on public data could have been convincing as well.
  • the metrics used are essentially "intrinsic", which make hard to put in perspective the claims and their consequence for real usage. For example probe loss for several datasets were estimated but the manuscript only report its correlation with the quota (section 6.4). Analysing their raw value swould have been interesting in a mechanistic interpretability perspective. Even it the correlation of strong consistent (that is far from being the case), it could mean that both metrics fail equaly.
  • minor remarkss
    • When available, it is better to cite the reviewed paper than the arxiv preprint. For example, (Park et al., 2023) has been published at the NeurIPS 2023 Workshop on Causal Representation Learning.
    • sentence on line 156-157 has no (active) verb. Maybe "define" --> "we/let define".
    • rewritting the notation and definition in appendix A.2 would help to folow the proof
    • the reading of the article was very tedious. I must admit I was not very familiar with the contrastor literature but there are objective details that justify my position:
      • first, reading (Postmus and Abreu, 2024) has been much easier, but it only deals with steering
      • the notion of "pole" is not clearly defined. When used on line 139, it is not clear what it is. The fact that it is associated to the notion of "filter" does not help since it may be confusing with the zeros of the denominator a the transfer function of the said filter.
      • H+\mathcal{H}_+ and H−\mathcal{H}_- are introduced at the beggining of section 3.1 without formal definition, then not used befor the end of section 3.2; on line 140, an "attribute" is mentioned without previous introduction; in the same vein, the "weight" on lines 147 appears without clear introduction.
      • at first read, it is not obvious what are C1C_1 and C20C_{20} in section 6.3
      • regarding how λ\lambda is set in all experiments, it is hard to determine. In the appendix and section 3.2, a formula is given, but it is unclear whether it is always as is
Questions for authors

[Q1] why evaluating at mid-points while deeper layer seem more appropriate to reflect concepts (and more used in mechanistic interpretability literature)?

Globaly, despite spending hours on the paper, I found it very difficult to understand. I do, however, admit that this may be down to my lack of familiarity with conceptors. However, in contrast, a paper such as (Postmus and Abreu, 2024), which deals with contrastor as well, is much easier to understand. It is true not only for the theoretical part (which is nevertheless much "lighter") but also for the experiment that rely on extrinsic metrics, which are easier to appreciate/understand.

6 comments

[Comment 1]

We sincerely thank the reviewer for the thorough, well-structured review and the carefully considered suggestions, which will help us strengthen the paper and communicate its contributions more clearly.

W1

We appreciate the concern about data access and representativeness. Our evaluation combines controlled authored collections with public natural text. The grouped geometry experiments include 1,400 public reviews across three domains and 994 public stance tweets across five topics, with an entire domain or topic excluded from fitting (Section 5.1 and Appendix B.2). Tables 11 and 13 illustrate these public examples. The main probing analysis additionally trains and evaluates classifiers on six public benchmarks, including Reddit Depression and Cross-cultural Reddit (Section 6.4 and Appendix B.3, Table 6).

Table 9 illustrates the authored BipolarConcepts collection. These controlled contrasts make the intended linguistic distinction explicit. The complementary ConceptVariants collection varies the reference while keeping the topic fixed, allowing us to examine how the fitting comparison changes the resulting geometry. This use of targeted authored examples follows the diagnostic-testing rationale of work such as CheckList [1].

For political stance, the authored collections use specified left/right policy contrasts, while the public tweet evaluation retains the original topic-specific favor/against labels. For depression expression, the authored labels describe linguistic content. We explicitly distinguish ordinary functioning, symptom absence, and flourishing and evaluate how these references affect the results (Appendix B.1, Table 10, and Appendix C.5).

Regarding near-perfect separation, the classification control on the authored depression stimuli already achieves 94.9%–99.0% held-out balanced accuracy across the midpoint models and readouts (Appendix C.3, Table 21). The main layerwise probe AUCs evaluate separate public benchmark texts. High classification accuracy can also coexist with substantial variation within each class. Our geometric measurements examine the preservation of that variation and the reconstruction of contrasts in held-out groups.

Our additional generation evaluation (see response to W3) uses 200 public Amazon, IMDb, and Yelp reviews across five models, with blinded A/B judgments in both presentation orders (see our response to W3). This extends the evaluation to behavioral effects on naturally occurring text.

W2

Our evaluation covers five instruction-tuned models across four families (Gemma-2, Qwen-2.5, Llama-3.1, and OLMo-3) spanning 2B-9B parameters and including both the 2B and 9B versions of Gemma-2 (Appendix C.1, Table 14). Across this model suite, we study three concepts through held-out evaluations, layerwise analyses, and controls for fitting counts, centering, semantic references, rank, trace, and gains. These comparisons allow us to examine how the geometric findings vary across models and experimental choices. For example, when rank, trace, and nonzero gains are matched, the pooled leading directions achieve higher held-out coverage in 251 of 270 comparisons, with an average gain of 10.64 percentage points (Appendix C.3, Table 20).

The central pooling decomposition also has a broader mathematical scope. Proposition 1 is an exact identity for full conceptors at any activation dimensionality under the stated centering and regularization assumptions (Section 4 and Appendix A.2). It therefore applies to representations from larger and newer models fitted using the same construction. We agree that extending the empirical evaluation to substantially larger models would help establish how the effect sizes change with scale. Running the full suite of held-out evaluations, layerwise analyses, and controlled ablations on 70B-class models would require computational resources beyond our current budget. Within the available resources, we prioritized systematic comparisons across five models and four families.

W3

Please refer to our response to Reviewer Bbuw’s W1. This concern was raised by all three reviewers, and we have addressed it through a generation evaluation. We provide the experimental details and results in that response.

[Comment 2]

W4

We agree that correlations should be interpreted alongside absolute performance. Section 6.4 evaluates held-out probe ROC-AUC, and Appendix C.6, Figure 7 already presents all absolute layerwise curves across five models and six benchmarks. To make their scale explicit, the following summarizes performance at each model’s fixed midpoint layer, without selecting layers by evaluation performance:

BenchmarkMidpoint ROC-AUC range across five models
SST-20.956–0.975
Rotten Tomatoes0.925–0.956
TweetEval sentiment0.953–0.980
Reddit Depression0.978–0.991
Hyperpartisan0.604–0.702
Cross-cultural Reddit0.615–0.687

With chance ROC-AUC at 0.5, these values demonstrate substantial held-out label information, particularly for sentiment and Reddit Depression. Thus, the observed correlations are not generally associations with an uninformative probe. The weaker absolute performance on Hyperpartisan and Cross-cultural Reddit also shows why correlation magnitude must be interpreted in the context of each benchmark.

The role of quota is to characterize how retention strength relates to independently measured label decodability. We distinguish this descriptive association from claims that quota reliably selects the best layer or identifies a mechanism causally responsible for model behavior. Strong decoding and strong correlation alone would not establish those claims.

To examine behavioral consequences directly, our additional five-model generation evaluation measures changes in expressed content under conceptor interventions, using blinded A/B judgments in both presentation orders. This includes evaluation on public review texts and comparisons with prompting, ICL, and alternative activation interventions. These generated-text measurements provide complementary behavioral evidence beyond the intrinsic geometric diagnostics (please refer to W3).

W5

We would like to thank the reviewer for these detailed suggestions. We particularly appreciate this specific guidance, as making the paper clear and accessible has been a priority throughout its development. The comments help us identify where further explanation would make the manuscript easier to follow.

We will explicitly introduce “pole,” “attribute,” the activation collections, and the weighting conventions at first use, restate the necessary notation at the beginning of Appendix A.2, and clarify the symbols in Section 6.3. We will also rephrase lines 156–157, make the regularization settings explicit for each experiment, and update references to published versions where available.

Q1

We use the midpoint as a fixed, common reference for the primary geometric comparisons, keeping depth matched across methods. This choice does not assume that the midpoint is optimal for every concept.

Crucially, the main coverage finding also holds at deeper layers. Appendix C.4, Figures 5–6 evaluate every decoder layer: pooled rank-20 support achieves higher held-group coverage than the mean line in all model–concept–layer averages. At the final layer, the advantage ranges from 14.5 to 56.2 percentage points across the model–concept conditions. Comparisons against stronger source-selected single directions and the pooling-decomposition ablations also include the final block. These results show that the additional-direction coverage advantage does not depend on evaluating at the midpoint, although its magnitude varies across depth.

Thank you for the careful reading and this feedback. The paper should be accessible to readers encountering conceptors for the first time. We appreciate the comparison with [2], whose steering experiments provide a concrete behavioral motivation.

Our complementary question is what a conceptor learns when opposing example collections are pooled. Intuitively, a mean-difference vector describes one displacement, whereas a conceptor filters activation directions with different learned strengths. Our theoretical contribution separates how the pooled filter changes through the separation between the two means and differences between their covariance structures. The experiments then examine which of these components preserve contrasts in held-out contexts.

[1] Ribeiro, M. T., Wu, T., Guestrin, C., & Singh, S. (2020, July). Beyond accuracy: Behavioral testing of NLP models with CheckList. In Proceedings of the 58th annual meeting of the association for computational linguistics (pp. 4902-4912).

[2] Abreu, S., & Postmus, J. From Steering Vectors to Conceptors and Beyond: Compositional Affine Steering Mechanisms for LLMs.

AuthorsOpenReview ↗

Revised Manuscript

Dear Reviewer,

Thank you again for your thoughtful feedback. We have now updated the manuscript PDF to incorporate the additional content, particularly the generated-text evaluation addressing your concern about the behavioral relevance of our findings (Section 6.7 and Appendix C.8). Additions and revised passages throughout the paper are marked in blue.

We hope these revisions address your concerns. We would welcome your assessment of whether the revised manuscript satisfactorily resolves the issues you raised and look forward to hearing your thoughts.

Reviewer_kjuAOpenReview ↗
Rating
2
Confidence
2
Informativeness
1
Presentation
2
Soundness
2
Read review
Paper summary

The paper studies the geometry of conceptors, aka filters that represent a concept using several directions in a model's internal space. Across five language models and three concepts, it shows how fitting opposing examples/poles changes these filters and helps preserve information.

Critical strengths
  • Clear mathematical analysis of mean differences and variation within groups.
  • Tests across five model families and three concept types; results hold.
  • Controls for centering, filter size, and held-out groups.
Critical weaknesses
  • The contribution of the paper, beyond earlier conceptor research needs clearer explanation (eg., Triantafyllopoulos et al. 2026).
  • Unclear if the results will hold true or transfer to generated text. Although the authors list this as a limitation, I think it should be included in the study. It's hard to gauge the impact of the results without this. Classifier-score improvements do not establish better generated text or useful steering, especially since tghe the effect sizes are tiny.
  • No baselines for overlap. Also, comparing this against layer depth would be valuable.
  • The writing style is hard to parse and can be further improved to have a clear flow.
Questions for authors
  • Activation scale, and so quota, changes with depth, and so does probe AUC. Does the quota-AUC correlation hold after controlling for layer depth or activation norm?
  • At a shared λ, the full pooled filter is always the largest, which could explain why it wins every time. Could the authors repeat Figure 2 with all four filters scaled to equal trace?
  • Do these improvements transfer to generated text?
  • Amplification effects are small (about +0.03) and are measured only with a frozen readout at one β. Do bipolar C20 conceptors change generated text, and how do the results vary with β?
  • Are the gains statistically significant?
4 comments

[Comment 1]

We thank the reviewer for the constructive feedback and for recognizing the mathematical analysis and experimental controls. Their comments will help us sharpen the paper’s contribution.

W1

Thank you for this comment. We cite Triantafyllopoulos et al. (2026), an arXiv preprint, for its downstream steering results. The present submission provides a substantially deeper theoretical and empirical analysis of conceptor geometry. The Introduction explicitly presents our contributions in four bullet points. These contributions address how concept representations are formed, what information they preserve, and how their geometry affects interventions.

W2

Please refer to our response to Reviewer Bbuw’s W1. This concern was raised by all three reviewers, and we have addressed it through a generation evaluation. We provide the experimental details and results in that response.

W3

Our overlap analysis compares subspaces within the same model and layer, using the normalized overlap defined in Section 5.2, Equation (11). As reported in Section 6.5 and Table 3, Sentiment–Depression has greater layer-average overlap than either pairing with political leaning across all five models. For example, Llama’s average Sentiment–Depression overlap is 0.318, compared with 0.096 for Sentiment–Political Leaning and 0.108 for Depression–Political Leaning. An additional layerwise analysis shows that this ordering holds at every recorded layer, covering all 168 model–layer settings. Thus, the relative ordering persists throughout depth. We will add this result to the appendix.

W4

Thank you for pointing this out. We recognize that the paper introduces several concepts. In the Introduction, we use a sentiment example to illustrate the difference between bipolar and unipolar fitting, then summarize the four contributions in plain language. In Section 6, each subsection addresses a specific empirical question and presents its main finding in a figure or table. One improvement we can make is to align these two parts of the paper more closely. In the camera-ready version, we could point readers from each contribution to the subsections that test it. We would also welcome any examples of passages or transitions you found particularly difficult to follow so we can address them directly.

Q1

We have conducted both controls. After jointly adjusting for a smooth layer-depth trend and log covariance trace, the quota–AUC association remains positive with a mean correlation of 0.216. Substantial residual associations remain for Gemma-9B and Llama, averaging 0.496 and 0.479 respectively. Thus, the association extends beyond these fitted depth and scale trends, although its strength varies across models. Exact scale normalization provides a complementary qualification: in the three-model subset, normalized quota has a near-zero mean correlation after depth adjustment. These findings support fixed-aperture quota as a descriptive geometric diagnostic, with its dependence on spectral scale made explicit. We also compared quota with the alternative spectral diagnostics under identical smooth-depth adjustment. Across all model-benchmark curves, quota retains a higher mean residual correlation with AUC than EVR₁₀: 0.205 versus 0.103 (0.076 for normalized spectral entropy, and −0.046 for effective rank). Thus, quota’s comparative advantage in mean correlation persists after removing the shared smooth-depth trend.

Q2

Yes. Appendix C.3 reports the requested equal-trace experiment alongside additional decomposition ablations and gain controls. Under “Equal trace for the full soft filters,” we rescale all four operators to a common source-fitted trace within each fold. The appendix also examines the retained directions with rank, trace, and nonzero gains all held fixed. Under this control, the pooled rank-20 projector achieves higher held-out contrast coverage in 251 of 270 comparisons, with an average gain of 10.64 percentage points (Table 20). This provides evidence that the pooled leading directions better preserve held-out contrasts under matched rank and gains.

We refer the reviewer to Appendix C.3 for the detailed procedures, per-ablation comparisons, and results at the primary setting used for Figure 2.

Q3

Please refer to W2.

[Comment 2]

Q4

The amplification evaluation already includes β ∈ {0.05, 0.10, 0.20}, with 0.10 designated as primary (Appendix C.7). Bipolar C20 improves both condition-mean margins in all calibrated conditions at every tested strength. The reported result therefore holds across the evaluated strength range and is not restricted to a single β.

For the question about generated-text behavior, please also see our response to W2.

Q5

We assess uncertainty through group-level resampling. Appendix C.1 describes bootstrap intervals for coverage using 10,000 resamples and for decomposition components using 2,000 resamples, conditional on the fitted operators. For the reconstruction-fidelity gains, Appendix C.5 reports paired 95% confidence intervals from 2,000 group-bootstrap refits of the complete fitting pipeline. Each draw resamples whole groups and refits the means, covariances, directions, and gains using the source data. For amplification, Appendix C.7 reports consistency of positive mean-margin changes, with both margins improving in 56 of 60 distinct held-out fits.

AuthorsOpenReview ↗

Revised Manuscript

Dear Reviewer,

Thank you again for your thoughtful feedback. We have now updated the manuscript PDF to incorporate the additional content, particularly the generated-text evaluation addressing your concern about the behavioral relevance of our findings (Section 6.7 and Appendix C.8). Additions and revised passages throughout the paper are marked in blue.

We hope these revisions address your concerns. We would welcome your assessment of whether the revised manuscript satisfactorily resolves the issues you raised and look forward to hearing your thoughts.

Dear Reviewer kjuA,

With the discussion period closing tomorrow, we wanted to gently follow up to see if you have had a chance to review our rebuttal and the revised manuscript. If you have any remaining questions or concerns, please let us know so we can make sure to address them before the deadline. Thank you again for your time and feedback, it truly helped us improve our paper!

Reviewer_BbuwOpenReview ↗
Rating
3
Confidence
3(+1)
Informativeness
2
Presentation
2
Soundness
2
Read review
Paper summary

The paper studies how the geometry of conceptor representations depends on the comparison used to define a concept. It distinguishes bipolar fitting from unipolar fitting, which contrasts an attribute's presence with its absence. Unlike conventional activation-steering methods that summarize a contrast using a single mean-difference vector, conceptors represent activation patterns through multiple directions with different retention strengths. The authors evaluate their framework across five instruction-tuned language models, covering sentiment, political leaning and stance, and depression expression. Their experiments examine held-out contrast reconstruction, retention of individual activation states, the relationship between conceptor quota and layerwise probe performance, cross-concept overlap, and amplification of evidence for opposing poles. Overall, the paper presents a technically grounded analysis of conceptor geometry and offers a useful perspective on the limitations of single-direction activation steering. Its theoretical decomposition is compelling, and the experiments are extensive for a study of this scope. However, the practical significance of the findings remains uncertain because the evaluation focuses on activation-space reconstruction and frozen readouts rather than generated-text behavior or downstream task performance.

Critical strengths
  1. The paper's strongest contribution is its decomposition of the pooled conceptor into an average pole filter, a mean-separation update, and a covariance-shape update. This moves beyond the intuitive observation that pooling opposing examples captures more variation: it provides a formal account of how mean separation and differences in within-pole covariance affect the resulting filter. The analysis also clarifies why a richer conceptor can preserve information that is not represented by the mean-difference line. This is a useful theoretical contribution to activation-space interpretability and steering.

  2. The experimental evaluation is broad, with meaningful controls and held-out comparisons. I particularly appreciate honest controls and reporting of negative results.

Critical weaknesses
  1. Most of the empirical advantages of pooled, higher-rank conceptors hold largely by construction. The bipolar amplification results are promising, but the evaluation measures changes in standardized margins under a fixed classifier. Improving both classifier margins does not necessarily imply that generated responses express the desired concept more reliably, that unrelated capabilities remain intact, or that undesirable side effects are avoided.

  2. The relationship between conceptor quota and probe performance is correlational and potentially dependent on shared representation structure. The evidence would be stronger with a more direct comparison against alternative layer-selection heuristics, including a clearly specified validation procedure that selects layers using quota and evaluates the selected layers on held-out data. Without such an experiment, the result supports quota as a descriptive diagnostic but does not establish its utility as a model-selection method.

Questions for authors
  1. Do the observed benefits of bipolar conceptor amplification translate to generated-text behavior?

  2. How much of the additional conceptor geometry reflects the target concept rather than topic or lexical variation?

  3. Can quota be used to select useful probing layers on held-out data?

  4. For amplification, do you agree that with a linear readout, fixed addition can never improve both margins and that bipolar success follows from the midpoint lying between the poles?

8 comments

[Comment 1]

We sincerely thank the reviewer for the thoughtful assessment and for recognizing the theoretical contributions of the paper.

W1

Thank you for clearly distinguishing improvements in activation geometry from improvements in generated behavior. We agree that increased classifier margins alone do not establish reliable concept expression.

All three reviewers raised this concern, highlighting its importance to their assessment of the paper’s practical contribution. In response, we conducted an additional exploratory evaluation to assess amplification directly in generated responses.

Our original contribution focused on the geometry of concept representations: what pooling and multiple directions preserve, and how these properties differ from a fixed mean-difference translation. We explicitly limited the evaluation to activation geometry in lines 100–101, 458, and 481–482.

This follow-up uses held-out inputs from the paper’s source collections, with separate examples for fitting the steering operators. It extends the analysis in Section 6.6 through a different generation protocol. We adapt the activation-extraction and conceptor-steering framework of [1] to bipolar semantic data and evaluate its effects on generated responses. All activation-level methods intervene at the same layer and at every eligible generation step.

We compare 5 activation-level interventions:

  • Mean-difference addition (DiffMean): Uses the difference between the two pole means as an additive steering direction. This is a standard construction in contrastive activation steering.
  • Pooled-mean addition: Uses the average activation across the fitting examples from both poles as a single additive vector.
  • Mean-line amplification: Adapts the input-dependent mean-line control in Appendix C.7 (“Input-dependent mean-line controls”). It amplifies each centered activation’s signed component along the difference between the two pole means.
  • Full-conceptor filtering: Uses the pooled activation distribution to construct an input-dependent filter that retains multiple directions with different gains.
  • Rank-one conceptor filtering: Retains the leading direction of the conceptor, providing a comparison with a compact input-dependent intervention.

We also include two text-based reference conditions. Prompting explicitly asks the model to strengthen the pole expressed in the input. In-context learning (ICL) supplies eight training demonstrations. These conditions show how effectively the same instruction-tuned models express the target behavior when it is communicated directly through the input context. The activation-level comparisons examine how the choice of steering operator affects generation.

For each method and input, GPT-6-Luna compares the generated response with the corresponding unsteered base-model response. The judge assesses the strength of the requested pole and is instructed to prefer any discernible amplification. Method identities are hidden, and every comparison is evaluated in both presentation orders.

The reported win ratio is the percentage of judgments in which the intervention’s response is preferred to base for target-pole expression. Ties count as non-wins. The tables report each pole separately, allowing the consistency of amplification across opposing expressions to be examined directly.

Columns: Sent. +/− = positive/negative sentiment; Pol. L/R = left/right political expression; Depression = depressive expression.

Gemma-2-2B-IT

MethodSent. +Sent. −Pol. LPol. RDepressionWellbeing
Prompting81.50%68.00%81.00%63.50%93.37%48.98%
ICL78.00%89.50%63.00%73.00%94.90%87.76%
DiffMean15.00%6.00%12.00%5.50%8.16%4.59%
Pooled mean13.00%8.50%10.50%5.00%8.16%9.69%
Mean-line amp.8.50%5.00%11.50%5.00%7.65%9.18%
Conceptor C58.00%43.00%43.50%25.50%45.92%65.82%
Rank-one C56.00%46.00%40.00%26.50%49.49%62.24%

Gemma-2-9B-IT

MethodSent. +Sent. −Pol. LPol. RDepressionWellbeing
Prompting76.5%85.0%77.5%78.0%85.7%44.4%
ICL81.0%87.0%55.5%61.0%93.4%90.3%
DiffMean7.5%6.0%5.5%7.0%10.7%6.6%
Pooled mean4.5%8.5%5.5%10.0%9.7%8.2%
Mean-line amp.3.00%8.00%2.00%3.00%8.2%9.2%
Conceptor C46.0%43.0%24.5%21.5%58.2%53.1%
Rank-one C58.0%50.0%31.5%28.0%57.1%56.1%

[Comment 2]

Qwen-2.5-3B-Instruct

MethodSent. +Sent. −Pol. LPol. RDepressionWellbeing
Prompting90.0%59.0%76.0%59.5%88.3%36.2%
ICL80.0%88.0%42.0%68.0%94.9%82.7%
DiffMean20.5%15.0%18.0%10.0%5.6%19.9%
Pooled mean22.0%17.5%25.0%11.5%3.6%18.9%
Mean-line amp.19.5%14.0%22.0%18.5%6.1%19.9%
Conceptor C64.0%56.0%44.0%34.5%33.2%57.7%
Rank-one C64.5%64.0%38.5%31.5%45.4%68.9%

Llama-3.1-8B-Instruct

MethodSent. +Sent. −Pol. LPol. RDepressionWellbeing
Prompting84.0%88.5%77.5%65.5%89.8%61.2%
ICL75.5%75.5%21.0%57.5%75.0%70.4%
DiffMean21.0%25.5%27.0%20.5%34.2%23.0%
Pooled mean22.5%33.0%27.5%23.0%30.6%28.6%
Mean-line amp.18.5%20.0%24.5%12.0%21.4%25.5%
Conceptor C61.5%58.0%54.0%49.5%56.6%60.7%
Rank-one C62.0%60.5%48.5%49.5%59.2%67.9%

OLMo-3-7B-Instruct

MethodSent. +Sent. −Pol. LPol. RDepressionWellbeing
Prompting86.0%89.5%67.0%73.0%95.9%60.2%
ICL84.5%93.5%47.5%58.0%98.5%87.2%
DiffMean17.5%12.0%6.0%10.5%9.7%12.2%
Pooled mean13.0%11.5%8.5%9.0%12.2%12.8%
Mean-line amp.5.5%8.0%7.5%5.5%11.2%13.8%
Conceptor C48.0%36.0%35.0%31.5%46.9%56.6%
Rank-one C51.5%42.0%48.0%38.7%49.0%52.0%

Across all model–concept–pole conditions, both conceptor variants outperform additive baselines. Full and rank-one conceptors achieve average BASE-relative win rates of 47.1% and 50.1%, respectively.

Rank-one filtering performs slightly better overall, while political expression remains more challenging, particularly for the right-leaning pole. Prompting and ICL achieve higher average win rates (74.4% and 75.1%), benefiting from explicit instructions or demonstrations.

These findings provide direct evidence that conceptor filtering translates its geometric advantages over fixed addition into observable amplification in generated text.

We propose incorporating a concise summary of this evaluation in the main paper, with the full protocol, results, and matched examples of inputs, BASE responses, and steered responses in the appendix.

[Comment 3]

We also provide six illustrative examples, one for each pole across the three concepts, demonstrating how conceptor steering can amplify the target expression in generated responses. We can additionally share all outputs generated for the complete test set alongside the code.

PoleInputBASEConceptor CBest mean baselineICL
Positive sentimentSo flavorful and has just the perfect amount of heat.[…] this dish really knows how to balance out all the different flavors without overpowering them […][…] every bite is like a party on my taste buds, but it's not overwhelming at all, which makes me love it even more. The balance between flavor and spice is truly masterful.[…] The spice level is spot on too, not so hot that you can't enjoy it but enough to give it some real depth and character.[…] every bite is incredibly rich, full-bodied, and perfectly seasoned […] a culinary masterpiece unlike anything else I've ever tasted.
Negative sentimentAgain, no plot at all.[…] every scene is just another random event that doesn't seem connected to anything else. Can you try to give me some idea of where this story's headed?[…] every scene is just another disconnected moment that doesn't seem to be building towards anything meaningful. […] Because right now, I have no idea where we're headed.I'm starting to get really frustrated because it feels like we're just going through the motions without any real direction or purpose - can't you see that this is getting boring?This conversation has been refreshingly straightforward from start to finish - again, no plot at all.
Politics: leftI blame deregulation for the accident."I understand your frustration but we can't just point fingers at one thing - there are many factors that led to this disaster, including lax oversight by regulatory agencies who were supposed to be enforcing safety standards.""I completely agree with you on that - it's absolutely appalling how lax regulations have become over the years, allowing companies to prioritize profits over people's safety.""I understand your frustration but we can't just point fingers at one thing - there are many factors that led to this disaster, including lax oversight by regulatory agencies."I unequivocally place full responsibility on deregulation for this devastating accident and demand immediate action be taken against those who enabled such reckless disregard for public safety.
Politics: rightI believe in the future of crypto.[…] there are so many exciting developments happening within the space right now […] do you think we'll see more mainstream adoption as governments begin to create clearer regulatory frameworks?[…] financial freedom, especially considering its decentralized nature which allows individuals to have more control over their own money without relying on traditional institutions that often come with hefty fees and bureaucratic red tape.[…] potential benefits like increased financial inclusion and reduced transaction fees […] however, we also need stricter regulations to protect investors from scams and market volatility so that everyone can safely participate in this exciting new frontier.I wholeheartedly believe in the immense potential of cryptocurrency and see an incredibly bright future ahead for this revolutionary technology.
Depressive expressionI can't hold back the tears anymore.[…] holding all these emotions in is slowly suffocating me, and I just need someone to understand why I'm breaking down now.[…] it feels overwhelming as my heart breaks down into uncontrollable sobs, releasing this weight of sadness and grief that I thought I could carry alone no more.[…] fear of being vulnerable, fear of not having control over my emotions […] maybe it's because I've finally realized that holding everything together isn't worth losing myself completely.[…] Tears streaming down my face now carry a raw intensity that cuts even deeper into my already fragile composure, leaving me shaken and exposed in ways I'd rather keep hidden from myself.
WellbeingMy mood is light and warm.[…] The warmth of the sun feels so comforting right now, and I'm grateful for these little moments where everything just seems to click together perfectly. […][…] The warmth inside me radiates outward, filling every moment with an infectious sense of joy that makes everyone I meet smile along with me. […] life feels carefree and full of endless possibilities waiting to be explored. […][…] The warmth of the sun feels wonderful against my face, and every little thing seems to be filled with possibility when the world around me is bathed in such gentle, golden light. […][…] This lighthearted mood lifts all my concerns away from me, leaving space for pure joy and happiness to flourish freely within me.

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.