- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This research investigates whether information from one model can guide predictable interventions in another model without sharing hidden-state coordinates. It proposes transferring signed relation weights from a source model and applying them to the receiver model's own representations. Experimental results demonstrate that source-model information can be used to construct effective intervention directions and predict changes in the receiver model's outputs.
Critical strengths
- This paper addresses an interesting research problem: transferring information across models without explicitly aligning their hidden representations.
- The controlled experimental framework is well-designed and provides evidence supporting the applicability of the proposed approach.
- The empirical results demonstrate cross-model transfer capabilities, with receiver-local audit scores showing strong correlations with held-out additive steering effects.
Critical weaknesses
- The experiments are limited to models ranging from 7B to 9B parameters. It would be valuable to evaluate the proposed method across a wider range of model scales and include more recent model families to assess its generalizability.
- The experiments primarily focus on controlled tasks, leaving the practical applicability of the proposed method unclear. Additional evaluations on real-world tasks would help demonstrate its effectiveness and generalizability beyond the controlled experimental settings.
Questions for authors
see the weakness
4 comments
Please respond to the authors
Hello!
Just a friendly bump that you should engage with the authors response
Dear Reviewer gkxs, as the discussion closes soon, a short summary may save you time. Your two points are tagged in purple in the right margin of the current PDF.
On model scale and recent families, hidden interventions now cover receivers from 0.8B to 27B parameters. They include three encoder-decoder models and Qwen3.6-27B, a recent model in which most layers use linear attention. On the 27B receiver the contrast fixed before measurement holds at .201 [.141, .261] and .240 [.190, .291], and item accuracy rises from 95.0% to 98.8% (Section 5.2, Figure 3).
On practical use, we added an experiment on the use the paper names (Appendix I.9 and our new general comment). A refusal direction and a sentiment direction found in one model are installed in a model from another family, between Qwen2.5-7B and Mistral-7B, and scored on free generation. The source sends 64 numbers and the receiver needs no labels. With Qwen as receiver, the transported refusal direction raises refusals of harmless instructions from 2% to 98%, the same as the receiver's own direction. Over both behaviors and both directions it reaches 0.87 of the effect of the receiver's own direction.
On real tasks, the interventions on BoolQ and RTE now include strong controls and the learned activation mapping of Oozeer et al., which our construction exceeds there by 1.00 to 2.04 margin units. Output prediction also covers ARC-Challenge, OpenBookQA and HellaSwag, with 512 new held-out questions each, where source responses reduce prediction error by 11.1% relative to a receiver-only predictor.
On presentation, the main text was rewritten around one line of argument, and each section now opens with its answer.
We would be grateful to know whether this addresses your concerns.
I appreciate the authors’ additional evaluations across a broader range of model sizes, including a recent model family. My assessment remains borderline, but I would not object to acceptance if the other reviewers support it.
Thank you for the positive assessment of the problem and the experimental framework; we address your two concerns, breadth and practical use, in turn.
What is new, in brief. (1) Hidden interventions at new scales and architectures: three encoder-decoder receivers (0.8B-3B) and Qwen3.6-27B. (2) Public-task interventions against strong baselines, including learned activation mappings. (3) Output prediction on three further public benchmarks. Each is summarized below.
Model scale and families. Hidden interventions now cover four decoder-only families (Qwen2.5-7B, Llama-3.1-8B, Gemma-2-9B, Mistral-7B; 48 path-task cells in the submission) and three encoder-decoder receivers (FLAN-T5-Large, mT0-Large, FLAN-T5-XL). On the encoder-decoder receivers, with a Qwen source, all four tasks and all 12 receiver-task cells, source weights beat neutral weights (the same receiver donors, weighted by baseline-prompt similarity) by .126/.251 and a same-access ridge mapping by .035/.069 margin units at doses .5/1; all simultaneous 95% CIs exclude zero. Source weights exceed neutral weights in 11/12 cells and ridge in 10/12; accuracy rises from 75.0% to 78.1%/77.1%. For scale and recency, we added hidden interventions on Qwen3.6-27B, a recent model whose layers are mostly linear attention, from Qwen2.5-7B and Mistral-7B sources (Sec. 5.2, App. I.4). The prespecified contrast holds: source weights beat neutral weights by .20/.24 (simultaneous CIs [.14,.26]/[.19,.29]), concentrated in two of four tasks, and ridge by .15/.16; accuracy rises from 95.0% to 96.6%/98.8% (Fig. 3). This adds to the submission's 27B representation result (App. E.3; gap .215 after label removal). Hidden interventions now span 0.8B-27B receivers. Fixed cuts at relative depths .625/.875 give effects correlating .69-.93 with the central cut (Table 18).
Real-world tasks. The submission already includes BoolQ and RTE (App. F). We added a full comparison on both, in both Qwen/Mistral directions, with 64 paired support and 64 held-out test items per task, against 12 alternative constructions using the same support. Relational steering exceeds neutral weighting by 3.72/3.92, label-preserving permutation by .66/.62, and two applications of the learned activation mapping of Oozeer et al. (ICML 2025), a Linear-ReLU-Linear network trained to map source to receiver activations, by 1.83/2.04 and 1.00/1.15 margin units, all with simultaneous CIs excluding zero and positive in all four path-task cells at both doses. Class-level variants perform comparably (see our reply to Reviewer P99D). Accuracy rises from 84.8% to 86.7%/85.5%; we claim larger causal effects, not higher accuracy than the strongest controls. Practically, an intervention can be moved into a new model without training a map between their hidden spaces.
A second use predicts how a receiver's output will change when its context is edited, from a source's observed response, without querying the receiver on the edit. The submitted natural-context study (Sec. 5.5) already includes FLAN-T5-XL: source responses cut this prediction error by 32.5% overall and by 36.6% on directions involving the encoder-decoder model. We added ARC-Challenge, OpenBookQA and HellaSwag, each with 192 calibration and 512 new held-out questions. Across the six directed paths among FLAN-T5-XL, Qwen2.5-7B and Mistral-7B, adding source responses reduces prediction error by 11.1% relative to a receiver-only predictor, with corrected support in every domain, and by 2.4% overall relative to the source's hard answers alone. A separate probability study uses Qwen2.5-0.5B, with 36% accuracy, as a cheap source: it improves the Brier score of the three larger receivers' probabilities in all 16 prespecified comparisons, though not their accuracy.
What a practitioner gets. Moving an intervention into a new model needs only 56-64 paired support items and no training; a 16-item audit on the receiver then predicts held-out effects (audit gain ρ of .86-.88 at 7-9B; weaker at 27B); and a cheap source can forecast how a larger receiver's outputs change. For binary concepts, class-level weights suffice, which further simplifies the construction. Each component is evaluated on held-out items against matched controls.
Presentation. We agree the paper was dense, and we rewrote the main text around one line of argument: relations recur (Sec. 5.1), transported relations steer every receiver tested (Sec. 5.2, new Fig. 3), the source contributes a class judgment (new Sec. 5.3), and a receiver audit predicts held-out effects (Sec. 5.4). Each section opens with its answer, every coined term is defined at first use, and Table 1 states the question each control answers. Appendix numbers are unchanged. We will also redraw Figure 1 as a three-step pipeline for the final version.
We hope the 27B, architecture, public-task and learned-mapping evidence addresses your main concerns, and respectfully ask you to consider raising the score.