- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Paired Causal Residual Transport (PCRT), which learns to correct the remaining activation errors of existing steering methods using paired source-target states. The method uses output-head geometry and conditional residual prediction to better match the distribution induced by a target instruction. Experiments demonstrate substantial reductions in sequence KL divergence across multiple models.
Critical strengths
- The paper provides a well-defined distribution-level objective for evaluating and improving activation steering.
- The experiments across multiple backbones and steering methods demonstrate consistent reductions in target-distribution errors. The ablation studies and statistical analyses are reasonably thorough.
Critical weaknesses
- The main approach relies on established residual learning and linear prediction techniques. Moreover, replacing output-head geometry with Euclidean fitting produces nearly identical results, raising questions about the necessity of the proposed formulation.
- Insufficient justification for post-editor correction. Tables 19–20 show that direct Source + PCRT achieves lower sequence KL than AcT + PCRT across all three external backbones. The paper does not adequately establish why correcting an existing editor is preferable to learning a direct intervention.
Questions for authors
1.Under what conditions does post-editor PCRT offer advantages over direct source correction? 2.What are the practical benefits of the proposed output-head geometry and conditional predictor over simpler residual correction methods?
4 comments
This follows up on both of your questions with a new run of the estimator exactly as submitted, now with three training replicates (Table 4 and Appendix S.4 of the second revision). The editor is a response-aligned transport editor whose outputs stay fluent, and the tasks are question answering, sentiment classification and the 73 IFEval items.
On the conditional predictor (Q2), the run compares it with the simpler correction on outputs. A paired residual mean fitted on the same pairs changes task success by at most three items, both after the editor and on the unedited source. The conditional predictor raises success in all 18 model, task and replicate cohorts in both settings. After the editor on Qwen 2.5, for example, exact answers in the instructed format go from 0 to between 35 and 42 of 48 questions. Against the paired mean, all 36 comparisons are significant after Holm correction (Table 45). We expect the reason to be that the instruction changes some response positions, such as the opening of the JSON object, much more than others, which a constant shift cannot express. The saved measurements do not resolve KL by position, so we state this as an expectation and not as a result.
On when post-editor correction helps (Q1), this editor starts closer to the target than the unedited source in all 18 cohorts. After correction it ends with lower KL than direct correction in 13 of them and has higher task success in 11, lower in 3 and equal in 4. None of these differences is significant (Tables 45 and 47). This sharpens the condition in our first reply. In our data an editor has to start closer to the target for the post-editor route to end closer, but starting closer does not by itself give a measurable advantage, so we still claim none. What the run does show is that post-editor correction reliably repairs an editor that is already in place, with higher task success than the editor alone in all 18 cohorts and significantly so in 17.
Does this answer both questions? If the revision resolves the two weaknesses in your review, we would be grateful if you could say so in the thread, because the other two reviews raise the same two points.
Thank you for your response. The comparison with the paired residual mean also addresses my concerns about the conditional predictor.
Thank you for returning to the thread and for confirming this. Your two questions led to the comparison in Table 39 and to the three-replicate study in Table 4, and the paper is better for them.
If any concern from your review remains open, please tell us and we will answer it today. If none does, we would be grateful if you would consider whether your rating still reflects your assessment of the revised paper.
Thank you for the positive assessment and for two precise questions. Changed text in the revised PDF is blue, and L refers to its line numbers. Tables 19–20 of the submission are now Tables 21–22.
Q1. Under what conditions does post-editor PCRT offer advantages over direct source correction?
Your reading of Tables 19–20 is correct, and the revision makes direct correction the recommended default (L95–102, L463–470). We can now state a condition and the evidence for it.
In our data the editor has to start closer to the target than the unedited source. Under our settings AcT starts farther on all 64 test contents of every additional backbone, at 2.0 to 6.8 times the source KL. PCRT removes a similar or larger share of its error (69.6% to 74.2%, against 45.8% to 71.8% for the source), yet the post-editor path ends above the direct path on 64, 62 and 64 of 64 contents (new Table 40). The same holds at all four training budgets (Table 28) and in the five IFEval categories. In none of our comparisons does a candidate that starts farther end closer.
Starting closer is not enough, however. A response-aligned transport editor starts closer than the source in four question answering and sentiment cohorts. After correction it matches direct correction or exceeds it by one item in joint success with the KL-fitted correction, and the result is mixed with the closed-form correction. KL favors each path in four of eight fits (Appendix S.3, Tables 42–43). On IFEval the post-editor path gains 9 items and loses 4 on one model, and gains 13 and loses 4 on the other, against direct correction (p = 0.27 and 0.049, unadjusted).
We therefore do not claim a general post-editor advantage (L518–525). Its use is repair. When an editor is already fixed, PCRT lowers its sequence KL by 35.7% to 54.4% on Gemma 2 with two editors and by 69.6% to 74.2% on three backbones without retraining it, and it raises joint success for an editor with usable output in all four cohorts (Table 4).
Q2. What are the practical benefits of the output-head geometry and the conditional predictor over simpler residual correction?
The geometry has a definitional role. G=W⊤W identifies which state error the vocabulary head can see, gives the probability bound, and separates span coverage from prediction error. It does not improve accuracy in our experiments. Euclidean fitting changes mean head error by at most 0.55% and both intervals cross zero, which the main text now states (L412–415). Appendix Q.3 explains why this is expected. For fixed features, unrestricted multi-output least squares has the same normal equations under any positive-definite output weighting.
The conditional predictor does help. The revision adds its comparison on the additional backbones with a paired residual mean, which is the simpler correction with the same supervision (Table 39, L407–410).
All three simultaneous 95% intervals for the difference exclude zero. On the primary Gemma 2 task the gain over the mean is 19.6% for AcT and 14.2% for LinEAS, with intervals [1.289, 1.873] and [0.798, 1.351]. On the second attribute there is no gain, and the paper says so. A different-content residual with the same predictor loses on all 64 contents for both editors. The benefit therefore depends on the task and the model, and it is largest where the editor's error is largest.
The revision also adds behavioral evidence for both paths (L452–479) and a worked example (Table 1). We would be glad to answer further questions.