- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper investigates whether activation interventions that produce a desired selection also support reuse of the condition governing that selection. In procedural time- and permission-based tasks, the authors train case-specific residual vectors in Qwen3.5-27B using target-identifier supervision. These interventions substantially improve selection on training-exposed menus, but the improvement disappears when familiar facts and identifiers are recombined. The interventions also provide little benefit to independently elicited eligibility and winner judgments, despite transferring across output wrappers. Additional experiments substitute retained history and patch source facts. An early source patch changes eligibility judgments primarily when the edited source is relevant, but does not reliably produce correct complete actions. The paper distinguishes successful target control, condition-sensitive judgments, and complete-action correctness.
Critical strengths
-
The factual-recombination experiment provides a convincing test beyond familiar-answer accuracy. It preserves the selection task while changing which identifier the current facts support. The disappearance of selection gains, together with increased repetition of the old target, identifies a specific failure pattern rather than merely showing poor transfer to a different task. The perfect-training-fit analysis further shows that this pattern is not confined to unsuccessful optimization.
-
The independent continuations and capability controls make the behavioral comparisons substantially more informative. Selection outputs are not passed into the judgment branches, and the wrapper experiments help separate serialization changes from changes in the requested computation. I also appreciate the explicit separation of fresh confirmation, reused worlds, and exploratory analyses, as well as the reporting of collateral errors and the unsuccessful primary source-patch result.
Critical weaknesses
-
The evidence remains specific to a restrictive intervention design. The learned writer operates at block 60 of 64, changes only a small portion of retained state, and receives supervision solely on target identifiers. This setup permits a shortcut that reproduces rewarded identifiers without updating the condition used elsewhere. The results establish that this shortcut occurs, but do not show how sensitive the failure is to intervention depth, token support, or supervision. The source-patching experiment does not resolve this because it changes all three: it uses natural donor activations, covers many tokens, and acts earlier. The paper acknowledges these confounds, but a more closely matched intervention comparison would substantially strengthen the contribution.
-
Weak native performance limits the interpretation of some reuse and action results. Natural B correctly answers only about one-third of target-true winner-verification questions, and its selection and complete-action accuracy also remain modest. Consequently, the absence of intervention gains can reflect both intervention limitations and limitations of the consumer itself. The 27 illustrative permission records demonstrate that the separation can occur when controls succeed, but they were selected partly for successful writer selection and failed writer judgments, so they cannot establish its prevalence among capable cases. The same-task crossing experiment is stronger here; the broader verification and complete-action conclusions need more systematic capability-conditioned evidence.
Questions for authors
-
Does the selection-versus-reuse gap persist when the same target-supervised writer is trained at earlier sites, with comparable intervention magnitude? This would help distinguish a limitation of the supervision from a limitation of the late write location.
-
Can you report results on a subset qualified solely by successful Native A and Natural B behavior, before considering writer outcomes? In particular, how often do crossed-selection and verification failures occur when the relevant unedited consumers demonstrably perform both conditions correctly?
-
Does the successful block-15 source patch retain its selective judgment effect across the full source-intervention cohort, beyond the prespecified 64-case subset? Extending this comparison would clarify the robustness of the paper’s positive condition-use result.