- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper proposes post-intervention recovery to investigate whether an SAE intervention forms a complete behavioral bottleneck. The method searches for bounded perturbations that maximally restore the suppressed behavior after successful SAE clamps. Experimental results show that multiple suppressed behaviors can be successfully recovered across different task scenarios, indicating an important finding that SAE interventions are not necessarily complete behavioral bottlenecks.
Critical strengths
- Clear problem formulation: the paper clearly distinguishes SAE interventions from complete behavioral bottlenecks, which is an important but frequently neglected point.
- Strong theoretical support: the proposed behavior optimization is mathematically grounded.
Critical weaknesses
- Limited real-world practicability: the method requires white-box access to residuals and gradients. Such recovery cannot be applied through adversarial inputs, making the distinction practically less critical.
- Over-reliance on fallback: the proportion 20.7% is not quite impressive. Moreover, the successful examples are mostly achieved by the fallback plan. The effectiveness of the optimization strategy is not clear.
Questions for authors
- Can recovery be achieved without white-box support? Otherwise, the distinction between SAE intervention and complete behavioral bottleneck is less practically significant.
- How can the method prove that recovery is achieved by re-activating the suppressed operations rather than creating a new adversarial path?
- It seems that most successful attempts do not meet the optimization requirements. Can the authors provide more concrete evidence that the optimization strategy is reasonable?
4 comments
>>> W2&Q3 Fallback selection and hard drift constraints
>>> A3 Thank you for asking how checkpoint selection affects the reported recovery rate. We clarified the selection rules in Section 6.1, Table 1, and Appendix D.3. At a perturbation budget of 50, the fixed SAE intervention remained active and 6/29 eligible prompts recovered. All six recoveries used fallback checkpoint selection and exceeded the preferred relative drift threshold of 0.03.
| Evaluation setting | Harmful recovery |
|---|---|
| Budget 50, fallback enabled, drift measured after selection | 6/29 (20.7%) |
| Five budgets, retrospective count of distinct prompts with recovery at measured drift ≤ 0.03 | 3/29 (10.3%) |
| Budget 50, hard drift cap of 0.05, fallback disabled | 0/29 (0.0%) |
| Budget 50, hard drift cap of 0.10, fallback disabled | 1/29 (3.4%) |
With fallback disabled, recovery still occurred on 1 of 29 eligible prompts at a hard drift cap of 0.10. At a cap of 0.05, the search found no feasible candidate. The 3/29 figure counts distinct prompts that recovered with measured drift at or below 0.03 across five budget runs.
The responses address most of my concerns. I maintain my original rating (3).
Dear Reviewer u6sa,
Thank you for your feedback! We are glad that our responses addressed your concerns. If there is anything else we can clarify, please do let us know. Thank you for your support!
Best regards, The authors
Thank you for distinguishing the practical access assumptions from the theoretical claim and for asking us to account for fallback explicitly.
>>> W1&Q1White-box access and practical scope>>> A1Thank you for asking about the practical access assumptions. We clarified the purpose and access model in Section 4, Section 5, and Appendix H. Post-intervention recovery is a defense diagnostic for model developers with access to internal activations and gradients, rather than an attack method. It tests whether a fixed SAE intervention sustains behavioral suppression under bounded residual perturbations. The result establishes recovery under this internal access model. Input-only recovery concerns the feasibility of adversarial attacks, which falls outside the scope of our defense diagnostic study.>>> Q2Behavioral recovery and circuit identity>>> A2Thank you for distinguishing behavioral recovery from circuit identity. We clarified the claim in Section 6.4, Appendix C.3, and Appendix H, and report the IOI controls in Appendix D.2. The audit measures whether suppressed behavior returns while the intervention remains active. The IOI controls show that recovery persists under joint encoder–decoder orthogonality and that freezing the reconstruction error reduces the recovered margin.