- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper introduces a self-regulating controller. There is a probe that reads the activations, updates states, and gates interventions. It also studies the controller dynamics and claims that algebraically exact off-state cannot be reached, before trying to close the gap. There are experimental results demonstrating some benefits of the proposed controller on a generated synthetic benchmark.
Critical strengths
- The paper studies an important area of research and is trying to propose a controller strategy that helps the frozen LM stick to the policy.
- There are interesting analysis of the controller dynamics and the discoveries about the unreachable null.
Critical weaknesses
- The paper is very poorly written. It is dense with weird breaks and terms right from the abstract till the end of the paper. The quality of the writing is severely impacting the readability of the paper and I believe it needs a complete re-write to ensure the community can parse the paper properly.
- The paper over claims a bunch of things, right from the beginning of the paper: "Every inference-time intervention on a frozen language model—a steering vector, an adapter, a rerouting objective—is deployed at a strength a human fixes in advance. " This is completely a false claim.
- The authors try to close the unreachability gap but seems limited to 1.5B model.
- The experimental results are quite mixed and unconvincing. In line 459, the paper explicitly says that a constant dose attains lower violation at lower benign cost, suggesting the dynamic controller is not specifically useful.
- There is no results with relevant baselines like CAST, llm-steer-instruct, etc
- There is no sufficient statistical reporting and the paper also acknowledged this...
Questions for authors
NA/ see above