- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper describes work called behavioral constitution discovery where the authors infer / extract / discover the constitution (or at least a compacted version) of a given model to understand how they govern a model’s refusal to specific (harmful) prompts. The discovery process involves use of public topics to guide prompt generation and testing this to models being investigated through a series of comparing decisions, proposition of rules, testing, filtering of passing rules. Results show that the proposed behavioral constitution discovery seems to outperform existing rule discovery methods (ORPO, ProTegi, Natural Refine) in terms of surrogate refusals and reconstruction errors after a number of iterations on 240 prompts.
Critical strengths
The paper tackles an interesting problem of extracting or discovering constitutions or learned rules that guide a model’s refusal to harmful prompts to capture the developer’s intent. The authors test their proposed method of extracting / approximating the constitution of a model through a surrogate model setup with open-weight models. There might be some benefits in this line of work but the paper does not clearly motivate this.
Critical weaknesses
The first thing that prevents me from fully understanding the paper’s contributions is that the writing very much needs a significant overhaul from being AI-generated which is very obvious to me and to anyone who will read the paper. There are so many unusual jargons and terminologies that occur at every instance without proper context such as “batch-start constitution” “protected memory preservation” “overbreadth” “constitution-conditioned surrogate” “source–surrogate agreement” “discovery-time source queries” and many more. While I reviewed the authors’ acknowledgement that AI has indeed been used majorly in writing, I am inclined to believe that there had been minimal effort to write the core content of the paper. It’s very hard to grasp what the authors wanted to say and hard to differentiate which were the authors’ main idea vs. what has been AI generated from this work.
I am not sure what goal is from the proposed reconstruction process of an unseen constitution and the paper seems unsuccessful in clarifying this to readers and emphasizing its utility. After reconstructing a (potentially) small part of an off-the-shelf model’s constitution what happens after this? What is the extracted constitution supposed to look like? Is there even a guarantee that the approximated refusal patterns meant to reflect the constitution is semantically or structurally correct? If the tested models refuse basic harmful prompts and an arbitrary constitution-like text is drawn from this, is that even surprising? Most models must refuse harmful prompts, exercise care in giving financial advice, avoid giving suggestions to deceptive practices, etc so I also do not understand the uniqueness of the example topics the authors are investigating because they are not properly motivated in the paper.
Given the two issues above, I’m convinced with the current results and how it can be useful to readers. In terms of technical rigor from the results, it also seems lacking. What was the basis of using these select models and why only three pairs? Why did the authors not do the proposed constitution method with frontier models like Claude or OpenAI knowing that Anthropic/OpenAI have openly publicized versions of their constitutions online? Did the authors use the actual constitution text for each of the models they evaluated? These are basic questions expected by readers to be made very clear in the paper.
Questions for authors
See questions raised in the weaknesses section and address them.