- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
As far as I understand the paper, the authors criticize that current deception detectors are evaluated on instructed instances of deception. They claim that current detectors detect superficial cues that are related to the deception instruction and might not be able to detect actual deception.
Critical strengths
None
Critical weaknesses
The presentation of the paper is extremely poor and makes it impossible to understand what the authors did. Without an adequate presentation it is impossible to review the underlying content of the paper. I recommend to rewrite the paper from scratch.
As far as I understand, one of the central experiments of the papers is "prompt equalization". However, what this precisely means is never explained in the main part.
The central premise of the paper, as far as I understand it, is that evaluating deception detectors on instances of instructed deception does not establish that the detectors can catch non-instructed instances of AI deception. That is a valid point but nobody in the field has claimed in the first place that evaluations on instructed deception are sufficient. People in the field are very well aware that evaluations need to cover non-instructed instances of deception. There exist many evaluations where AI lies or deception occur without explicit instructions to do so. Examples include [1], [2] and many more. Existing deception detectors, such as [3] or [4], are evaluated on non-instructed instances of deception, such as the insider trading scenarios in [5].
[1] Liars' Bench: Evaluating Lie Detectors for Language Models
[2] DeceptionBench: A Comprehensive Benchmark for AI Deception Behaviors in Real-world Scenarios
[3] Detecting Strategic Deception Using Linear Probes
[4] Benchmarking Deception Probes via Black-to-White Performance Boosts
[5] Large Language Models can Strategically Deceive their Users when Put Under Pressure
Questions for authors
- Please provide examples of the training data of the deception detectors and of the evaluation data.
- What is prompt "equalization"? I cannot see a clear explanation of this term anywhere in the paper.
2 comments
I thank the authors for their response. Given the response, I still have significant concerns regarding the clarity and soundness of the paper and I believe it should not be accepted for publication at ICLR.
Thank you. We accept that the submitted main text did not explain what we did, and we have rewritten it.
What is prompt equalisation? Both conditions receive one identical neutral system prompt ("You are a helpful assistant. You will be asked about a factual claim. Share what you know about this topic."). The false claim is still presented in one arm, but nothing tells the model to lie. It is defined where it is first used (§1), shown in Figure 1(b), and its limits are stated in §3.2: it removes the lie together with the instruction.
Examples of training and evaluation data. Figure 1 shows a verbatim trial of each kind, with the system prompt, question, answer and label. The detector is trained and evaluated on its yes/no replies to a fixed question battery asked after the answer. In our fixed-elicitation data, deception is graded from the answer, and there is no condition label.
"Nobody claims instructed evaluations are sufficient; detectors are evaluated on non-instructed data such as insider trading." We agree, and the revised Related Work says so and cites all five papers you list. The submitted version buried the part of our work that addresses this point. We audited exactly those corpora:
Our findings (§4.4, Table 4):
None of this says these corpora contain no deception. It says that accuracy on them does not by itself separate deception from the alternatives the audit names, and each problem can be fixed in the corpus design. This, not the instructed-lie critique, is the part of the paper we think is most useful to people in the field, and the revision now leads with it.