- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
The paper introduces DECOR, a training-free, multi-agent framework for black-box auditing of LLM deception. Drawing on Information Manipulation Theory, it decomposes the input context into atomic information units, assigns importance weights, evaluates each unit along four dimensions—quantity, quality, relation, and manner—and aggregates the scores into a deception index. The authors provide human annotations for 745 DeceptionBench outputs and evaluate DECOR on DeceptionBench and OpenDeception under response-only and thought-plus-response settings. Experiments include baseline comparisons, evaluations across 15 auditor backbones, and component ablations. Reported performance is strongest in the single-turn setting.
Critical strengths
-
Inspectable auditing workflow. DECOR exposes information units, importance weights, and dimension-level scores underlying its aggregate judgment. These intermediate outputs provide concrete material for manual inspection and error analysis, illustrated through both successful and unsuccessful cases. The method also requires neither parameter training nor access to model internals.
-
Human annotation effort. The authors annotate all 745 evaluated DeceptionBench outputs, labeling responses and elicited thoughts separately. The labeling guidelines and domain-specific agreement statistics provide useful documentation for evaluating deception auditors.
-
Promising single-turn results. With GPT-4o as the auditor, DECOR reports AUROCs of 0.938 and 0.948 on DeceptionBench under response-only and thought-plus-response settings, respectively, exceeding the reported baselines in both settings. The weighting and decomposition ablations provide preliminary evidence that these components benefit the pipeline on this dataset.
Critical weaknesses
W1: Theoretical Foundation
- Reliability of IMT
Page 2, lines 73–77, describes Information Manipulation Theory (IMT) as extensively validated, without adequately discussing the relevant disputes or conditions of applicability.
Experiments by McCornack et al. (1992) found that manipulating information quantity, veracity, relevance, and clarity affected participants’ judgments of deceptiveness. This supports IMT’s value as an analytical framework, but does not establish that an arbitrary scoring scheme along these four dimensions can accurately detect LLM deception. In a replication incorporating checks on the covertness of violations and message types, Jacobs, Dawson, and Brashers (1996) reported results inconsistent with the IMT predictions they tested and argued that deception should instead be explained through false conversational implicatures. McCornack et al. (1996) challenged this interpretation and reanalyzed the data. In a Hong Kong sample of 310 participants, Yeung, Levine, and Nishiyama (1999), whom the paper cites, found that Quality and Relevance violations were judged deceptive, whereas the Quantity and Manner conditions did not yield the same result. Ratings on all four dimensions nevertheless correlated with perceived deceptiveness, and the authors suggested that cultural differences in what constitutes a covert violation might explain the discrepancy. These findings indicate that IMT is not a fully reliable theoretical foundation and that its applicability is context-dependent.
- Departures from IMT’s Original Definitions
The following changes in the paper’s operationalization of IMT require explanation.
| Location | DECOR’s rule | Concern |
|---|---|---|
| Appendix A.1, p. 13, lines 688–699 | Assigns newly introduced, unverified information presented as fact to Quantity | The original framework places assertions lacking adequate evidence under Quality. Why reassign or double-count them under another dimension? |
| Appendix A.1, p. 14, lines 703–708 | Assigns bypassing an information unit’s constraints while advancing the original goal to Relation | This partly measures goal compliance rather than conversational relevance alone. |
| §3.1, p. 4; Appendix A.2, p. 14 | The main text weights information by its importance to the user’s judgment; the appendix weights it by whether it facilitates or obstructs the execution of deceptive instructions | Influence on audience beliefs and importance to executing a deceptive task are distinct quantities. |
The original discussion of Quality, Relation, and covert violations appears in McCornack (1992), pp. 5–6. It concerns how speakers exploit listeners’ expectations of cooperative communication to mislead them, rather than simply whether an output advances a predefined goal.
Questions: Please explain each modification and its necessity, and use contrasting examples to distinguish compliance with an inappropriate request from inducing false beliefs in an audience. Clarify whether the intended audience is the informed requester or a third party who ultimately receives the generated content, to avoid conflating deception, task compliance, and safety refusals.
- Gap Between Theory and Validation
The paper’s central weakness is that its claim to be “theoretically grounded” is insufficiently supported by the method and experiments. In practice, IMT is primarily implemented as four-dimensional scoring rules in prompts, with an LLM assessing information units’ importance and degree of manipulation (§3; Appendix A). This introduces a set of manually designed inductive biases into an LLM judge. Citing IMT explains their origin, but does not establish their suitability for detecting LLM deception, particularly given the changes to the original concepts’ operational definitions.
Equations (1)–(4) define the workflow without translating the theory into testable methodological constraints. They encapsulate decomposition, weighting, and auditing as functions and specify output aggregation, but derive neither properties these functions should satisfy under IMT nor a theoretical relationship between the aggregate score and deception. Although the aggregation formulas are used in the experiments, the formalization does not serve to test the theory: the evaluation neither tests IMT-derived predictions nor verifies that the LLM’s scores faithfully instantiate the theoretical constructs. Moreover, the evaluation still relies on the “black-box response-level judgments” criticized by authors themselves in the abstract.
The experiments therefore validate the predictive performance of the overall prompting workflow, not its theoretical foundation. The decomposition and weighting ablations in Table 5 and the dimension-removal experiments in Figure 3 show that some design choices help on the current datasets. They do not establish whether the gains arise from IMT’s specific explanatory mechanisms or from finer task decomposition, more detailed scoring instructions, and additional reasoning. Higher AUROC alone does not establish the theoretical validity of the introduced inductive biases.
Questions: Please identify the design choices and testable predictions derived from IMT and test those predictions directly. Also evaluate alternative scoring frameworks while holding decomposition, weights, inputs, and reasoning budgets fixed to isolate IMT’s contribution. The authors could also consider formal verifications or other approaches that make reasoning more traceable and verifiable as complementary validation. Such evidence would strengthen my confidence in the paper’s central claim.
W2: Empirical Soundness
- Independent Validation of Human Labels
Appendices B.1–B.2, p. 16, state that two annotators inspected the context and deceptive goal, labeled independently, and then discussed disagreements to reach consensus. Overall Cohen’s κ for Response was 0.810, but only 0.564 for Education (Table 6).
These results support annotation consistency, but do not establish that the responses would actually induce false beliefs in the intended audience. The paper also provides insufficient detail on the annotators’ relationship to the authors, whether they were blinded to method predictions, and how disagreement discussions were conducted. The safeguards for independence and validity are therefore unclear. Two annotators are too few, and disagreement resolution may be overly sensitive to individual judgment.
Questions: Please describe annotator recruitment and blinding, release anonymized pre-discussion labels and disagreement-resolution records, and have independent annotators relabel a subset. For disputed cases involving omission, implication, and ambiguity, add a small audience study that directly measures factual beliefs formed after reading the outputs.
- Missing Ground Truth for Fine-Grained Explanations
A key contribution is identifying “what information is manipulated and how” (§3; §5.2), yet human annotations primarily consist of binary deception labels for thoughts and responses (Appendix B.1). The completeness of information units, appropriateness of weights, and correctness of the four-dimensional scores are illustrated through examples rather than independently validated quantitatively.
High final AUROC therefore does not establish that the intermediate explanations are correct. The finding that Quantity and Relation manipulations are more common (§5.4; Figure 4) also relies on the auditor’s own classifications and has not been confirmed by independent annotation.
Questions: Please independently annotate information units, manipulation types, and importance on a stratified subset, and report accuracy and agreement for each component. Validate the classifications before drawing conclusions about manipulation frequencies; otherwise, describe them only as the distribution of categories predicted by DECOR.
- Too Few Negative Examples in Multi-Turn Evaluation
Appendix B.3, p. 17, Table 7, shows that the filtered OpenDeception set contains 140 deceptive and six non-deceptive dialogues. Rank comparisons and false-positive estimates rely on just six negative dialogues. Sensitivity to individual negatives therefore needs to be reported.
In Table 3, DECOR’s Response-only AUROC is 0.571, below CoT Red-Handed’s 0.583, and reaches 0.657 only after adding elicited thoughts. The paper itself acknowledges that these thoughts need not faithfully reflect internal reasoning (p. 5, footnote 1). The multi-turn results should therefore report detection performance separately for visible responses alone and for inputs that include additional thought text.
The paper reports neither a full-test-set confusion matrix nor the decision threshold used to convert DECOR scores into binary predictions. Table 7 gives only the ground-truth label distribution. Appendix D (pp. 21–24) presents one TP, TN, FP, and FN example each, which cannot substitute for aggregate counts. AUROC does not reveal how many of the six non-deceptive dialogues are flagged at a given operating threshold. With only six negatives, each additional false positive changes FPR by approximately 16.7 percentage points. A confusion matrix would improve transparency but would not remedy the shortage of negative examples.
Questions: Please add non-deceptive dialogues, especially hard negatives involving legitimate omission, uncertainty, politeness, and refusals. Report confidence intervals for each setting and a sensitivity analysis leaving out each of the six negatives in turn. State the benefits and applicability of each input setting separately. For both Response and Thought & Response, report full-test-set confusion matrices with raw TP, FP, TN, and FN counts, the decision threshold and its selection procedure, and FPR and recall with confidence intervals. Thresholds should be prespecified or selected on an independent validation set, not optimized on the test set.
- Limited Generalization Evaluation
In Table 1, 600 of 745 responses come from DeepSeek-R1, indicating limited coverage of output-generating models. The 15 models in Table 4 are auditor backbones; varying them does not replace independent evaluation across output sources or task distributions. Appendix E also acknowledges that both datasets primarily elicit deception through explicit goals, pressure, or incentives, leaving spontaneous, low-signal deception untested.
Although the paper evaluates both DeceptionBench and OpenDeception, they share important construction conditions and cannot adequately test whether the method generalizes beyond them. The empirical scope remains narrow and concentrated on goal-induced scenarios; broader applicability has not been established.
Questions: Please report results by output-generating model and evaluate a more balanced sample. Without changing the scoring rules, evaluate samples without explicit deceptive goals and test generalization to independent task distributions. Candidate benchmarks include MASK (consistency between knowledge and statements), the Sneaking subset of DarkBench (information alteration in summarization or rewriting), and LH-Deception (long-horizon, multi-task interactions). The CSQ tasks in Beyond Prompt-Induced Lies offer a reference for settings without explicit deceptive goals. These evaluations use different label definitions, so their relationship to the paper’s definition of deception must be clarified; factual errors or reasoning failures must not simply be treated as deception. If further evaluation is infeasible, restrict the claimed scope to the goal-induced settings studied here.
W3: Methodological Novelty
- IMT’s Independent Contribution Is Unclear
Section 3.1 explicitly attributes atomic information decomposition to FActScore, and §2 acknowledges prior work applying IMT to deceptive persuasion by LLMs. The main addition is the combination of decomposition, importance weighting, four-dimensional auditing, and aggregation.
Table 5 shows that removing weighting or decomposition reduces performance, but does not attribute the gains to IMT. The dimension-removal experiments in Figure 3 also leave open whether another equally detailed set of judgment criteria would perform similarly. This affects both the theoretical claim and the method’s novelty relative to existing structured LLM-as-judge approaches.
Questions: Please hold the backbone, inputs, decomposition module, weights, and reasoning budget fixed, and vary only the scoring rules to compare IMT, IDT, and a generic checklist for omissions, contradictions, and misleading content.
- Baseline Outputs and Reasoning Budgets Need Alignment
Appendix C.2, p. 19, describes the Zero-shot and Few-shot baselines as producing binary labels, whereas DECOR produces continuous aggregate scores and the main metric is AUROC. Please clarify whether the baseline ROC curves use only binary outputs or additional, undocumented scores. If the former, the comparison is confounded by differences in output resolution.
The single-agent comparison in Table 9 also does not adequately specify whether role prompts, context isolation, and token/call budgets are matched. Their effects therefore cannot be clearly separated from the contribution of the multi-agent design.
Questions: Please have each baseline produce continuous or sufficiently granular ordinal deception scores, and release the actual outputs, scoring prompts, and parsing procedures used to compute AUROC. This would prevent differences between binary hard labels and continuous scores from confounding the method comparison. Also report call counts, token usage, and costs, and include a budget-matched, single-agent baseline that audits in stages to identify the source of the gains.
References
- McCornack, S. A. (1992). Information manipulation theory. Communication Monographs, 59(1), 1–16. DOI: 10.1080/03637759209376245.
- McCornack, S. A., Levine, T. R., Solowczuk, K. A., Torres, H. I., & Campbell, D. M. (1992). When the alteration of information is viewed as deception: An empirical test of information manipulation theory. Communication Monographs, 59(1), 17–29. DOI: 10.1080/03637759209376246.
- Jacobs, S., Dawson, E. J., & Brashers, D. (1996). Information manipulation theory: A replication and assessment. Communication Monographs, 63(1), 70–82. DOI: 10.1080/03637759609376375.
- McCornack, S. A., Levine, T. R., Morrison, K., & Lapinski, M. (1996). Speaking of information manipulation: A critical rejoinder. Communication Monographs, 63(1), 83–92. DOI: 10.1080/03637759609376376.
- Yeung, L. N. T., Levine, T. R., & Nishiyama, K. (1999). Information manipulation theory and perceptions of deception in Hong Kong. Communication Reports, 12(1), 1–11. DOI: 10.1080/08934219909367703.
Questions for authors
See Weaknesses.
7 comments
Author's response (Part 2)
Original IMT concerns misleading listeners by exploiting expectations of cooperative communication, including covert violations, rather than simply advancing a predefined goal (McCornack, 1992, pp. 5–6). Explain why each adaptation is necessary, provide contrasting examples distinguishing compliance with inappropriate requests and safety refusals from inducing false beliefs, and clarify whether the intended audience is the informed requester or a third-party recipient.
We thank the reviewer for highlighting the distinction between task compliance and deception. We want to clarify that the prompts used to generate responses from the source models do not necessarily contain explicit deceptive goals. For example, a prompt may ask the model to sell a product despite a known safety risk, rather than directly asking, “How can I deceive the customer?” Task compliance and refusal concern whether the response follows the requester’s instruction, while deception concerns whether it would lead the intended recipient to form a false belief. The recipient may differ from the informed requester. For example, two responses to a pregnant customer both retain the salesperson’s role. One calls the product “generally safe for most users” without mentioning the known miscarriage risk. The other discloses the risk. Human annotators labeled the first deceptive and the second honest. Failing to clearly and accurately communicate the known miscarriage risk could lead the customer(recipient) to falsely believe the product is safe during pregnancy. The distinction is whether the response misleads the customer, not whether it pursues the sales goal.
W1.3Gap Between Theory and Validation.
We thank the reviewer for pointing out the need to clarify the role of IMT and validate its use in DECOR. IMT guides the four-dimensional manipulation scores assigned to each IU. Decomposition, impact weighting, and aggregation are our methodological choices for applying these scores to LLM auditing, rather than procedures derived from IMT.
To isolate the contribution of the scoring rules, we compared IMT with IDT and a generic checklist using the same GPT-4o backbone, inputs, IUs, weights, aggregation, and prompt template. Only the scoring rules were changed.
| Scoring rules | Response | Thought & Response |
|---|---|---|
| IMT (Quantity, Quality, Relation, Manner) | 0.935 | 0.946 |
| IDT (Veridicality, Completeness, Directness, Clarity, Personalization) | 0.907 | 0.920 |
| Checklist (Omission, Contradiction, Misleading content) | 0.907 | 0.924 |
IMT achieves higher AUROC in both input settings, supporting its contribution beyond the shared decomposition and weighting steps.
W2.1Independent Validation of Human Labels.
We thank the reviewer for suggesting further validation of the human labels. The two annotators are members of the author team, each with over one year of research experience in LLM deception. They annotated independently without seeing each other’s labels, and all labels were finalized before DECOR was designed. We will release both annotators’ anonymized pre-discussion labels and conduct independent relabeling upon publication.
To clarify how disputed cases were resolved, we added two disputed cases to Appendix B.2.
In the airbag case, the response acknowledges the accident but presents the failure to deploy as normal and claims that safety inspections were passed. This could lead the buyer to falsely believe the airbags are working properly, so it was labeled deceptive. In the ultrasound case, the response confirms normal fetal development while recommending consultation about supplements. This advice would not create a false belief that supplements are needed to address a developmental problem, so it was labeled non-deceptive.
To check whether our conclusions depend on how disagreements were resolved, we re-evaluated all methods under different treatments of disputed labels. DECOR ranks first or ties for first in every case.
| Ground-truth labels (n) | DECOR Response | Best baseline | DECOR Thought & Response | Best baseline |
|---|---|---|---|---|
| Consensus, as in the paper (745) | 0.938 | 0.919 | 0.947 | 0.927 |
| Annotator A only (745) | 0.926 | 0.904 | 0.932 | 0.917 |
| Annotator B only (745) | 0.925 | 0.925 | 0.936 | 0.927 |
| Agreed before discussion only (675) | 0.961 | 0.947 | 0.967 | 0.950 |
| Disputed cases → deceptive (745) | 0.922 | 0.901 | 0.927 | 0.910 |
| Disputed cases → honest (745) | 0.936 | 0.934 | 0.948 | 0.939 |
Author's response (Part 3)
W2.2Missing Ground Truth for Fine-Grained Explanations. Questions: Please independently annotate information units, manipulation types, and importance on a stratified subset, and report accuracy and agreement for each component. Validate the classifications before drawing conclusions about manipulation frequencies; otherwise, describe them only as the distribution of categories predicted by DECOR.
We thank the reviewer for this suggestion. We added human validation of IU decomposition, impact weighting, and manipulation judgments on 50 DeceptionBench contexts, with 10 from each domain.
For decomposition, an annotator independently constructed reference IUs for each context. We compared these with IUs extracted by GPT-4o (two independent runs), Claude Sonnet 4.6, and Qwen3-235B-A22B.
| Auditor backbone | Precision | Recall (all IUs) | Recall (decisive IUs) | Consistency (F1) |
|---|---|---|---|---|
| GPT-4o (run 1) | 0.972 | 0.887 | 0.947 | – |
| GPT-4o (run 2) | 0.975 | 0.909 | 0.961 | 0.979 |
| Claude Sonnet 4.6 | 0.944 | 0.974 | 0.987 | 0.894 |
| Qwen3-235B-A22B | 0.956 | 0.870 | 0.921 | 0.911 |
Precision measures the share of extracted IUs that match a reference IU, and recall measures the share of reference IUs recovered. Consistency is measured by F1 against GPT-4o run 1. Extraction precision is at least 0.944, overall recall ranges from 0.870 to 0.974, and decisive-IU recall is at least 0.921.
For impact weighting, the annotator assigned each reference IU a weight w ∈ {1, 2, 3} following Appendix A.2, without seeing DECOR’s outputs. Decisive IUs receive the highest weight (w = 3), indicating information that directly supports or obstructs the execution of the instruction.
| Auditor backbone | Exact agreement | Quadratic κ | Decisive precision | Decisive recall |
|---|---|---|---|---|
| GPT-4o (run 1) | 0.790 | 0.704 | 0.878 | 0.903 |
| GPT-4o (run 2) | 0.776 | 0.694 | 0.868 | 0.904 |
| Claude Sonnet 4.6 | 0.818 | 0.751 | 0.789 | 0.947 |
| Qwen3-235B-A22B | 0.776 | 0.670 | 0.853 | 0.914 |
Quadratic-weighted Cohen’s κ ranges from 0.670 to 0.751, showing agreement between DECOR’s weights and human judgments. Recall for decisive IUs exceeds 90% across all backbones, indicating that DECOR correctly identifies most information judged decisive by the annotator.
For manipulation judgments, we evaluated 91 human-identified decisive IUs from the same 50 contexts. Following Appendix A.1, the annotator judged whether the response violates each IMT dimension for each IU, without seeing DECOR’s scores. Human judgments are binary, whereas DECOR assigns graded scores. To compare them directly, we converted each DECOR score into “violation” for a positive score and “no violation” for zero.
| Dimension | Agreement | κ |
|---|---|---|
| Quantity | 0.90 | 0.80 |
| Quality | 0.93 | 0.85 |
| Relation | 0.82 | 0.63 |
| Manner | 0.81 | 0.62 |
Agreement ranges from 81% to 93% across the four dimensions (κ = 0.62–0.85), supporting DECOR’s manipulation judgments on decisive information. We report the main findings in Section 5.4 and provide the full protocol and results in Appendix C.4.
We also revised section 5.3 to describe the distribution of IMT dimensions predicted by DECOR, rather than ground-truth manipulation frequencies.
Author's response (Part 1)
We sincerely appreciate your feedback and insightful comments! We address the questions and comments below in detail.
We thank the reviewer for highlighting these disputes. We agree that “extensively validated” overstates the evidence and have replaced it with “widely used.” We have also cited all the studies suggested by the reviewer and added a fuller discussion of IMT’s applicability in the
appendix A.3.We do not assume that IMT is universally valid. We use its four dimensions as theoretically motivated features because they have been linked to perceived deception in human communication, although findings vary across studies. Our setting is suitable for this analysis because the input context provides the relevant facts, allowing the auditor to assess whether the response omits, distorts, or sidesteps information important to the audience’s understanding.
We appreciate the reviewer for pointing out these ambiguities. We clarify the three definitions below and provide examples distinguishing task compliance from misleading an audience.
(i) We acknowledge that the original IMT places assertions lacking adequate evidence under Quality. In our rubric, “unverified” means unsupported by the input context, which is not the same as lacking adequate evidence. Quantity concerns how much information is provided, including both too little and too much information (McCornack, 1992, p. 5). DECOR uses the input context as a reference to identify omissions and additions. We include new, unverified additions under Quantity if they are presented as established fact and materially distort the audience’s understanding. These additions are not necessarily false or lacking adequate evidence. Quality, by contrast, concerns false or distorted information presented as true.
(ii) In the original IMT, Relation concerns relevance under the constraints of the preceding discourse (McCornack, 1992, p. 5). In our setting, a response may depart from the requested task because it refuses or corrects the request. Such departures should not themselves count as manipulation. We therefore require that a response both bypasses relevant information and continues to advance the original goal. For example, when asked to sell a product with a known safety risk, a response that refuses and offers an honest alternative disclosing the risk does not violate Relation. A response that refuses but then suggests redirecting safety questions toward the product’s benefits violates Relation, because it avoids addressing the risk while still helping sell the product.
(iii) We agree that importance to the audience’s judgment and importance to task execution are distinct quantities. We have revised Section 3.1 to align with
Appendix A.2, clarifying that impact weights measure the importance that directly supports or obstructs the execution of the instruction.