- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper uses an insider trading environment to test for agent collusion, compares misalignment rates in single- and multi-agent settings, and introduces a fine-tuning method to reduce deceptive model behavior.
Critical strengths
- Testing models' capabilities after fine-tuning to detect potential declines.
- The fact that PACT, the papers fine-tuning method, achieves results that outperform traditional supervised fine-tuning and improves model alignment compared to the non-fine-tuned baseline.
Critical weaknesses
- The very first sentence of the paper's abstract contains a mistake (it's a sentence fragment). This doesn't set the stage well for the paper, as it doesn't really speak for the authors' diligence. Proof-reading their work once would have fixed that.
- The abstract doesn't introduce abbreviations like "PACT" (in fact, "PACT" is never introduced). Also, it uses sentences that are very hard to read. Quote: "Using generic honesty prompts, PACT trains a stronger student on its own sampled continuations, matching its next-token distribution to that of a smaller, frozen honesty-aligned teacher via reverse-KL supervision." Also, what is "existential pressure with ethical instructions"? Sure, you talk about this later in the paper, but a reader starts with the abstract and won't have any idea what that is.
- The paper states " We will release our honesty-aligned models to support future research on scalable alignment and deception mitigation in agentic systems." However, I found no link to any models, code, or data anywhere. This reduces the overall quality of the submission and gives me the impression that this sentence is a side-effect of the paper being AI-written without thorough manual double-checking. The paper also contains numerous Claudisms, e.g. sentences like "We keep [...] fixed [...] and vary only [...]." I will not make any claims in this regard (area chairs, pls double-check with Pangram), since I can only speculate about this, but it at least seems (!) to contradict the statement that LLMs were "only [used] for language editing and presentation."
- Some references are erroneous (see e.g. line 574, where Marius Hobbhahn is stated to be the author, but this is not true). Other references are misplaced, and citations don't support the claims (see e.g. line 52, citing Neel & Chang for deceptive communication, but it is a privacy survey, or e.g. line 267, citing Betley et al. 2026 and others, but these papers have nothing to do with detailing LLM judge methodologies, and numerous other places where this happened).
- The paper is riddled with fancy-sounding, but shallow terms and sentences. There are too many to list them here, but see for instance line 102, where authors want to distinguish their study from the work others have done (which is a strawman) and use terms like "consequential misaligned actions", "action-level misalignment", or "deceptive reporting", which sound fancy, but make it hard for readers to understand what is actually going on. Most importantly, the entire topic could be expressed in way simpler language.
- Authors use MMLU to assess models capabilities after fine-tuning. Given how flawed this benchmark is (not to speak of training data contaminations), I wonder whether it is a good choice.
- A core problem with the paper is the lack of statistical tests. It reports zero p-values, and some plots lack error bars. While this may be common in computer science, it is no excuse and a major weakness. It is unclear whether gaps in model behavior are "real". Sure, some comparisons/increases/decreases in a specific model behavior are so large that they are certainly significant. But others aren't. See for instance Figure 2, where authors claim that PACT "consistently reduces all three behaviors beyond SFT". But PACT and SFT intervals overlap, so to raise such a claim, authors need a paired test. In sum, I think the paper should either clearly state that results are merely descriptive, weaken their claims, and soften their interpretations. Or it should contain statistical tests.
- The limitations section of the paper appears somewhat sloppy when mentioning two very generic limitations (the benchmark is narrow and the LLM judge could be wrong). There are other, more informative limitations (because the two limitations mentioned apply to basically every paper doing model evaluations and using automated judges) that should be listed.
Questions for authors
- Why do Figure 2 and Figure 6 show different types of CIs?
Manuscript Updates and Request for Reviewer Reassessment
We sincerely thank all reviewers for their thoughtful feedback and constructive suggestions.
We have carefully addressed the reviewers' concerns in our detailed responses and uploaded an updated manuscript incorporating the additional experiments, clarifications, and corrections.
We would be grateful if the reviewers could kindly revisit our responses and let us know whether their concerns have been adequately addressed. If so, we would respectfully appreciate their support for our work and their kind consideration of increasing their review scores accordingly.
We sincerely appreciate the reviewers' time and consideration.