- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces a benchmark measuring whether LLM agents spontaneously engage with the ethical dimensions of realistic professional work when the ethics is not explicitly flagged. Starting from 150 practitioner-authored GDPval tasks, the authors construct six systematic variations per task. They run nine+four models across seven conditions, and score outputs with a three-LLM judge panel on a seven-dimension rubric. They also get it validated against 1,444 human raters. The main finding is a large "salience gap". That is, models score much lower on unprompted ethical reasoning at baseline than when the same task's ethics is made explicit. Also, adding noise produces no meaningful shift, suggesting that the gap reflects a failure to recognize ethical content rather than an inability to reason about it once prompted.
Critical strengths
- The seven-condition structure is a useful way to differentiate "capacity" from "application". The noise control is also a useful check against models simply reacting to any added text.
- The validation of the LLM as judge annotations using human judges is good.
- The paper clearly discusses where its construction failed, runs an additional experiment to check the results, and tests how stable the rankings are without making stronger claims than the results support.
- Evaluating ethical behavior in agent-generated outputs, without explicitly asking models to consider ethics reflects a real world use case more closely.
Critical weaknesses
- The agreement between human annotators and LLM judges is only moderate, but some of the paper's claims seem too strong given this agreement. The paper should acknowledge this uncertainty when discussing the results, especially in Sections 5.1 and 5.4.
- The models used to generate task variations and evaluate responses come from overlapping model families, and some judges are also evaluated models. This could introduce bias, so testing a subset of tasks generated by a different model family would help.
- The information-occlusion condition has relatively low quality, with only 99 out of 150 cases meeting the intended requirements. Its effect is also small and only marginally significant, so the paper should either improve this condition or be more careful when interpreting its results.
- Most performance indicators (20 out of 28) are evaluated by the same LLM judges that assess ethics, which could introduce bias. Using independent or human-verified performance measures for a subset would make the claim that ethical behavior does not reduce performance more convincing.
- The experiments only use English-language tasks in US professional settings, which limits how well the findings may apply to other cultures. The paper should discuss how cultural differences might affect ethical dimensions such as moral imagination and sensitivity to stakeholders.
- The frontier models in Table 2 use different reasoning and generation settings compared to the main models. These differences could affect the comparison, so they should be clearly mentioned in the main results rather than only in the appendix.
Questions for authors
- Could the 30-point improvement in the explicit condition be partly due to judges finding ethical reasoning more easily, rather than models actually reasoning better?
- Why do models fail to recognize ethical issues without explicit cues, even when the task remains unchanged? Could this indicate reliance on keywords rather than reasoning?
- Could differences in safety training or fine-tuning explain why some models show smaller improvements in the explicit condition than others?
2 comments
I thank the authors for their clarifications. I would like to keep my previously positive ratings.
Thanks for the review and the questions.
Agreement and claims. We'll narrow the claims in Sections 5.1 and 5.4 to rankings and condition effects. Individual humans agree with each other at α = 0.31, and three judges match the remaining human raters better than three humans do (0.55 vs. 0.46). We'll report the 0.672 as interval alpha (ordinal: 0.670), and give the 0.78 rank correlation with its interval, [0.50, 0.93].
Model families. Claude Sonnet 4.6 wrote the variants, but Haiku 4.5, the only Claude model on the roster, gains about as much under the explicit conditions (+46) as GLM-5 (+48.5) and Kimi K2.5 (+45). All three judges are also roster models. Section 4.3 finds at most 0.09 points of self-preference on the 1–5 scale (about 2 on the 0–100 scale). We'll release the per-judge scores.
Occlusion. On the 99 occlusion variants that meet the spec, the change is +0.6 [−0.9, 2.2]. We'll present occlusion only as a probe of information seeking, on that subset.
Performance indicators. The performance score uses nine of the 28 indicators, and seven of those nine are judge answers. The other two come from the agent logs: whether the agent used all the reference files, and whether it avoided tools outside the sandbox. On those two alone, performance still rises slightly under the explicit conditions (+2.4, +3.2 and +2.9 against a baseline of 66.6, all intervals above zero), much as the judged score does (+2.7 to +3.6). So the finding that the work doesn't suffer doesn't rest on the judges.
We'll expand the limitations on the English-language, US-based tasks, including how stakeholder sensitivity and moral imagination may vary across cultures. We'll also move the frontier settings into the main results.
Q1. We scored each output against both briefs. Changing only the brief moves the score by −2.1 to 0.0 points. Changing the output moves it by +29 to +38. In signposting, the note is worth +2.1 to the judges, against +18.7 from what the models write.
Q2. One appended sentence naming an issue already in the brief raises scores by +20.8 [18.4, 23.1], and by +11.4 on the deliverables alone. So an explicit flag does increase engagement. Removing ethical wording while keeping the content gives no detectable decrease (−0.5 [−2.2, 1.1]), though that doesn't rule out keyword sensitivity. Our reading is that models treat ethics as part of the job only when the request mentions it. Our data show the behaviour, not its cause.
Q3. The explicit lift varies widely among models with similar baselines (+18 for Mistral Large vs. +48.5 for GLM-5). We can't see the training data, so we report it as a property of each model rather than guess at the cause.
Note: the original DeepSeek-R1 is no longer served, so the new judging uses DeepSeek-R1-0528 with Kimi K2.5 and GLM-5. Every comparison here is made within one batch, and where nothing else changed the new judges score within a point of the paper's (−0.8 [−2.6, 1.0]).