- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper asks whether LLMs exercise final decision authority when a dialogue delegates it to them. To test this, the authors build a matched-triplet benchmark, where only the dialogue assigning final authority changes. They find "delegated-authority underuse" (DAU): answers are correct most of the time when the human holds final approval but only about a third when authority is delegated to the model. Their fix, DARC, is an inference-time prompting controller that makes the authority direction explicit and binds it to a decision-right response policy.
Critical strengths
-
The setting of this paper is novel. To the best of my knowledge, it is the first work to consider the final decision right delegated to LLMs. By keeping task facts, request, and options fixed and varying only the authority-assigning dialogue, the authors identify "delegated-authority underuse" (DAU).
-
The mechanism claim is testable, and the study is transparent by precisely specifying the metrics (DAU rate, error composition, directional gap), and providing a thorough appendix (verbatim prompt templates, QC protocol, per-cell variance tables, full McNemar tables).
Critical weaknesses
-
Overall, the manuscript reads as somewhat hastily written. For example, Section 3 reads more like a programming walkthrough than a mathematical treatment. In Line 148, the authors don't explain what the range of is. Figures 2 and 3, which appear slightly horizontally squeezed, should be polished up to meet the bar of a top conference.
-
I'd like to see a bit more on the rationale: why does the phenomenon (DAU) arise when only the authority differs, and why is the proposed method expected to work? A couple of extra sentences describing the method (Lines 078–079) would also help. The current description feels a little thin.
Questions for authors
-
How does authority affect the final result?Does the choices made by the digital person differ from that made by a human?
-
What's the deep mechanism in the proposed method? Briefly, what makes the proposed method work?