- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies LLMs acting as mediators in bilateral trade rather than as negotiators for one party. Its main methodological contribution is a counterfactual policy audit that perturbs components of the negotiation history and measures how the mediator's proposed price responds, with the goal of recovering a local revealed policy. The paper combines this analysis with a controlled environment of deterministic counterparties, theoretical characterizations of feasible trade and welfare benchmarks, and experiments across several frontier LLM families.
The main empirical conclusion is that LLM mediators exhibit side-dependent behavior, substantial dependence on their own previous proposals, and asymmetric responses to offers depending on whether they continue or reverse the previous bargaining trajectory. The paper further argues that these behaviors induce economically meaningful incentives, including robustness to retracted concessions but incentives for parties to stall.
Critical strengths
A meaningful evaluation perspective beyond endpoint metrics. Treating the mediator's revealed behavioral policy and the strategic incentives it induces as the central objects of study is both conceptually well motivated and potentially useful beyond bilateral bargaining. This is the strongest aspect of the work.
Good integration of controlled experimentation and economic analysis. Using counterparties with known policies makes it possible to disentangle mediator behavior from opponent behavior, while the theoretical benchmarks give the empirical outcomes interpretable reference points. The cross-model replication also provides some evidence that the main qualitative observations are not idiosyncratic to one LLM family.
Critical weaknesses
The evidence supporting the central “revealed policy” claims is too local relative to the breadth of the conclusions. The audit relies on one-variable-at-a-time perturbations around only a small number of base histories. Importantly, the paper itself notes that the audited histories share a particular negotiation pattern. For a highly nonlinear, history-dependent LLM policy, this leaves open whether self-anchoring and trajectory filtering are genuinely stable policy properties or behaviors specific to a narrow region of the state space. This matters directly because policy identification, rather than benchmark performance, is the paper's main contribution.
The economic conclusions remain strongly tied to a constructed environment. The deterministic agents use designed concession and acceptance rules, while the alternative LLM-counterparty environment behaves very differently and does not support the same welfare analysis. The current experiments therefore convincingly characterize behavior within the testbed, but provide weaker evidence that the identified incentives characterize realistic mediation settings. This substantially limits the scope of the broader conclusions.
Questions for authors
How stable are the reported self-anchoring and trajectory-filtering effects across a substantially larger and randomly or systematically stratified collection of negotiation histories, especially histories with different acceptance/rejection patterns? If these effects weaken materially outside the current audit histories, my assessment of the main contribution would change.
Because the audit changes one input at a time, have the authors evaluated whether the resulting local policy approximation predicts mediator outputs on joint perturbations of multiple history variables or held-out negotiation states? Such an experiment would help distinguish identification of an underlying policy from a collection of local marginal response curves.