- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces ProcGround, a benchmark for evaluating whether LLM agents make decisions based on the required evidence rather than simply producing correct final outcomes. It includes 215 tasks across 12 domains and uses Evidence–Decision Contracts and counterfactual evidence changes to evaluate agent behavior. Experiments across 11 models show a large gap between outcome correctness and evidence-grounded success, highlighting that agents can reach correct answers without following a reliable decision-making process.
Critical strengths
Meaningful improvement over outcome-only evaluation: The Evidence–Decision Contract framework provides a clear way to distinguish correct outcomes from decisions made without sufficient evidence. Evaluating evidence acquisition before consequential actions is particularly relevant for real-world agents where reaching the correct answer by chance is not enough.
Comprehensive experimental validation: The paper evaluates 11 models across 215 tasks and includes counterfactual evidence changes, external AppBench experiments, and controlled interventions. The human validation audits and detailed failure analyses further strengthen the findings and help explain why agents make unsupported decisions.
Critical weaknesses
Dependence on process annotations: The evaluation relies heavily on predefined evidence contracts and LLM-based judgments about whether agent trajectories satisfy them. Although the authors conduct human audits, agreement is lower for some important evaluation subsets, raising questions about the robustness of the reported grounding measurements.
Limited causal interpretation of counterfactual results: The counterfactual experiments use a selected subset of 59 tasks, and evidence-bypass and grounded trajectories are not randomly assigned. Differences in task difficulty or evidence accessibility could partly explain the higher failure rate among bypass cases, limiting how strongly the results establish a causal relationship.
Questions for authors
How sensitive are the reported grounding success rates to alternative reasonable definitions of required evidence and consequential commitment? Could the authors provide additional analysis showing whether these evaluation choices materially affect the model comparisons?
Could the authors further control for task difficulty and evidence accessibility when comparing counterfactual failures between evidence-bypass and contract-grounded trajectories? This would help determine how much of the observed difference is specifically associated with evidence bypass.