- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies whether small language models can be fine-tuned to behave as coherent decision-makers, where coherent decision-making requires both preserving beliefs under changes in utilities and correctly mapping beliefs and consequences to actions. The authors construct a benchmark based on 20 tabular binary-prediction domains and systematically vary decision utilities and natural-language framings while keeping the underlying evidence fixed. They evaluate belief distortion and belief-conditional decision errors separately, and further investigate incomplete-information settings in which one or both error costs are withheld. Across six Gemma and Qwen models, the authors find that targeted supervised fine-tuning substantially improves decision coherence and belief stability, with some transfer to unseen domains and framings. They also find that models specialized for recognizing missing decision-relevant information perform better at decidability, while complete-information CoT specialists are better at executing decisions, motivating a routed system that combines the two capabilities. Overall, the paper presents a carefully controlled framework for disentangling belief instability, utility misapplication, and decision incompleteness, and provides empirical evidence that these capabilities can be improved through targeted SFT.
Critical strengths
- Well-designed decomposition of decision-making failures.
A major strength is the separation of belief distortion from utility misapplication. By keeping the evidence fixed while varying the utilities and their linguistic framing, the paper can distinguish whether a model changes its belief when the stakes change from whether it simply fails to apply the stated utilities to its own reported belief.
- Systematic evaluation and positive results.
The experimental design goes beyond standard in-distribution evaluation by holding out entire application domains, individual framings, and even whole structural classes of payoff descriptions. This makes the claim that SFT teaches a decision procedure rather than merely memorizing particular templates more credible.
Critical weaknesses
- The benchmark is substantially simpler than the broader notion of coherent decision-making suggested by the paper.
The experimental setting is restricted to binary decisions with asymmetric false-positive and false-negative costs, where the optimal decision reduces to a single probability threshold. Although this is a useful controlled starting point, it leaves open whether the learned behavior extends to multi-action decisions, multiple possible outcomes, non-linear utility functions, correlated uncertainties, or settings where utilities cannot be reduced to two error costs. The authors acknowledge this limitation themselves, but it is important because the paper's framing around “coherent decision-makers” is broader than what is directly established by the benchmark.
- The observed framing generalization is still limited, especially for unseen payoff structures.
Although the paper demonstrates meaningful transfer, the full-class framing holdout results remain considerably worse than the seen-framing results, with the authors reporting belief-conditional decision errors of 0.16 to 0.43 for Direct SFT in this setting. Moreover, CoT SFT can perform worse than the corresponding base CoT model on some held-out full-class framings. This suggests that the learned procedure may still depend substantially on the structural forms encountered during training, which somewhat tempers the stronger claim that the model learns a generally reusable decision procedure.
Questions for authors
-
How sensitive are the results to the choice of the five utility pairs and the corresponding probability thresholds? Would the conclusions remain similar if the benchmark included a denser and more continuous range of thresholds rather than the five fixed values?
-
How does the approach behave when the evidence itself is ambiguous or contradictory, or when the model's parametric knowledge conflicts with the external evidence?
-
Decision making is a widely studied topic, and I don't see the method's novelty very clearly (The related work section doesn't mention similar decision-making approaches neither). Could the authors elaborate on this?
-
The experiments are done on small to moderate sized LLMs (the largest is 12B). For frontier LLMs, does the problem of decision-making coherency still exists?