- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Although large language models (LLMs) offer flexible modeling capabilities for personalized decision-making, they lack a solid theoretical foundation, exhibit behavioral instability, and suffer from insufficient interpretability. This paper introduces the "Learning to Agentic Orchestration" (L2AO) framework. It employs "Theory-guided Agent Learning" (TAL) to train agents that make decisions based on various theories, and utilizes "Consensus-First Expert Adaptation" (CFEA) to coordinate the decision outputs of multiple agents, thereby balancing both the commonalities and the distinct differences among them. Experiments conducted on five decision-making datasets, derived from real-world survey data, demonstrate that L2AO achieves state-of-the-art performance, outperforming utility-based, machine learning-based, and existing LLM-based baseline methods. Furthermore, the paper reveals that relying on a single decision theory to guide agent behavior can introduce potential systematic biases.
Critical strengths
- L2AO integrates various decision theories with LLM agents, combining theory-specific numerical utility gradients with textual gradients to facilitate agent learning. Furthermore, it employs an ensemble of multiple agents to achieve additional performance gains.
- The paper conducts a comprehensive comparison of the proposed method against existing approaches across five decision-making datasets based on real-world surveys, demonstrating a clear advantage for L2AO.
Critical weaknesses
- There are issues with the citation information and formatting. When citing the paper "The rise and potential of large language model based agents: A survey," the authors included eight names that do not appear in the original source. Furthermore, ICLR 2027 requires an author-year citation format, whereas this paper uses a numbered citation format.
- In L2AO, the results derived from decision theory serve merely as inputs for the LLM, which then makes a final decision by synthesizing these theoretical results with textual knowledge and profiles. However, the paper does not analyze how the LLM resolves conflicts between theoretical results and textual knowledge, nor does it examine the extent to which the LLM relies on the theoretical results. Consequently, it remains difficult to determine the degree to which the theory actually guides the final decision-making process.
Questions for authors
Q1 Could the authors please correct the citation information and verify the citation format?
When citing the paper "The rise and potential of large language model based agents: A survey," the authors included eight non-existent names in the author list: Wei Xu, Junjie Ye, Guiyang Hou, Yan Liu, Bin Gui, Haoxiang Fen, Yongzu Cano, and Zhengando Wen. The original paper can be found here: https://arxiv.org/abs/2309.07864v3. Furthermore, ICLR 2027 requires an author-year citation format, yet this manuscript uses a numbered citation style. Adhering to the specified formatting guidelines is a fundamental requirement for submission. Please ensure these are corrected.
Q2 Could the authors analyze how an LLM makes decisions when there is a conflict between theoretical results and textual knowledge?
It is important to examine whether an LLM can appropriately weigh theoretical results against textual knowledge, and to what extent theoretical results actually guide the LLM’s decision-making process. This relates to the core assumption of this paper, namely, that decision theory can help LLMs make better decisions.
5 comments
W2&Q2 How does decision theory guide LLM predictions?
Decision theories guide both the learning process and final predictions through explicit behavioral structures. We clarify this through the optimization mechanism and an additional analysis of symbolic–LLM prediction consistency.
(a) Theory guide LLM in both the forward process and backward optimization.
In the forward process, each agent computes theory-conditioned choice probabilities from its learned utility function. These probabilities serve as explicit behavioral priors for LLM reasoning, alongside contextual knowledge and theory-specific assumptions. In the backward process, prediction errors guide updates to both symbolic utilities and contextual knowledge. Theory-specific constraints govern these revisions, while numerical optimization and validation-based evaluation regulate utility updates. This ensures that each agent retains its theory-specific choice formulation throughout iterative optimization.
The optimized agents preserve distinct theoretical structures across demographic groups. For example, on SWM, Group 2 (age < 39, income < 50k) learns linear time–cost utilities under MNL, with a car-availability coefficient of 2.42. MXL instead introduces nonlinear cost transformations and trip-purpose heterogeneity (SD = 0.41). In Group 9 (age > 65, income 50–100k), MXL learns demographic interactions and greater trip-purpose heterogeneity (SD = 3.80). PT retains reference-dependent valuation (α = 0.54, β = 0.44, λ = 1.60), with opposite travel-pass effects for Train (+2.75) and Swissmetro (−2.84). PCL learns logarithmic fares and mode-specific attributes. Theory-specific utility structures remain distinguishable after optimization.
(b) Interaction between symbolic predictions and LLM reasoning.
LLM decisions primarily follow theory-guided predictions while retaining flexibility for contextual adjustments. We examine cases where symbolic utility predictions conflict with contextual predictions across all four theory-guided agents in following table. Such conflicts occur in 66.2% of cases. The final LLM follows the theory in 71.0% of these cases, compared with 19.8% following the context and 9.2% selecting another alternative. Theory-following rates exceed 66% for all four theories.
Table: Conflict resolution between symbolic and contextual predictions. Conflict rate denotes the proportion of cases where the two predictions differ. Follow Theory, Follow Context, and Other are calculated among conflict cases.
| Theory | Conflict | Follow Theory | Follow Context | Other |
|---|---|---|---|---|
| MNL | 64.2% | 76.8% | 16.5% | 6.8% |
| MXL | 68.4% | 66.8% | 22.4% | 10.8% |
| PT | 68.0% | 73.0% | 16.5% | 10.5% |
| PCL | 64.1% | 67.6% | 23.9% | 8.5% |
| Overall | 66.2% | 71.0% | 19.8% | 9.2% |
We further compare symbolic and final LLM prediction accuracy in the following table. Across five datasets, symbolic predictions achieve 57.4% accuracy, which increases to 63.3% after LLM reasoning. When symbolic predictions are correct, the LLM preserves the correct decision in 91.3% of cases. When symbolic predictions are incorrect, the LLM corrects 25.6% of these errors. Beneficial corrections (10.9%) substantially exceed harmful changes (5.0%), resulting in a net accuracy gain of 5.9 percentage points.
Table: Symbolic–LLM prediction consistency. CC/CW/WC/WW denote correctness combinations; net gain is LLM accuracy minus symbolic accuracy (percentage points).
| Task | CC | CW | WC | WW | Net gain |
|---|---|---|---|---|---|
| ALC | 36.4% | 6.3% | 18.1% | 39.2% | +11.8 |
| JOB | 55.0% | 4.1% | 11.7% | 29.2% | +7.6 |
| MAJ | 50.6% | 6.4% | 10.9% | 32.1% | +4.5 |
| SWM | 54.9% | 6.0% | 10.7% | 28.4% | +4.7 |
| VAC | 64.9% | 2.3% | 2.9% | 29.9% | +0.6 |
| Overall | 52.4% | 5.0% | 10.9% | 31.7% | +5.9 |
These findings reveal how symbolic and contextual reasoning complement each other in L2AO. Theory-derived predictions provide a behavioral foundation that is largely preserved by the LLM, while contextual reasoning allows the model to revise symbolic predictions when additional information supports a different choice. As a result, Theory guidance informs final predictions without rigidly determining every choice, providing measurable theoretical grounding while retaining the flexibility of LLM reasoning.
These analyses are now included in Section 4.3 of the revised manuscript.
We would like to kindly follow up on our rebuttal and the revised manuscript. We have addressed both concerns regarding citation accuracy and the role of decision theory in LLM decision-making.
We would greatly appreciate your feedback on whether these revisions have adequately addressed your concerns. If any questions remain, we would be happy to clarify or discuss them further. Thank you again for your time and valuable feedback.
We sincerely thank the reviewer for their time and thoughtful comments.
We thank the reviewer for identifying this error and sincerely apologize for the inaccurate attribution.
We carefully reviewed the original paper and manually imported its citation metadata from Google Scholar. However, during a subsequent round of AI-assisted language polishing and formatting, the author list was inadvertently altered to include nonexistent authors. Because the reference contained a long author list and the incorrect names appeared in the middle, we unfortunately overlooked these changes during our final manual verification before submission.
The error was limited to the author list. The cited paper itself, including its title, publication information, and DOI, was correctly identified. We take full responsibility for this oversight and have corrected the reference metadata in the revised manuscript. We sincerely apologize for this error and appreciate the reviewer for bringing it to our attention.