- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper tries to answer whether LLMs can perform approximate Bayesian network in context. It is shown that, in general, LLMs violate Bayes' rule when updating their beliefs in context. They propose evaluating Bayesian inference in context along three sequential axes. They compare against a recent baseline.
While the paper is interesting and easy to read, it was not made clear why these results are significant. The findings of this paper are not precise or agree with commonsense.
p7 Result 1. ... modern reasoning LLMs generally satisfy basic probability axioms ...
Agree with commonsense. Generally, but not guaranteed.
p8 Result 2. Without reasoning, LLMs fail to perform accurate Bayesian inference in context ...
Agrees with commonsense. LLMs do not perform accurate Bayesian network inference.
p8 Result 3. Reasoning substantially improves the ability of LLMs to perform Bayesian inference in context ...
Agrees with commonsense. Adding tools improves LLM ability.
p8 Result 3. ... closer to the optimium ...
Closer to the optimimum is not precise.
p9 Result 4. With access to external tools such as code environments, modern LLMs can select appropriate tools for Bayesian inference ...
Not precise. Can, not will. Can it be quantified? How often?
p9 Result 5. For modern reasoning LLMs, the structured harness employed by recent belief-updating frameworks such as BED-LLM may no longer be necessary ...
Not precise. Previous methods might be needed or they might not be needed. Can it be quantified when the previous method is needed?
In short, everyone knows that LLM answers cannot be trusted. When using LLMs, there is always a disclaimer shown that LLMs can make mistakes. In Bayesian inference, I can trust the answer from an exact Bayesian inference algorithm. I can trust that the answer from an approximate Bayesian inference algorithm lies between the provided lower and upper bounds. But the results put forth in this paper appear to come with no guarantees.
Critical strengths
Pursuing accurate Bayesian inference using LLMs is a worthy topic.
Critical weaknesses
The 5 Results reported in this paper are not precise or they agree with common sense.
Questions for authors
Why should the five stated results be considered significant?
3 comments
W9: Result 5 is not precise. Can it be quantified when harnesses are needed?
R9: Thank you for pointing this out; we agree and updated the result accordingly, see again the changes in blue on page 9.
W10: Exact and approximate Bayesian inference algorithms come with guarantees, whereas the results in this paper appear to come with none.
R10: We fully agree that guarantees are essential, and we believe this is where our findings are most significant.
1. Given that there have not yet been found strong theoretical boundaries on LLM-based belief updates, we believe that our work is even more important to guide development and empirically verify current capabilities.
2. Our results, in particular the qualitative analysis in App. B, show that tool-augmented LLMs do not produce posteriors through opaque internal computation. One of our main findings is that they set up the probabilistic model explicitly, and either perform correct explicit analytical calculations or implement a standard Monte Carlo estimator. The resulting posterior is therefore the output of a classical inference algorithm and carries its usual guarantees. The question of trust therefore becomes significantly easier to verify by checking logs of the used tool, instead of having to treat the LLM's outputs as a blackbox.
In short: our findings show that LLM-based belief updates need not come without guarantees. LLMs are able to appropriately delegate computation to established inference algorithms, those algorithms' guarantees apply, and only the implemented procedure remains to be verified.
We hope these clarifications and the revised, quantified results address your concerns. Please let us know if any points remain unclear; we genuinely appreciate your time reviewing our work.
[2] Bartlett, Montanari and Rakhlin, “Deep Learning: A Statistical Viewpoint”, Acta Numerica, 2021.
[3] Fan, Ma and Zhong, "A selective overview of deep learning.", Statistical science: a review journal of the Institute of Mathematical Statistics 36.2, 2020.
[4] Freedman and Toni, "Exploring the potential for large language models to demonstrate rational probabilistic beliefs", In The International FLAIRS Conference, 2025.
[5] Li and Sreedhar, "Outcome-free arbitrage audits and coherence repairs for LLM forecasters", ICML 2026 Workshop on AI Forecasting, 2026.
[6] Mueller et al., "Transformers can do Bayesian inference", In International Conference on Learning Representations, 2022.
[7] Xie et al., "An explanation of in-context learning as implicit Bayesian inference", In International Conference on Learning Representations, 2022.
Follow-up
Dear Reviewer,
Thank you again for your review. We wanted to briefly follow up on our response, since the discussion period is coming to an end.
To summarize, we addressed your concerns as follows:
- Significance of the results: Our contribution is an empirical evaluation framework. LLMs are already used for belief updating in scientific discovery, but no theory yet says when their updates can be trusted. Systematic empirical evaluation fills that gap, much as benchmarks guided deep learning before theory caught up.
- Results vs. common sense: Several of our findings contradict or settle open questions in the literature. For example, prior audits found LLM probability judgments largely incoherent, whereas we show this incoherence mostly disappears within a single dialogue (Res. 1).
- Precision of Results 3–5: We agreed with this point and rephrased these results more precisely in the revised paper (highlighted in blue, p. 9).
- Guarantees: Our qualitative analysis (App. B) shows that tool-augmented LLMs explicitly set up the probabilistic model and either compute the posterior analytically or implement a standard Monte Carlo estimator. The resulting posteriors therefore inherit the guarantees of these classical algorithms. Only the implemented procedure needs to be verified, and that can be done by inspecting the tool logs.
We hope these clarifications and revisions address your concerns. If they do, we would be grateful if you would consider updating your score. If anything is still unclear, we are happy to discuss it further.
Best regards, The Authors
Thank you for your review! We appreciate that you found our paper interesting and clear and easy to follow, and that you have no substantive concerns about its soundness.
We are also glad that you consider pursuing accurate Bayesian inference with LLMs a worthy topic, and that from our work you learned something interesting and useful.
We address your concerns below.
Q6: Why should the five stated results be considered significant?
W5: Result 1 agrees with common sense.
W6: Result 2 agrees with common sense.
W7: Results 3 and 4 agree with common sense: adding tools to LLMs improves their performance.
W8: Results 3 and 4 are not precise enough.