- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2(+1)
- Soundness
- 2
Read review
Paper summary
This paper proposes a pretrained framework for prior-amortized Bayesian inference in GLMMs to achieve fast inference.
Critical strengths
- The paper provides a comprehensive solution to the proposed problem, with extensive experiments that support its effectiveness.
Critical weaknesses
- The practical need of the proposed pretrained model is not sufficiently justified.
Questions for authors
- My major concern is the practical need of the proposed method. The paper shows computational gains over NUTS, but it remains unclear to what extent the computational cost of posterior inference is a bottleneck in empirical studies. In my opinion, research design, data collection, and model specification may be considerably more time-consuming. Could the authors identify concrete examples from published empirical studies where the computational cost of NUTS (or other Bayesian inference method for GLMMs) has substantially constrained the analysis, thereby motivating the need for this project?
- The first paragraph, as well as Appendix F.1, reports that about half of the surveyed papers use GLMMs. However, it is unclear what proportion actually use Bayesian inference. Since the proposed method specifically targets Bayesian GLMM inference, this is important for assessing its practical relevance.
- The writing could be improved, particularly in the Abstract, by reducing the use of “;” to connect independent sentences.
3 comments
Response to authors
I thank the authors for the responses and additional experiments. The presented examples demonstrate the practical value of the proposed method. These efforts address my main concern. The response has strengthened my assessment of the paper, and I have raised my rating.
Thank you very much for going through our response and for raising your score! We believe, your request has strengthened the practical argument of our paper.
Practical need, Bayesian share and readability
Thank you for the encouraging review. We are glad you see MetaBeta (MB) as "a comprehensive solution" and appreciate our "extensive experiments that support its effectiveness". All changes are marked green in the revised PDF.
Q1
Published studies report cutting their analyses because NUTS was too slow:
The revision cites more cases in Sec. 1 and App. G.1.
Two of the stages you name are themselves many-fit workflows: research design includes power analysis, which needs to refit the model on thousands of simulated datasets for GLMMs [4]. Model specification includes model comparison and prior sensitivity analysis. MB cuts these from days or hours to minutes or seconds:
The power analysis is a new experiment (App. D.3). Suppose half of m schools get an educational program, 20 students per school pass or fail, and we study the effectiveness of the program with the model
passed ~ program + (1 | school). How many schools does the study need in order to detect an effect? Following the standard simulation-based procedure [4, 5], we fit 1,000 simulated trials per study design under a weakly informative and a skeptical prior. Then we count how often the 95% credible interval of the effect excludes zero. MB's power curves match those of NUTS and show that 80% power requires 40-60 schools under either prior. Finding this out after sampling too few (or unnecessarily many) schools translates to substantial delays to conducting such a study.Q2
About one in seven: 14% of the surveyed GLMM papers report a Bayesian analysis, and 12% of citations to GLMM software packages went to the Bayesian ones in 2025 (App. G.1). We believe the share would be higher if Bayesian inference were faster, since runtime is a common reason to avoid it: "A frequent objection that we encounter to the type of Bayesian analyses we have presented here [...] is that the workflow is very time-consuming compared to a frequentist analysis" [3].
Q3
Thanks for bringing this up. We dropped semicolons from the abstract to split independent sentences. We also split 14 other sentences in the main text in a similar spirit. Happy to take further pointers on hard to read sentences or passages.
Thank you again for pushing us to make the practical case more explicit. Does the evidence above address your concern about the practical need?
References