- Rating
- 2(+1)
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces Model Priming, a simple method that utilizes small model and large model together to save computation. Specifically, the large model simply generates a fixed number of tokens first, and then the small model continues to generate after that point. The performance evaluations showcase that the overall performance interpolates between the two models’ performance with varying amount of tokens written by the large model.
Critical strengths
The approach is extremely simple and straightforward, and empirically shows some performance preservation with notable cost reduction.
Critical weaknesses
The paper lacks comparisons with relevant baselines. There is a large body of prior work on utilizing small and large models together to improve efficiency, but the paper compares against only a few, primitive approaches. For example, COPE [1] uses a large model as a planner, and a small model as executor. This closely matches with the paper’s setup of a large model generating a small amount of text and the small model continues generating, as the large model can generate a concise plan and a small model could execute it. Other examples may include works like SpecReason [2], where large and small models collaborate to improve efficiency while preserving or even improving performance. Comparisons against existing state-of-the-art methods are necessary in order to claim that the given performance preservation at the given cost is meaningful.
Furthermore, the paper lacks analysis on why priming works, only providing speculative explanations. Without them, the paper would not provide sufficient insights to add to the community.
[1] Efficient LLM Collaboration via Planning, TMLR 2026
[2] SpecReason: Fast and Accurate Inference-Time Compute via Speculative Reasoning, NeurIPS 2025
Questions for authors
Could the authors provide comparisons with other state-of-the-art baselines, and a deeper analysis about why model priming works well?