- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper studies two post-training methods for LLMs to express uncertainty, which are verbalizing a confidence score after the answer and emitting an <uncertain> marker during reasoning. The authors show that confidence training improves calibration and that both uncertainty signals can support downstream tasks, such as selective retrieval to revise completed answers. Internal representations related to the uncertainty signals are further analysed.
Critical strengths
The paper explores a novel idea of generating an explicit uncertainty signal during the reasoning process through post-training.
Critical weaknesses
- The paper is hard to follow, and the overall structure should be better organized. For instance, the “Error coverage and precision” section mainly presents experimental results and would be more appropriate in the evaluation section rather than in the method section.
- The main experiments are mainly only based on Llama-3-8B-Instruct, which limits the strength of the general conclusions. Although the authors provided other model experiments, but these are mostly single run replications.
- Some of the claimed contributions appear too broad and are not sufficiently separated from prior work. For instance, training models to verbalize confidence has already been studied. The paper should more clearly distinguish what has already been established and what is newly contributed here.
- In the downstream retrieval task, the retrieval decision is made only after the first response has been completed. Therefore, the experiments do not actually evaluate the practical advantage of emitting the <uncertain> marker during reasoning.
Questions for authors
- How were the reward values 5.0, 3.5, and -2.0 in Equation (6) selected? How sensitive are the results to these choices?
- When the model emits <uncertain> during reasoning, does the marker itself influence the subsequent reasoning or final answer?
- Why is timing of warning not included in the reward function?