- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper asks whether selecting fine-tuning examples that the model already answers correctly preserves reliable abstention. Its premise is that observed abstention, the ranking of unreliable answers, and the separation of known and unknown questions can change in different ways. Refusal rate is therefore an incomplete evaluation of factual adaptation.
The study uses closed-book PopQA and TriviaQA, three instruction-tuned model families, and 72 training runs across three adapter ranks. Repeated initial-model answers define historical known and unknown question panels. The known-fact, unknown-fact, and high-loss known-fact arms share an answer-only objective. Held-out question trajectories distinguish lost correct answers from abstentions that become errors.
Known-fact training converts many prior abstentions into incorrect answers: 57.72% of the unknown panel in Llama and 27.69% in Qwen. Unknown-fact training adds 14.53 and 12.17 points of correct-to-error transitions over known-fact training in Llama and Qwen, respectively. OLMo's lower final accuracy mainly reflects a smaller improvement from a highly abstaining start. Qwen nearly stops abstaining under both arms (0.44% and 0.03%). Yet its abstention score separates current answer correctness with AUROC values of 0.873 and 0.426 on PopQA under one prompt, and 0.880 and 0.596 under another. At rank 16, fixed and refit hidden-state classifiers show that historical-label transfer depends on the elicitation prompt.
The paper is diagnostic. It offers no new training objective or validated mitigation. It also states that its known/unknown contrast does not isolate unknownness from other properties of the selected facts.
Critical strengths
-
The transition breakdown separates where new errors come from, which final accuracy cannot do.Final accuracy cannot distinguish losing a correct answer from switching from abstention to a wrong guess. For each question, the paper compares the base model response with the checkpoint response. It then counts transitions such as abstain-to-wrong and right-to-wrong. It uses the whole panel as the denominator, so the counts sum to the total change in errors. The authors verify this sum on all 768 rank-16 panels. The method only needs saved responses, so it is cheap to reuse.
-
The paper attributes an accuracy gap to the model's starting behavior, not to the size of the drop.The same accuracy drop can mean very different things. In Llama and Qwen, it reflects real damage: previously correct answers turn wrong. This right-to-wrong movement is 14.53 and 12.17 points higher than in K-SFT. OLMo's base model abstains on 92.58% of its own K₀ questions. These questions had passed the correct-answer criterion. Thus OLMo's lower U-SFT accuracy mostly means it started low and climbed less. It has only 0.58 points of extra right-to-wrong movement. Reading a gap in this way generalizes beyond these three models.
Critical weaknesses
The paper identifies several metrics behind abstention frequency but does not say how to combine them or what they imply for subsequent training.
Questions for authors
Q1. If a practitioner has computed all three metrics and they conflict, as with the probe at 0.896 and s_IDK at 0.437 on the same checkpoint, which should take precedence when deciding whether to add explicit abstention training? Should this depend on model or dataset, and if so, how should that dependence be handled in practice?
Q2. Concretely, how should these three metrics be used to improve a subsequent training run? Should they guide data selection, determine when to stop, or decide between filtering alone and filtering plus abstention supervision? A worked example on one of the three model families would clarify the intended use.
I am maintaining my scores due to the lack of response from the authors.