- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes a post-training objective to reduce hallucination in short-answer QA. A frozen base model greedily answers each training prompt, and answers judged different from the gold answer are kept as negatives. The loss compares answer-level cross-entropy on the gold answer and on the model's own wrong answer. It is applied only when the margin falls below a threshold, uses a bounded gate on the deficit. Evaluation covers cross-dataset transfer, with ablations over hyperparameters, layers, seeds, backbones and judges.
Critical strengths
S1. Training one layer for 100 steps adds no inference cost and leaves general ability intact. The preference baselines use the same negative pool, so the comparison isolates the objective from the data.
S2. Reporting various metrics make the trade-off visible. The DROP to HaluEval-QA gain is stable across seeds.
Critical weaknesses
W1. The premise "the model knows but is misaligned" is never operationalized. Because is the model's own greedy output, holds almost automatically, whether or not the model knows the answer. No known/unknown split is made.
W2. The metric is error rate, not hallucination. Any mismatch with the gold answer is labeled HALLUCINATED, so the reported rate is roughly 1 − accuracy.
W3. The objective can only swap one answer for another, and no calibration or abstention metric is reported, even though Section 2.3 criticizes abstention-based methods.
W4. The net improvement over the base model is small, about 1.7% (DROP) and 1.1% (HotpotQA) of the evaluation set, and the gap to the baselines is under 1 pp in the HaluEval-trained setting.
W5. The same main configuration reports inconsistent numbers: Net 158, 189, 179 and 181 across Tables 1, 3/4a, 5 and 6a.
W6. Trainable parameters, number of steps and /learning rate are not given for SFT, DPO, ORPO or KTO.
W7. Qwen judges its own outputs. Other judges shift absolute rates by 6–24 pp.
W8. , so the most confidently wrong samples receive the weakest updates. This is not discussed.
Questions for authors
See weaknesses. I would be happy to improve my score if my questions (especially for W1, W3, W4, and W8) could be reasonably resolved.