- Rating
- 2
- Confidence
- 1
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper investigates whether simple features of answer wording predict correctness in truthfulness benchmarks. It proposes six surface features and an iterative filtering procedure that removes question pairs reinforcing these associations. Applied to binary-choice TruthfulQA, the procedure produces a smaller subset on which the surface classifier performs close to random. Additional experiments examine other benchmarks and robustness to reversed surface cues.
Critical strengths
- The paper addresses a relevant problem using a simple, interpretable diagnostic.
- The release of a filtered benchmark provides practical value.
Critical weaknesses
- The conceptual and methodological contribution seems modest to me. The approach combines a small set of hand-designed features, logistic regression, and greedy filtering.
- The justification for treating the detected associations as undesirable bias is not fully convincing. TruthfulQA targets misconceptions, so correct answers may naturally contain more negation. Demonstrating that negation predicts correctness does not by itself establish that removing this association improves the intended evaluation.
- Near-chance performance on a filtered dataset provides little evidence that the resulting subset is a better truthfulness benchmark overall.
Questions for authors
-
What criterion distinguishes an unwanted surface artifact from a legitimate property of a misconception-focused task?
-
Can the authors provide independent evidence, beyond the targeted six-feature audit, that filtering improves evaluation validity without removing important aspects of the task?
4 comments
Thanks for the constructive comments. I do appreciate it.
Thank you
Thank you for your kind reply. If our answers have resolved your concerns, we would appreciate it if you would consider revisiting your score.
I do appreciate the clarifications you made although my view on the work has not changed much. My main concerns, which were (1) the removal of negation is debatable while (2) the overall contribution significance seems limited, somewhat remain.
However, I have to admit that I am no expert in this particular area and I am open to increasing my rating of your submission, if the other PC members and the AC (who hopefully are experts) believe it makes sense to do.
Response to Reviewer GpHa
Q1 — Criterion: artifact vs legitimate property
The goal of many well-known dataset tasks is to evaluate proper reasoning, such as evaluating the truth of a statement. Starting an answer with "No ..." does not imply it should be more truthful. In the case of TruthfulQA its statistical correlation is a construct of the phrasing of responses about misconceptions.
We demonstrate specifically how this can be exploited in the Surface-Inversion Generalization Test (Sec 3.3), and the generative extension in Appendix L.
The Surface6 features all have correlation with the TruthfulQA responses, and specifically do not address the core task (Truthfulness).
So you are right, this is an important question. And extending these Surface features to other datasets and reasoning tasks will require care and (for now) human judgement to determine if there is a definitional or only surface-statistical relationship to the task intended to be measured. A practical test is the one we use: move the cue to the other answer, keep the question and the labels fixed, and see whether model choices change.
Q2 — Independent evidence that filtering improves validity
(a) The Surface-Inversion test (Section 3.3, Table 3): classifiers trained on TruthfulQA-476 transfer better to the inverted cohort (significant for four of nine encoders).
On the natural cohort the reported tests detect no significant difference, though the cohort is small and seven of nine point estimates are lower, so we claim no more than "no detected change".
A generative extension shows similar results in Appendix L.
(b) On 16 embedding classifiers never used in pruning (see reply to j8yP Q1) and 300 surface features proposed by four LLMs (see reply to D77L W3), TruthfulQA-476 is less predictable than a size-matched random subset.
(c ) Question difficulty and ranking are retained, as well as coverage. Specifically we keep:
Moreover, our methodology (surface features and AuditPrune) can be used as part of the creation process for new datasets. There the goal is to prevent the sort of explicitly identified leakage before these datasets become part of the substrate.
W1 — Contribution seems modest
We intentionally built our method on standard classic tools because they work. We did not add complexity for complexity's sake.
The contribution is in the problem identification, the careful combination of such tools, and the experimental design and demonstrations.