- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes the truthfulness spectrum for investigating how truth directions generalize across domains. The authors evaluate probe generalization across multiple truth categories. Extensive analyses show that domain-general and domain-specific detection directions can coexist, therefore reconciling prior seemingly conflicting findings and further characterizing truth directions on a spectrum, with directions of varying generality coexisting.
Critical strengths
- The analysis in this paper helps researchers understand the generalization of using probes to detect the truthfulness of content generated by LLMs. It reveals the coexistence and mechanisms of both domain-general and domain-specific truth directions, offering valuable insights for future research.
- The datasets employed cover a diverse range of "truth" types, including basic epistemological truth types, sycophantic lying, expectation-inverted scenarios, and existing honesty benchmarks.
Critical weaknesses
- Although the analysis covers a variety of truth types, the type selection process appears somewhat arbitrary—combining epistemological truth types and existing honesty benchmarks with a few additional types conceived by the authors. The paper would be more robust if the authors had first established a formal taxonomy of "truth" based on epistemological or other theoretical frameworks, and subsequently constructed datasets for analysis derived from that taxonomy.
- As the authors acknowledge in the limitations, this study focuses exclusively on linear structures, testing three types of probe architectures: Difference of Means, Logistic Regression, and Linear Discriminant Analysis. The final experiments were conducted using a specific configuration—layer 33, logistic regression, and training on averaged tokens—which to some extent limits the generalizability of the findings.
Questions for authors
None
2 comments
Thanks for your response. I have no further questions.
We thank the reviewer for the positive review! We are glad that you find that "the coexistence and mechanisms of both domain-general and domain-specific truth directions" offers "valuable insights for future research", and that our datasets "cover a diverse range of truth types".
We aimed to stress-test generality across deliberately diverse notions of truthfulness (L129–130). The truth types in one paper are unlikely to be exhaustive, as we note in the Limitations. Our FLEED follows well-established philosophical distinctions in the domain of truth (Kant; Hume; Quine 1951; Lewis 1978; Wright 1992). The remaining datasets vary along other axes: whether the statement is the model's own generation (on-policy), whether truth is objective or relative to the user's expectation, and where the pressure to lie comes from.
We will add the epistemological paper citations and add a table organizing the ten datasets along these axes, so the selection is easier to follow.
Our main probe configuration was selected by cross-domain performance (App. B), but we test the main findings well beyond the main configuration: using LDA and difference-of-means (Figs. 19, 20), across layers and token aggregation (Figs. 12, 13, 27), model families (Figs. 15, 22), and various datasets (Figs. 16, 17, 18).
Reference
We hope these responses address your concerns. Thank you again for your positive assessment!