Papers by Dylan Hadfield-Menell
Cognitive Dissonance: Why Do Language Model Outputs Disagree with Internal Representations of Truthfulness? (2023.emnlp-main)
Copied to clipboard
| Challenge: | Past work has found that query–probe disagreements occur in situations where either probes or queries are uncertain. |
| Approach: | They propose to identify three different classes of disagreement, which they term confabulation, deception, and heterogeneity. |
| Outcome: | The proposed methods are more accurate than LM outputs and better on uncertain answers than queries and probes. |