Papers by David Atkinson
What Gets Echoed? Understanding the “Pointers” in Explanations of Persuasive Arguments (D19-1)
Copied to clipboard
| Challenge: | Explanations are central to everyday life, and are a topic of growing interest in the AI community. |
| Approach: | They propose a word-level prediction task to investigate how explanations selectively reuse information from what is being explained. |
| Outcome: | The proposed features have strong predictive power on the echoing of a word in an explanation, and enhance neural methods of generating explanations. |
Token Erasure as a Footprint of Implicit Vocabulary Items in LLMs (2024.emnlp-main)
Copied to clipboard
| Challenge: | Current language models process text as sequences of tokens that roughly correspond to words . individual tokens are often semantically unrelated to the meanings of the words/concepts they comprise . |
| Approach: | They propose a method to "read out" the implicit vocabulary of an autoregressive LLM by examining differences in token representations across layers. |
| Outcome: | The proposed method "reads out" the implicit vocabulary of an autoregressive LLM by examining differences in token representations across layers. |