Papers by Jahna Otterbacher
EU DisinfoTest: a Benchmark for Evaluating Language Models’ Ability to Detect Disinformation Narratives (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Disinformation narratives can be deceptive and disinformative, designed to sow division, distrust, and fear. |
| Approach: | They propose to evaluate the efficacy of Language Models in identifying disinformation narratives using a Human-in-the-Loop methodology. |
| Outcome: | The EU DisinfoTest evaluates language models on their ability to perform zero-shot classification of disinformation narratives versus credible narratives. |