Papers with LLMs-as-Raters
Do Large Language Models Reflect Demographic Pluralism in Safety? (2026.findings-eacl)
Copied to clipboard
Usman Naseem, Gautam Siddharth Kashyap, Sushant Kumar Ray, Rafiq Ali, Ebad Shabbir, Abdullah Mohammad
| Challenge: | Existing datasets that focus on demographics and safety are narrow in their annotator pools. |
| Approach: | They propose to decouple value framing from responses by modeling pluralism directly at the prompt level. |
| Outcome: | Demo-SafetyBench decouples value framing from responses to model pluralism at the prompt level. |