Papers by Shannon Spruit
SafetyKit: First Aid for Measuring Safety in Open-domain Conversational Systems (2022.acl-long)
Copied to clipboard
| Challenge: | Several studies discuss the potential harms and benefits of large language models (LLMs) large neural models can replicate and even amplify negative, stereotypical, and derogatory associations in the data. |
| Approach: | They propose to use a first aid kit to assess the safety of conversational AI in various settings . they propose several future directions and discuss ethical considerations . |
| Outcome: | The proposed tools can provide estimates of the relative safety of systems in various settings, but they still have several shortcomings. |