Papers by Jeffrey Sorensen
Countering Hateful and Offensive Speech Online - Open Challenges (2024.emnlp-tutorials)
Copied to clipboard
Leon Derczynski, Marco Guerini, Debora Nozza, Flor Miriam Plaza-del-Arco, Jeffrey Sorensen, Marcos Zampieri
| Challenge: | a comprehensive understanding of the field is needed to maintain respectful and inclusive online environments. |
| Approach: | This tutorial aims to provide attendees with a comprehensive understanding of the field by delving into essential dimensions such as multilingualism, counter-narrative generation, a hands-on session with one of the most popular APIs for detecting hate speech, fairness, and ethics in AI, and the use of recent advanced approaches. |
| Outcome: | This tutorial aims to provide attendees with a comprehensive understanding of the field by delving into essential dimensions such as multilingualism, counter-narrative generation, a hands-on session with one of the most popular APIs for detecting hate speech, fairness, and ethics in AI, and the use of recent advanced approaches. |
Civil Rephrases Of Toxic Texts With Self-Supervised Transformers (2021.eacl-main)
Copied to clipboard
| Challenge: | et al., 2018a): a poor phrasing may make the conversation go awry. |
| Approach: | They propose a model that can help suggest rephrasings of toxic comments in a more civil manner. |
| Outcome: | The proposed model generates sentences that are more fluent and better at preserving the initial content compared to earlier systems and human evaluation. |
Toxicity Detection: Does Context Really Matter? (2020.acl-main)
Copied to clipboard
| Challenge: | Existing ‘toxicity’ detection datasets and models ignore the context of the posts, implicitly assuming that comments may be judged independently. |
| Approach: | They limit the notion of context to the previous post in the thread and the discussion title and focus on how it affects human judgement. |
| Outcome: | The proposed model can amplify or mitigate perceived toxicity of posts and a small but significant subset of manually labeled posts end up having the opposite toxicity labels if the annotators are not provided with context. |
From the Detection of Toxic Spans in Online Discussions to the Analysis of Toxic-to-Civil Transfer (2022.acl-long)
Copied to clipboard
| Challenge: | a dataset of English posts with annotations of toxic spans is released . sequence labeling models perform best, but rationale extraction methods are promising . |
| Approach: | They propose a dataset for toxic spans detection that includes an annotation of toxic posts . they propose to add generic rationale extraction mechanisms to the model to obtain toxic span information . |
| Outcome: | The proposed framework is based on a dataset of English posts with toxic span annotations . it shows that sequence labeling models perform best, but that rationale extraction methods are promising . |