| Challenge: | a new corpus of responses to hate speech is developed to counter hate speech . authors work with real, user-generated hate speech and all the replies it elicits . counterspeech refers to a "direct response that counters hate speech" |
| Approach: | They propose a taxonomy of responses to hate speech and a new corpus to analyze responses . they find that responses to user-generated hate speech are more effective than replies generated by a third party . |
| Outcome: | The proposed taxonomy of responses to hate speech and a new corpus provide insights into content real users reply with and which replies are empirically most effective. |
Similar Papers
NLP for Counterspeech against Hate: A Survey and How-To Guide (2024.findings-naacl)
Copied to clipboard
| Challenge: | Recent studies have focused on the challenges of analysing, collecting, classifying, and automatically generating counterspeech, to reduce the huge burden of manually producing it. |
| Approach: | They propose a guide for doing research on counterspeech, with detailed examples and best practices that can be learnt from the NLP community. |
| Outcome: | The proposed strategies can reduce online and offline violence while preserving the freedom of speech of the users. |
Beyond Denouncing Hate: Strategies for Countering Implied Biases and Stereotypes in Language (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Counterspeech, i.e. responses to counteract potential harms of hateful speech, has become an increasingly popular solution to address online hate speech without censorship risks of deletion-based content moderation. |
| Approach: | They draw from psychology and philosophy literature to craft six psychologically inspired strategies to challenge the underlying stereotypical implications of hateful language. |
| Outcome: | The strategies used in human- and machine-generated counterspeech datasets are convincing, whereas human-written counterspech uses less specific strategies compared to machine-produced counters. |
Generate, Prune, Select: A Pipeline for Counterspeech Generation against Online Hate Speech (2021.findings-acl)
Copied to clipboard
| Challenge: | Off-the-shelf methods to generate hate speech are limited in that they generate repetitive and safe responses regardless of the hate speech. |
| Approach: | They propose a three-module pipeline approach to generate diverse and relevant counterspeech . they first generate various counterspeak candidates by a generative model, then filter ungrammatical ones using a BERT model . |
| Outcome: | The proposed pipeline generates diverse and relevant counterspeech responses on three datasets. |
Outcome-Constrained Large Language Models for Countering Hate Speech (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing research focuses on generating counterspeech with linguistic attributes such as being polite, informative, and intent-driven. |
| Approach: | They develop automatic counterspeech generation methods that incorporate two desired conversation outcomes into the text generation process: low conversation incivility and non-hateful hater reentry. |
| Outcome: | The proposed methods incorporate two desired conversation outcomes: low conversation incivility and non-hateful hater reentry. |
Assessing the Human Likeness of AI-Generated Counterspeech (2025.coling-main)
Copied to clipboard
| Challenge: | Existing studies have focused on relevance, surface form, and other shallow linguistic characteristics. |
| Approach: | They propose to evaluate the human likeness of AI-generated counterspeech . they implement and evaluate several LLM-based generation strategies . |
| Outcome: | The proposed models show that human-written counterspeech can be distinguished by both simple classifiers and humans. |
Latent Hatred: A Benchmark for Understanding Implicit Hate Speech (2021.emnlp-main)
Copied to clipboard
Mai ElSherief, Caleb Ziems, David Muchlinski, Vaishnavi Anupindi, Jordyn Seybolt, Munmun De Choudhury, Diyi Yang
| Challenge: | Existing studies on explicit or overt hate speech have failed to address a more pervasive form based on coded or indirect language. |
| Approach: | They propose a theoretically-justified taxonomy of implicit hate speech and a benchmark corpus with fine-grained labels for each message and its implication. |
| Outcome: | The proposed dataset will serve as a useful benchmark for understanding this multifaceted issue. |
Is Safer Better? The Impact of Guardrails on the Argumentative Strength of LLMs in Hate Speech Countering (2024.emnlp-main)
Copied to clipboard
| Challenge: | Automated responses lack argumentative richness which characterises expert-produced counterspeech. |
| Approach: | They propose to automate counterspeech generation by investigating tension between helpfulness and harmlessness of LLMs and to assess whether presence of safety guardrails hinders quality of generations. |
| Outcome: | The proposed approach produces more cogent responses that lack argumentative richness which characterises expert-produced counterspeech. |
Generating Counter Narratives against Online Hate Speech: Data and Strategies (2020.acl-main)
Copied to clipboard
| Challenge: | Hate Speech (HS) is a pervasive issue that spreads quickly and widely . research has focused on avoiding undesired effects that come with content moderation . |
| Approach: | They propose to use large scale unsupervised language models to generate responses to hate effectively using large scale models. |
| Outcome: | The proposed methods lack quality data and produce generic/repetitive responses. |
CSEval: Towards Automated, Multi-Dimensional, and Reference-Free Counterspeech Evaluation using Auto-Calibrated LLMs (2025.naacl-long)
Copied to clipboard
| Challenge: | Current evaluation methods do not capture complex attributes of counterspeech quality, such as contextual relevance, aggressiveness, or argumentative coherence. |
| Approach: | They propose to use a dataset and framework to evaluate counterspeech quality across four dimensions: contextual relevance, aggressiveness, argument-coherence, and suitability. |
| Outcome: | The proposed method outperforms ROUGE, METEOR, and BertScore in correlating with human judgement, indicating a significant improvement in automated counterspeech evaluation. |
NLP for Counterspeech against Hate and Misinformation (CSHAM) (2025.acl-tutorials)
Copied to clipboard
| Challenge: | tutorial aims to show how counterspeech is used to tackle abuse and misinformation by individuals, activists and organisations. |
| Approach: | tutorial aims to show how counterspeech is currently used to tackle abuse and misinformation . will also show how Natural Language Processing (NLP) and Generation (NLG) can be applied to automate its production. |
| Outcome: | The tutorial will bring diverse multidisciplinary perspectives to safety research . case studies from industry and public policy will be included . |