Nuanced Toxicity Detection in Spanish: A New Corpus and Benchmark Study (2026.findings-eacl)
Copied to clipboard
Alba María Mármol-Romero, Robiert Sepúlveda-Torres, Estela Saquete, María-Teresa Martín-Valdivia, L. Alfonso Ureña
| Challenge: | Existing corpora for Spanish are under-resourced for toxic content detection . sarcasm, indirect aggression, irony, and other toxicity are not detected in English . |
| Approach: | They propose to extend the NECOS-TOX corpus to include 4,011 Spanish comments . each comment is annotated across three levels of toxicity, with substantial inter-annotator agreement . |
| Outcome: | The proposed model performs on par with larger models and is released publicly . the proposed model is based on a human-in-the-loop active learning strategy . |
Similar Papers
Toxic Language Detection in Social Media for Brazilian Portuguese: New Dataset and Multilingual Analysis (2020.aacl-main)
Copied to clipboard
| Challenge: | Hate speech and toxic comments are a common concern of social media platform users . identifying toxic comments is important for studying and preventing the proliferation of toxicity in social media. |
| Approach: | They propose to use Brazilian Portuguese to analyze toxic or non-toxic tweets . they propose to analyze tweets as toxic or in different types of toxicity . |
| Outcome: | The proposed model achieves 76% macro-F1 score using monolingual data in the binary case. |
Toxicity in Multilingual Machine Translation at Scale (2023.findings-emnlp)
Copied to clipboard
Marta Costa-jussà, Eric Smith, Christophe Ropers, Daniel Licht, Jean Maillard, Javier Ferrando, Carlos Escolano
| Challenge: | In this paper, we evaluate and analyze added toxicity when translating a large dataset from English into 164 languages. |
| Approach: | They evaluate added toxicity when translating a large dataset from English into 164 languages. |
| Outcome: | The results show that added toxicity is more prevalent in low-resource languages than in high-resolution translations. |
Enhancing LLM-based Hatred and Toxicity Detection with Meta-Toxic Knowledge Graph (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to address toxicity issues with large language models are inadequate . lack of domain-specific knowledge leads to false negatives and excessive sensitivity to toxic speech limits freedom of speech. |
| Approach: | They propose a method that leverages graph search on a meta-toxic knowledge graph to enhance hatred and toxicity detection. |
| Outcome: | The proposed method lowers false positive rate and improves toxicity detection performance in out-of-domain scenarios. |
A Survey of Toxicity Mitigation Strategies for Multilingual Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models can reproduce and amplify toxic content, including hate speech, harassment, and bias. |
| Approach: | They propose a comprehensive survey of the many detoxification methods tailored to multilingual LLMs. |
| Outcome: | The proposed methods are based on data filtering, style transfer, expert-based logit steering, retrieval augmentation, and human feedback. |
New Terms, New Toxicity: Consensus-based Chinese Neologism Toxicity Detection via Search-Augmented LLMs (2026.acl-long)
Copied to clipboard
Shiyao Cui, QingLin Zhang, Di Wang, Yida Lu, Zhexin Zhang, Jinhua Gao, Jinglin Yang, Min He, Han Qiu, Minlie Huang
| Challenge: | Neologisms can foster new linguistic consensus by stabilizing shared meanings and usage in common communicative norms. |
| Approach: | They propose a taxonomy that captures the origins and consensus-verification criteria of toxic neologisms . they propose 'SeTox' framework that integrates real-time web context for naeologim detection . |
| Outcome: | The proposed framework outperforms large-scale models in detecting neologism toxicity. |
Can LLMs Recognize Toxicity? A Structured Investigation Framework and Toxicity Metric (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing toxicity metrics rely on encoder models trained on specific toxicity datasets, which are susceptible to out-of-distribution (OOD) problems and depend on the dataset’s definition of toxicity. |
| Approach: | They propose a robust metric grounded on LLMs to flexibly measure toxicity according to the given definition by analysing toxicity factors and intrinsic toxic attributes. |
| Outcome: | The proposed metric improves on conventional metrics by 12 points in the F1 score and shows that upstream toxicity significantly influences downstream metrics, suggesting that LLMs are unsuitable for toxicity evaluations within unverified factors. |
Realistic Evaluation of Toxicity in Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | a large amount of data exposes large language models to toxicity and bias . prompt engineering can be easily bypassed with minimal prompt engineering. |
| Approach: | They propose a dataset that uses manually crafted prompts to nullify protective layers of large language models. |
| Outcome: | The proposed dataset shows that prompts can nullify protective layers of large language models. |
MuTox: Universal MUltilingual Audio-based TOXicity Dataset and Zero-shot Detector (2024.findings-acl)
Copied to clipboard
Marta Costa-jussà, Mariano Meglioli, Pierre Andrews, David Dale, Prangthip Hansanti, Elahe Kalbassi, Alexandre Mourachko, Christophe Ropers, Carleigh Wood
| Challenge: | Existing studies on text-based toxicity detection for other languages are limited, especially for languages other than English. |
| Approach: | They propose a multilingual audio-based toxicity classifier which covers 14 different linguistic families and a dataset of 20,000 audio utterances for English and Spanish. |
| Outcome: | The new classifier improves F1-Score by an average of 100% when compared to existing wordlist-based classifiers. |
ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detection (2022.acl-long)
Copied to clipboard
| Challenge: | Toxic language detection systems often falsely flag text that contains minority group mentions as toxic . this over-reliance on spurious correlations also causes systems to struggle with detecting implicitly toxic language. |
| Approach: | They develop a machine-generated dataset of toxic and benign statements about 13 minority groups that generates subtly toxic and harmless text with a massive pretrained language model. |
| Outcome: | The proposed method can detect toxic and benign statements on a large scale . it can also detect hate speech on 94.5% of the toxic examples . |
♪ Something Just Like TRuST ♪ *: Toxicity Recognition of Span and Target (2026.findings-acl)
Copied to clipboard
| Challenge: | Toxic language is pervasive online, and because LLMs are trained on web data, it generates such content. |
| Approach: | They propose a large-scale dataset that synthesizes toxicity definitions and an annotation scheme . they use a rigorous human annotation process to evaluate the diversity of the annotations . |
| Outcome: | The proposed model outperforms existing models on three tasks and is not reliable. |