David Dale, Anton Voronov, Daryna Dementieva, Varvara Logacheva, Olga Kozlova, Nikita Semenov, Alexander Panchenko
| Challenge: | Existing studies on text detoxification cast this task as style transfer . text detox requires better preservation of the original meaning, authors argue . |
| Approach: | They propose two unsupervised methods for eliminating toxicity in text . they use a paraphraser guided by style-trained language models to keep the text content . |
| Outcome: | The proposed methods yield new SOTA results. |
Similar Papers
Exploring Cross-lingual Text Detoxification with Large Multilingual Language Models. (2022.acl-srw)
Copied to clipboard
| Challenge: | Existing methods of textual style transfer are monolingual i.e. designed to work in one exact language. |
| Approach: | They propose to make large multilingual models capable of performing multilingual style transfer without direct fine-tuning in a given language. |
| Outcome: | The proposed model can generate text in a given language without fine-tuning and is able to perform cross-lingual detoxification without direct fine- tuning. |
Multilingual and Explainable Text Detoxification with Parallel Corpora (2025.coling-main)
Copied to clipboard
Daryna Dementieva, Nikolay Babakov, Amit Ronen, Abinew Ali Ayele, Naquee Rizwan, Florian Schneider, Xintong Wang, Seid Muhie Yimam, Daniil Alekhseevich Moskovskiy, Elisei Stakovskii, Eran Kaufman, Ashraf Elnagar, Animesh Mukherjee, Alexander Panchenko
| Challenge: | Existing approaches to manage toxic speech on social platforms are limited . however, there is a need for more proactive moderation of abusive speech. |
| Approach: | They extend parallel text detoxification corpus to new languages to test the approach . they propose a method that combines toxic and non-toxic sentences into a more neutral form . |
| Outcome: | The proposed method integrates the descriptive features of toxic and non-toxic sentences into a more neutral or non- toxic form. |
Text Detoxification: Data Efficiency, Semantic Preservation and Model Generalization (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for detoxification of text often rely on manually annotated data . xiangli: "detoxification of texts is a powerful way to remove toxic content" |
| Approach: | They propose a reinforcement learning framework that optimizes detoxification and semantic preservation without annotating large amounts of data. |
| Outcome: | The proposed method overcomes major limitations and surpasses humanannotated references across multiple benchmarks. |
A Survey of Toxicity Mitigation Strategies for Multilingual Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models can reproduce and amplify toxic content, including hate speech, harassment, and bias. |
| Approach: | They propose a comprehensive survey of the many detoxification methods tailored to multilingual LLMs. |
| Outcome: | The proposed methods are based on data filtering, style transfer, expert-based logit steering, retrieval augmentation, and human feedback. |
Challenges in Detoxifying Language Models (2021.findings-emnlp)
Copied to clipboard
Johannes Welbl, Amelia Glaese, Jonathan Uesato, Sumanth Dathathri, John Mellor, Lisa Anne Hendricks, Kirsty Anderson, Pushmeet Kohli, Ben Coppin, Po-Sen Huang
| Challenge: | Prior work often relies on automatic evaluation of LM toxicity. |
| Approach: | They evaluate toxicity mitigation strategies for automated and human evaluations . they find human raters disagree with high automatic toxicity scores after strong toxicity reduction interventions . |
| Outcome: | The proposed methods reduce LM toxicity but lower coverage for marginalized texts . human raters disagree with high toxicity scores after strong toxicity reduction interventions . |
To Paraphrase or Not: Efficient Comment Detoxification with Unsupervised Detoxifiability Discrimination (2026.eacl-short)
Copied to clipboard
| Challenge: | Existing methods for detoxification of toxic comments are limited by overcorrection and data scarcity . experimental results show that DID outperforms existing methods on academic data and an industrial platform . |
| Approach: | They propose a paradigm that adaptively conducts filtering or paraphrasing for each toxic comment based on its detoxifiability . they propose 'detoxifiabilities-aware detoxification' that can be trained to filter or paraphrase toxic comments based upon their detoxifikatability based only on detoxificable comments . |
| Outcome: | Experimental results show that DID outperforms existing methods on academic and industrial data. |
DetoxLLM: A Framework for Detoxification with Explanations (2024.emnlp-main)
Copied to clipboard
| Challenge: | DetoxLLM is a comprehensive end-to-end detoxification framework for toxic language. |
| Approach: | They propose a comprehensive end-to-end detoxification framework that tackles toxic language across platforms. |
| Outcome: | The proposed detoxification framework outperforms the SoTA model on human-annotated parallel corpus and offers explanation to promote transparency and trustworthiness. |
Detoxification for LLM: From Dataset Itself (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for large language models focus on post-training stage or inference time, while few tackle the source of toxicity, namely, the dataset itself. |
| Approach: | They propose to localize and rewrite toxic spans in raw corpora with SoCD, which guides an LLM to localized and preserving semantics while preserving toxicity. |
| Outcome: | The proposed method reduces TP from 0.42 to 0.18 and Expected Maximum Toxicity (EMT) from 0.43 to 0.20 on three LLMs. |
MultiParaDetox: Extending Text Detoxification with Parallel Data to New Languages (2024.naacl-short)
Copied to clipboard
| Challenge: | Text detoxification is a textual style transfer task where a toxic text is paraphrased to the neutral register. |
| Approach: | They propose to extend ParaDetox pipeline to multiple languages to automate parallel detoxification corpus collection. |
| Outcome: | The proposed methods have been used in toxic speech combating and toxic speech fighting tasks. |
COUNT: COntrastive UNlikelihood Text Style Transfer for Text Detoxification (2023.findings-emnlp)
Copied to clipboard
Mohammad Mahdi Abdollah Pour, Parsa Farinneya, Manasa Bharadwaj, Nikhil Verma, Ali Pesaranghader, Scott Sanner
| Challenge: | Text detoxification is a task to ensure the generation of non-toxic and safe text. |
| Approach: | They propose a novel contrastive unlikelihood objective that combines rephrasing and identity mapping to effectively isolate and focus learning on non-toxic style transfer. |
| Outcome: | The proposed method achieves significant improvements in fluency, content preservation, and detoxification on two parallel datasets. |