Exploring Cross-lingual Text Detoxification with Large Multilingual Language Models. (2022.acl-srw)
Copied to clipboard
| Challenge: | Existing methods of textual style transfer are monolingual i.e. designed to work in one exact language. |
| Approach: | They propose to make large multilingual models capable of performing multilingual style transfer without direct fine-tuning in a given language. |
| Outcome: | The proposed model can generate text in a given language without fine-tuning and is able to perform cross-lingual detoxification without direct fine- tuning. |
Similar Papers
A Survey of Toxicity Mitigation Strategies for Multilingual Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models can reproduce and amplify toxic content, including hate speech, harassment, and bias. |
| Approach: | They propose a comprehensive survey of the many detoxification methods tailored to multilingual LLMs. |
| Outcome: | The proposed methods are based on data filtering, style transfer, expert-based logit steering, retrieval augmentation, and human feedback. |
Multilingual and Explainable Text Detoxification with Parallel Corpora (2025.coling-main)
Copied to clipboard
Daryna Dementieva, Nikolay Babakov, Amit Ronen, Abinew Ali Ayele, Naquee Rizwan, Florian Schneider, Xintong Wang, Seid Muhie Yimam, Daniil Alekhseevich Moskovskiy, Elisei Stakovskii, Eran Kaufman, Ashraf Elnagar, Animesh Mukherjee, Alexander Panchenko
| Challenge: | Existing approaches to manage toxic speech on social platforms are limited . however, there is a need for more proactive moderation of abusive speech. |
| Approach: | They extend parallel text detoxification corpus to new languages to test the approach . they propose a method that combines toxic and non-toxic sentences into a more neutral form . |
| Outcome: | The proposed method integrates the descriptive features of toxic and non-toxic sentences into a more neutral or non- toxic form. |
MultiParaDetox: Extending Text Detoxification with Parallel Data to New Languages (2024.naacl-short)
Copied to clipboard
| Challenge: | Text detoxification is a textual style transfer task where a toxic text is paraphrased to the neutral register. |
| Approach: | They propose to extend ParaDetox pipeline to multiple languages to automate parallel detoxification corpus collection. |
| Outcome: | The proposed methods have been used in toxic speech combating and toxic speech fighting tasks. |
Cross-Lingual Transfer of Debiasing and Detoxification in Multilingual LLMs: An Extensive Investigation (2025.findings-acl)
Copied to clipboard
| Challenge: | Prior work has shown that finetuning on specialized datasets can mitigate this behavior, and doing so in English can transfer to other languages. |
| Approach: | They propose to fine tune generative large language models to provide safe responses to harmful user input and to use direct preference optimization to mitigate toxicity. |
| Outcome: | The proposed models show that finetuning on specialized datasets reduces biases but also produces fluent and diverse text in non-English languages. |
Detoxifying Large Language Models via the Diversity of Toxic Samples (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for analyzing and utilizing toxic samples are limited . current methods fail to fully harness their potential . |
| Approach: | They propose a diverse detoxification framework that leverages toxic samples' diversity . they propose MPSG strategy and SC-DPO approach to elicit personalized toxic responses . |
| Outcome: | The proposed framework could be used to optimize large language models for user safety . it incorporates two components: MPSG strategy and SC-DPO approach . |
Text Detoxification using Large Pre-trained Neural Models (2021.emnlp-main)
Copied to clipboard
David Dale, Anton Voronov, Daryna Dementieva, Varvara Logacheva, Olga Kozlova, Nikita Semenov, Alexander Panchenko
| Challenge: | Existing studies on text detoxification cast this task as style transfer . text detox requires better preservation of the original meaning, authors argue . |
| Approach: | They propose two unsupervised methods for eliminating toxicity in text . they use a paraphraser guided by style-trained language models to keep the text content . |
| Outcome: | The proposed methods yield new SOTA results. |
Detoxifying Large Language Models via Knowledge Editing (2024.acl-long)
Copied to clipboard
Mengru Wang, Ningyu Zhang, Ziwen Xu, Zekun Xi, Shumin Deng, Yunzhi Yao, Qishen Zhang, Linyi Yang, Jindong Wang, Huajun Chen
| Challenge: | Existing methods to detoxify Large Language Models (LLMs) are limiting, but knowledge editing can be effective. |
| Approach: | They propose a baseline method to detoxify Large Language Models (LLMs) they propose supervised fine-tuning and reinforcement learning from human feedback (RLHF) |
| Outcome: | The proposed method reduces toxicity of large language models with one instance of tuning . it reduces the toxicity, while minimizing the toxins, the authors show . |
Preference Tuning For Toxicity Mitigation Generalizes Across Languages (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Detoxifying multilingual Large Language Models (LLMs) has become crucial due to their increasing global use. |
| Approach: | They propose to use English preference tuning to study cross-lingual detoxification of LLMs. |
| Outcome: | The proposed method reduces toxicity in multilingual LLMs by reducing the probability of mGPT-1.3B generating toxic continuations across 17 languages. |
Challenges in Detoxifying Language Models (2021.findings-emnlp)
Copied to clipboard
Johannes Welbl, Amelia Glaese, Jonathan Uesato, Sumanth Dathathri, John Mellor, Lisa Anne Hendricks, Kirsty Anderson, Pushmeet Kohli, Ben Coppin, Po-Sen Huang
| Challenge: | Prior work often relies on automatic evaluation of LM toxicity. |
| Approach: | They evaluate toxicity mitigation strategies for automated and human evaluations . they find human raters disagree with high automatic toxicity scores after strong toxicity reduction interventions . |
| Outcome: | The proposed methods reduce LM toxicity but lower coverage for marginalized texts . human raters disagree with high toxicity scores after strong toxicity reduction interventions . |
Attribute Controlled Fine-tuning for Large Language Models: A Case Study on Detoxification (2024.findings-emnlp)
Copied to clipboard
Tao Meng, Ninareh Mehrabi, Palash Goyal, Anil Ramakrishna, Aram Galstyan, Richard Zemel, Kai-Wei Chang, Rahul Gupta, Charith Peris
| Challenge: | Using a sequence-level constraint, we regularize the LLMtraining by penalizing the KL divergence between the desired output distribution and the LRM’s posterior. |
| Approach: | They propose a constraint learning schema forfine-tuning Large Language Models with attribute control by penalizing the KL divergence be-tween the desired output distribution and the LLM's posterior. |
| Outcome: | The proposed approach improves the performance of large language models while enhancing their utility and generation quality. |