UnityAI Guard: Pioneering Toxicity Detection Across Low-Resource Indian Languages (2025.emnlp-demos)
Copied to clipboard
Himanshu Beniwal, Reddybathuni Venkat, Rohit Kumar, Birudugadda Srivibhav, Daksh Jain, Pavan Deekshith Doddi, Eshwar Dhande, Adithya Ananth, null Kuldeep, Mayank Singh
| Challenge: | Existing systems target high-resource languages, but UnityAI-Guard addresses this gap by developing state-of-the-art models for binary toxicity classification targeting low-resourced Indian languages. |
| Approach: | They propose a framework for binary toxicity classification targeting low-resource Indian languages. |
| Outcome: | The proposed framework achieves an impressive average F1-score of 84.23% across seven languages, leveraging a dataset of 567k training instances and 30k manually verified test instances. |
Similar Papers
Toxicity Red-Teaming: Benchmarking LLM Safety in Singapore’s Low-Resource Languages (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have transformed natural language processing, but their safety mechanisms remain under-explored in low-resource, multilingual settings. |
| Approach: | They propose a red-teaming approach to probe LLM vulnerabilities in Singapore's diverse linguistic context using a dataset and evaluation framework. |
| Outcome: | The proposed framework systematically probes LLM vulnerabilities in three real-world scenarios including Singlish, Chinese, Malay, and Tamil. |
ToxVidLM: A Multimodal Framework for Toxicity Detection in Code-Mixed Videos (2024.findings-acl)
Copied to clipboard
| Challenge: | Using a dataset of 931 videos with 4021 code-mixed Hindi-English utterances, we find that video content with multiple modalities is more accurate and more accurate than textual content. |
| Approach: | They propose to use a dataset to analyze toxic content in video content in non-English languages by leveraging language models. |
| Outcome: | The proposed framework achieves an Accuracy and Weighted F1 score of 94.29% and 94.35% for the first time in its class. |
MuTox: Universal MUltilingual Audio-based TOXicity Dataset and Zero-shot Detector (2024.findings-acl)
Copied to clipboard
Marta Costa-jussà, Mariano Meglioli, Pierre Andrews, David Dale, Prangthip Hansanti, Elahe Kalbassi, Alexandre Mourachko, Christophe Ropers, Carleigh Wood
| Challenge: | Existing studies on text-based toxicity detection for other languages are limited, especially for languages other than English. |
| Approach: | They propose a multilingual audio-based toxicity classifier which covers 14 different linguistic families and a dataset of 20,000 audio utterances for English and Spanish. |
| Outcome: | The new classifier improves F1-Score by an average of 100% when compared to existing wordlist-based classifiers. |
ModelCitizens: Representing Community Voices in Online Safety (2025.emnlp-main)
Copied to clipboard
Ashima Suvarna, Christina A Chance, Karolina Naranjo, Hamid Palangi, Sophie Hao, Thomas Hartvigsen, Saadia Gabriel
| Challenge: | Existing toxic language detection models are trained on annotations that collapse diverse perspectives into a single ground truth. |
| Approach: | They propose to augment social media posts with conversational scenarios to reflect the impact of conversational context on toxicity. |
| Outcome: | The proposed model outperforms existing models on social media with conversational scenarios. |
No offence, Bert - I insult only humans! Multilingual sentence-level attack on toxicity detection networks (2023.findings-emnlp)
Copied to clipboard
| Challenge: | a new sentence-level attack on toxic detection models is shown to work on seven languages . toxicity detection systems are used to silence the voices of criticism, causing echo chambers . |
| Approach: | They propose a sentence-level attack that adds positive words to a hateful message . they show the attack works on seven languages from three different language families . |
| Outcome: | The proposed attack is shown to work on seven languages from three different language families. |
TOXIFRENCH: Benchmarking and Enhancing Language Models via CoT Fine-Tuning for French Toxicity Detection (2026.findings-acl)
Copied to clipboard
| Challenge: | toxicity detection in French remains underdeveloped due to the lack of culturally relevant, human-annotated, large-scale datasets. |
| Approach: | They propose a method that generalizes French online comments using a semi-automated annotation pipeline that reduces manual labeling to only 10% through high-confidence LLM-based pre-annotation and human verification. |
| Outcome: | The proposed model outperforms GPT-4o and DeepSeek-R1 on the benchmark while maintaining cross-lingual capabilities. |
A Survey of Toxicity Mitigation Strategies for Multilingual Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models can reproduce and amplify toxic content, including hate speech, harassment, and bias. |
| Approach: | They propose a comprehensive survey of the many detoxification methods tailored to multilingual LLMs. |
| Outcome: | The proposed methods are based on data filtering, style transfer, expert-based logit steering, retrieval augmentation, and human feedback. |
BhashaSutra: A Task-Centric Unified Survey of Indian NLP Datasets, Corpora, and Resources (2026.acl-long)
Copied to clipboard
| Challenge: | Existing reviews focus on a few high-resource languages or embed Indian languages within broad multilingual settings, limiting coverage of low-resourced and culturally diverse varieties. |
| Approach: | They present a unified survey of Indian NLP resources, covering 200+ datasets, 50+ benchmarks, and 100+ models, tools, and systems across text, speech, multimodal, and culturally grounded tasks. |
| Outcome: | The proposed survey covers 200+ datasets, 50+ benchmarks, and 100+ models, tools, and systems across text, speech, multimodal, and culturally grounded tasks. |
Subasa - Adapting Language Models for Low-resourced Offensive Language Detection in Sinhala (2025.naacl-srw)
Copied to clipboard
Shanilka Haturusinghe, Tharindu Cyril Weerasooriya, Christopher M Homan, Marcos Zampieri, Sidath Ravindra Liyanage
| Challenge: | A major challenge in the field of NLP are the disparities between high- and low-resource languages. |
| Approach: | They propose fine-tuning strategies that have not been previously explored for Sinhala in the downstream task of offensive language detection. |
| Outcome: | The proposed models outperform baseline models on the Sinhala offensive language detection task. |
Speak No Evil, Just Prompt: Low-resource Multilingual Toxic Speech Detection with Audio Language Model (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for toxic speech detection rely on high-resource languages and lack acoustic cues. |
| Approach: | They propose a prompt-based adaptation framework that performs end-to-end toxicity detection without ASR. |
| Outcome: | The proposed framework achieves a micro-averaged ROC-AUC of 98.07% on polySpeechTox . it is based on a frozen audio language model and can perform end-to-end toxicity detection without ASR . |