Transfer Learning and Prediction Consistency for Detecting Offensive Spans of Text (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing models for toxic span detection only classify text snippets as offensive or not . a novel model seeks to simultaneously predict offensive words and opinion phrases . |
| Approach: | They propose a novel model that seeks to predict offensive words and opinion phrases simultaneously . they also introduce a regularization mechanism to encourage consistency of the model predictions . |
| Outcome: | The proposed model performs well compared to baselines on toxic span detection tasks . it predicts offensive words and opinion phrases to leverage inter-dependencies . |
Similar Papers
From the Detection of Toxic Spans in Online Discussions to the Analysis of Toxic-to-Civil Transfer (2022.acl-long)
Copied to clipboard
| Challenge: | a dataset of English posts with annotations of toxic spans is released . sequence labeling models perform best, but rationale extraction methods are promising . |
| Approach: | They propose a dataset for toxic spans detection that includes an annotation of toxic posts . they propose to add generic rationale extraction mechanisms to the model to obtain toxic span information . |
| Outcome: | The proposed framework is based on a dataset of English posts with toxic span annotations . it shows that sequence labeling models perform best, but that rationale extraction methods are promising . |
Data Augmentation with Dual Training for Offensive Span Detection (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing models only classify text excerpts as offensive or not, failing to provide information on which words and phrases contribute the most to its offensive tone. |
| Approach: | They propose a model for offensive span detection that uses a pre-trained language model to generate training data. |
| Outcome: | The proposed model can detect offensive spans in a text snippet using a pre-trained language model . the proposed model is able to detect offensive text in simulated training conditions . |
MUDES: Multilingual Detection of Offensive Spans (2021.naacl-demos)
Copied to clipboard
| Challenge: | Identifying offensive spans in texts is the goal of the SemEval-2021 Task 5: Toxic Spans Detection . previous work focused on post level annotations, but identifying offensive span is useful in many ways. |
| Approach: | They propose a Python-based system to detect offensive spans in texts with pre-trained models and a user-friendly web-based interface. |
| Outcome: | The proposed system is based on a Python-based framework and a user-friendly web-based interface. |
STATE ToxiCN: A Benchmark for Span-level Target-Aware Toxicity Extraction in Chinese Hate Speech Detection (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on Chinese hate speech detection lack span-level fine-grained annotations. |
| Approach: | They construct a Span-level target-aware Toxicity Extraction dataset and evaluate existing models for Chinese hateful slang. |
| Outcome: | The proposed dataset is the first span-level Chinese hate speech dataset and evaluates the ability of existing models to understand hate semantics. |
Performance and Risk Trade-offs for Multi-word Text Prediction at Scale (2023.findings-eacl)
Copied to clipboard
Aniket Vashishtha, S Sai Prasad, Payal Bajaj, Vishrav Chaudhary, Kate Cook, Sandipan Dandapat, Sunayana Sitaram, Monojit Choudhury
| Challenge: | Large Language Models (LLMs) generate ethically inappropriate texts even for seemingly innocuous contexts. |
| Approach: | They propose to use large language models to detect and filter toxic content in text prediction tasks by evaluating their toxicity detection approaches against a manually crafted CheckList of harms. |
| Outcome: | The proposed methods are compared against a checklist of harms targeted at different groups and different levels of severity in English. |
SpanPredict: Extraction of Predictive Document Spans with Neural Attention (2021.naacl-main)
Copied to clipboard
| Challenge: | identifying predictive text in clinical notes can be as important as the predictions themselves . identifying specific content in clinical note descriptions may illuminate previously unknown risk factors . |
| Approach: | They propose a method for identifying predictive text in clinical notes . they use linear attention to formalize the problem as predictive extraction . |
| Outcome: | The proposed model preserves differentiability and allows scalable inference via stochastic gradient descent. |
Muted: Multilingual Targeted Offensive Speech Identification and Visualization (2023.emnlp-demo)
Copied to clipboard
Christoph Tillmann, Aashka Trivedi, Sara Rosenthal, Santosh Borse, Rong Zhang, Avirup Sil, Bishwaranjan Bhattacharjee
| Challenge: | Existing visualizations of offensive language use only sentence level annotations, but there are few that explore spans and other languages. |
| Approach: | They propose a system to identify multilingual HAP content by displaying offensive arguments and their targets using heat maps to indicate their intensity. |
| Outcome: | The proposed model can identify toxic spans without further fine-tuning using existing models and its attention mechanism out-of-the-box. |
Towards Building a Robust Toxicity Predictor (2023.acl-industry)
Copied to clipboard
| Challenge: | Recent studies have focused on robustness of toxicity language predictors, but this is problematic for real-world toxicity detection. |
| Approach: | They propose a novel adversarial attack that exploits greedy search strategies to fool toxic text classifiers. |
| Outcome: | The proposed attack can detect weaker toxicity language detectors even against unseen attacks. |
Dissecting Span Identification Tasks with Performance Prediction (2020.emnlp-main)
Copied to clipboard
| Challenge: | Span identification tasks are a staple of applied NLP, but there is little insight on how their properties influence their difficulty. |
| Approach: | They propose to build a model to predict span ID performance for unseen span ID tasks that can support architecture choices. |
| Outcome: | The proposed model predicts span ID tasks for unseen span ID task in English, and the meta model predictable span ID performance. |
Fortifying Toxic Speech Detectors Against Veiled Toxicity (2020.emnlp-main)
Copied to clipboard
| Challenge: | Modern toxic speech detectors are incompetent in recognizing disguised offensive language, such as adversarial attacks that deliberately avoid known toxic lexicons. |
| Approach: | They propose a framework that fortifies existing toxic speech detectors without a large labeled corpus of veiled toxicity. |
| Outcome: | The proposed framework is aimed at fortifying existing toxic speech detectors without a large labeled corpus of disguised offensive language. |