Rethinking Offensive Text Detection as a Multi-Hop Reasoning Problem (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing methods of offensive text detection perform poorly when asked to detect implicitly offensive statements . a dataset based on SLIGHT provides a framework for implicit offensive text identification . |
| Approach: | They propose a dataset to support the task of implicit offensive text detection in dialogues . they show that reasoning is crucial for understanding this broader class of offensive utterances - SLIGHT . |
| Outcome: | The proposed model achieves 11% accuracy in implicit offensive text detection tasks . the proposed model can be used to identify toxic speech in specific domains . |
Similar Papers
Avoiding Reasoning Shortcuts: Adversarial Evaluation, Training, and Model Development for Multi-Hop QA (P19-1)
Copied to clipboard
| Challenge: | In multi-hop question answering, models need to connect multiple pieces of evidence scattered in a long context to answer the question. |
| Approach: | They propose to use a control unit that dynamically attends to the question at different reasoning hops to guide the model's multi-hop reasoning. |
| Outcome: | The proposed model outperforms baseline models but is limited on adversarial test. |
The Relevance of Value Systems for Offensive Language Detection (2026.eacl-long)
Copied to clipboard
| Challenge: | Recent research in perspectivism has departed from the assumption that offensiveness can be defined through a universal perspective. |
| Approach: | They propose to use a dataset consisting of neutrally-phrased sentences on controversial topics, evaluated by individuals from 4 different value systems to identify offensiveness patterns. |
| Outcome: | The proposed dataset consists of neutrally-phrased sentences on controversial topics, evaluated by individuals from 4 different value systems. |
Seemingly Plausible Distractors in Multi-Hop Reasoning: Are Large Language Models Attentive Readers? (2024.emnlp-main)
Copied to clipboard
| Challenge: | State-of-the-art Large Language Models (LLMs) are accredited with a number of different capabilities, including reading comprehension, mathematical and reasoning skills, and possessing scientific knowledge. |
| Approach: | They propose a benchmark to generate seemingly plausible multi-hop reasoning chains that ultimately lead to incorrect answers. |
| Outcome: | The proposed model circumvents the reasoning requirement but in subtle ways . it shows that it is more difficult to generate plausible alternatives . |
OLEA: Tool and Infrastructure for Offensive Language Error Analysis in English (2023.eacl-demo)
Copied to clipboard
| Challenge: | State-of-the-art models for identifying offensive language fail to generalize over nuanced or implicit cases of offensive and hateful language. |
| Approach: | They propose an open-source Python library for error analysis in the context of offensive language detection. |
| Outcome: | OLEA provides tools for error analysis in the context of detecting offensive language in English. |
Transfer Learning and Prediction Consistency for Detecting Offensive Spans of Text (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing models for toxic span detection only classify text snippets as offensive or not . a novel model seeks to simultaneously predict offensive words and opinion phrases . |
| Approach: | They propose a novel model that seeks to predict offensive words and opinion phrases simultaneously . they also introduce a regularization mechanism to encourage consistency of the model predictions . |
| Outcome: | The proposed model performs well compared to baselines on toxic span detection tasks . it predicts offensive words and opinion phrases to leverage inter-dependencies . |
MUDES: Multilingual Detection of Offensive Spans (2021.naacl-demos)
Copied to clipboard
| Challenge: | Identifying offensive spans in texts is the goal of the SemEval-2021 Task 5: Toxic Spans Detection . previous work focused on post level annotations, but identifying offensive span is useful in many ways. |
| Approach: | They propose a Python-based system to detect offensive spans in texts with pre-trained models and a user-friendly web-based interface. |
| Outcome: | The proposed system is based on a Python-based framework and a user-friendly web-based interface. |
GMH: A General Multi-hop Reasoning Model for KG Completion (2021.emnlp-main)
Copied to clipboard
| Challenge: | Knowledge graphs are incomplete with many facts missing, causing performance bottlenecks in many applications. |
| Approach: | They propose a general multi-hop reasoning task that can be formulated as a search process and can be extended to long-distance reasoning scenarios. |
| Outcome: | The proposed model improves on baselines in short and long distance reasoning scenarios. |
Low-Resource Generation of Multi-hop Reasoning Questions (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods to generate valid and fluent questions from text are limited and insufficient for training. |
| Approach: | They propose to generate multi-hop reasoning questions from the raw text in a low resource circumstance by deducing over multiple relations on several sentences in the text. |
| Outcome: | The proposed model can be applied to the task of machine reading comprehension and achieve significant performance improvements. |
Can We Guide a Multi-Hop Reasoning Language Model to Incrementally Learn at Each Single-Hop? (2022.coling-1)
Copied to clipboard
| Challenge: | Recent developments have shown that pre-trained language models are effective soft reasoners over language. |
| Approach: | They propose to model multi-hop reasoning process as a sequence of explicit single-hop steps. |
| Outcome: | The proposed model improves on multiple-choice question answering and reading comprehension with 68.4% and 16.0% w.r.t. classic PLMs. |
Mind Your Bias: A Critical Review of Bias Detection Methods for Contextual Language Models (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for detection of biases in contextual language models are inconsistent and inconclusive. |
| Approach: | They propose to use word embedding association test to detect biases in contextual language models to compare them with other methods. |
| Outcome: | The proposed methods are inconsistent and inconclusive for language models with word embeddings. |