Scoring and Classifying Implicit Positive Interpretations: A Challenge of Class Imbalance (C18-1)
Copied to clipboard
| Challenge: | a reimplementation of a system on detecting implicit positive meaning from negated statements is reported . a baseline taking the mean score or most frequent class is hard to beat because of class imbalance in the dataset. |
| Approach: | They propose a system to detect implicit positive meaning from negated statements . they convert the scores into classes and report their results on regression and classification tasks . |
| Outcome: | The proposed system is hard to beat because of class imbalance in the dataset. |
Similar Papers
A Survey of Methods for Addressing Class Imbalance in Deep-Learning Based Natural Language Processing (2023.eacl-main)
Copied to clipboard
| Challenge: | Developing methods to improve model performance in imbalanced data settings has been an active area for decades . |
| Approach: | They propose to use sampling, data augmentation, choice of loss function, staged learning, or model design to address class imbalance in NLP. |
| Outcome: | The proposed approaches are evaluated on a variety of NLP tasks or in the computer vision community. |
SetConv: A New Approach for Learning from Imbalanced Data (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for classification are biased towards the majority class when the Imbalance Ratio (IR) is high. |
| Approach: | They propose a set convolution operation and an episodic training strategy to extract a single representative for each class, so that classifiers can later be trained on a balanced class distribution. |
| Outcome: | The proposed algorithm is permutation-invariant despite the order of inputs and shows superiority on multiple large-scale benchmark text datasets. |
Oddballs and Misfits: Detecting Implicit Abuse in Which Identity Groups are Depicted as Deviating from the Norm (2024.emnlp-main)
Copied to clipboard
| Challenge: | Abusive language is often defined as hurtful, derogatory or obscene utterances made by one person to another. |
| Approach: | They propose to use a dataset to detect abusive sentences in identity groups . they also report on classification experiments. |
| Outcome: | The proposed dataset includes 7 identity groups and includes classification experiments. |
Improving negation detection with negation-focused pre-training (2022.naacl-main)
Copied to clipboard
| Challenge: | Negation is a common linguistic feature that is crucial in many language understanding tasks. |
| Approach: | They propose a new approach to detect negation in language models using data augmentation and negation masking. |
| Outcome: | The proposed approach improves negation detection performance and generalizability over the strong baseline NegBERT. |
Leveraging Affirmative Interpretations from Negation Improves Natural Language Understanding (2022.emnlp-main)
Copied to clipboard
| Challenge: | Negation poses a challenge in many natural language understanding tasks . leveraging sentences with negation and affirmative interpretations is beneficial for many tasks involving humans . |
| Approach: | They propose to collect negated sentences and their affirmative interpretations and leverage them to build a plug-and-play neural generator that generates an affirmative interpreter. |
| Outcome: | The proposed method does not require manual effort and does not impact other tasks. |
Beyond Negative Stereotypes – Non-Negative Abusive Utterances about Identity Groups and Their Semantic Variants (2025.acl-long)
Copied to clipboard
| Challenge: | implicitly abusive language is a language that could offend, demean or marginalize another person . a large portion of what is considered abusive language can be classified as implicitly abused . |
| Approach: | They propose to profile implicitly abusive language and use it to analyze a dataset of such utterances. |
| Outcome: | The proposed dataset identifies the type of abusive language that is not conveyed by unambiguously abusive words. |
This is not a Dataset: A Large Negation Benchmark to Challenge Large Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have grammatical knowledge but fail to interpret negation . a recent study shows that LLMs struggle with negative sentences . |
| Approach: | They propose to use a dataset to grasp LLMs' generalization and inference capability . they also fine-tuned models to assess whether the understanding of negation can be trained . |
| Outcome: | The proposed model is able to generalize and infer negation in 400,000 sentences . but it is suboptimal when it comes to negation, a key step in natural language processing . |
The Authors Matter: Understanding and Mitigating Implicit Bias in Deep Text Classification (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on text classification have focused on the bias towards the individuals mentioned in the text content. |
| Approach: | They propose a framework to mitigate implicit bias in text classification models based on demographic attributes of authors . they propose to use this framework to train deep text classifiers to make predictions on the right features . |
| Outcome: | The proposed framework outperforms existing models significantly in fairness and performance. |
HardEval: Focusing on Challenging Tokens to Assess Robustness of NER (2020.lrec-1)
Copied to clipboard
| Challenge: | Named entity recognition (NER) systems are often evaluated on human annotations . a new evaluation method focuses on subsets of tokens that represent specific sources of errors . |
| Approach: | They propose a method that focuses on subsets of tokens that represent specific sources of errors. |
| Outcome: | The proposed evaluation method focuses on subsets of tokens that represent specific sources of errors. |
A Comprehensive Taxonomy of Negation for NLP and Neural Retrievers (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a new taxonomy of negation is proposed to improve neural information retrieval models . negation types are covered in existing datasets, allowing for faster convergence . |
| Approach: | They propose a taxonomy of negation that derives from philosophical, linguistic, and logical definitions . they also propose analyzing the performance of retrieval models on existing datasets using a logic-based classification mechanism. |
| Outcome: | The proposed taxonomy produces a balanced data distribution over negation types . it also provides a better training setup that leads to faster convergence on the NevIR dataset . |