Paraphrasing in Affirmative Terms Improves Negation Understanding (2024.acl-short)
Copied to clipboard
| Challenge: | Negation is a common linguistic phenomenon in human languages . however, language models face challenges with negation in many tasks . |
| Approach: | They propose to incorporate affirmative interpretations into models to make them more robust against negation. |
| Outcome: | The proposed models are more robust against negation when negation is present in input . the proposed models can be used to analyze large corpus and natural language understanding tasks . |
Similar Papers
Leveraging Affirmative Interpretations from Negation Improves Natural Language Understanding (2022.emnlp-main)
Copied to clipboard
| Challenge: | Negation poses a challenge in many natural language understanding tasks . leveraging sentences with negation and affirmative interpretations is beneficial for many tasks involving humans . |
| Approach: | They propose to collect negated sentences and their affirmative interpretations and leverage them to build a plug-and-play neural generator that generates an affirmative interpreter. |
| Outcome: | The proposed method does not require manual effort and does not impact other tasks. |
Making Language Models Robust Against Negation (2025.naacl-long)
Copied to clipboard
| Challenge: | Negation is a semantic phenomenon that alters an expression to convey the opposite meaning. |
| Approach: | They propose a self-supervised method to make language models more robust against negation by pre-training models. |
| Outcome: | The proposed task outperforms the off-the-shelf versions on nine negation-related benchmarks. |
CONDAQA: A Contrastive Reading Comprehension Dataset for Reasoning about Negation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Negation is fundamental to human communication. |
| Approach: | They propose a dataset which requires reasoning about implications of negated statements in paragraphs . they collect paragraphs with diverse negation cues and crowdworkers ask questions about implications . |
| Outcome: | The first dataset in english requires reasoning about implications of negated statements in paragraphs . it features 14,182 question-answer pairs with over 200 unique negation cues based on crowd-workers . the best performing model achieves only 42% on consistency metric, well below human performance of 81%. |
Commonsense Knowledge with Negation: A Resource to Enhance Negation Understanding (2026.findings-acl)
Copied to clipboard
| Challenge: | Negation is a common and important semantic feature in natural language, yet Large Language Models struggle when negation is involved in natural learning tasks. |
| Approach: | They propose to augment existing corpora with negation by automatically augmenting existing ones with negations by combining multiple triples with if-then relations. |
| Outcome: | The proposed approach yields two new corpora containing over 2M triples with if-then relations. |
Understanding by Understanding Not: Modeling Negation in Language Models (2021.naacl-main)
Copied to clipboard
| Challenge: | Negation is a core construction in natural language, but state-of-the-art pre-trained language models often handle it incorrectly. |
| Approach: | They propose to augment language modeling objective with unlikelihood objective based on negated generic sentences from a raw text corpus. |
| Outcome: | The proposed approach reduces the top 1 error rate to 4% on negated LAMA dataset and improves on negating NLI benchmarks. |
A Question-Answer Driven Approach to Reveal Affirmative Interpretations from Verbal Negations (2022.findings-naacl)
Copied to clipboard
Md Mosharaf Hossain, Luke Holman, Anusha Kakileti, Tiffany Kao, Nathan Brito, Aaron Mathews, Eduardo Blanco
| Challenge: | Negations carry affirmative meanings, which are difficult to process and understand by humans. |
| Approach: | They propose a question-answer driven approach to reveal affirmative interpretations from verbal negations. |
| Outcome: | The proposed approach is based on a natural language inference task . it shows that state-of-the-art transformers are insufficient to reveal affirmative interpretations . |
An Analysis of Negation in Natural Language Understanding Corpora (2022.acl-short)
Copied to clipboard
| Challenge: | Using annotator-generated examples, one can evaluate systems with synthetic language that is not representative of language in the wild. |
| Approach: | They analyze negation in eight popular corpora spanning six natural language understanding tasks. |
| Outcome: | The proposed corpora have few negations compared to general-purpose English and are often unimportant . state-of-the-art transformers obtain significantly worse results with instances that contain negation, especially if the negations are important. |
This is not a Dataset: A Large Negation Benchmark to Challenge Large Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have grammatical knowledge but fail to interpret negation . a recent study shows that LLMs struggle with negative sentences . |
| Approach: | They propose to use a dataset to grasp LLMs' generalization and inference capability . they also fine-tuned models to assess whether the understanding of negation can be trained . |
| Outcome: | The proposed model is able to generalize and infer negation in 400,000 sentences . but it is suboptimal when it comes to negation, a key step in natural language processing . |
Improving negation detection with negation-focused pre-training (2022.naacl-main)
Copied to clipboard
| Challenge: | Negation is a common linguistic feature that is crucial in many language understanding tasks. |
| Approach: | They propose a new approach to detect negation in language models using data augmentation and negation masking. |
| Outcome: | The proposed approach improves negation detection performance and generalizability over the strong baseline NegBERT. |
Strong hallucinations from negation and how to fix them (2024.findings-acl)
Copied to clipboard
| Challenge: | Despite great performance on many tasks, language models still struggle with reasoning, sometimes providing responses that cannot possibly be true because they stem from logical incoherence. |
| Approach: | They propose a way to treat negation as an operation over latent representations that constrains how they may evolve. |
| Outcome: | The proposed approach improves model performance in cloze prompting and natural language inference tasks without training on sparse negative data. |