Context Matters: A Pragmatic Study of PLMs’ Negation Understanding (2022.acl-long)
Copied to clipboard
| Challenge: | In linguistics, there are two main perspectives on negation: a semantic and a pragmatic view. |
| Approach: | They propose to use transformer-based pre-trained language models to study negation understanding using a pragmatic paradigm. |
| Outcome: | The proposed transformer-based model outperforms the human benchmark at NLU and GLUE, and the results are much more optimistic than previous studies. |
Similar Papers
An Analysis of Negation in Natural Language Understanding Corpora (2022.acl-short)
Copied to clipboard
| Challenge: | Using annotator-generated examples, one can evaluate systems with synthetic language that is not representative of language in the wild. |
| Approach: | They analyze negation in eight popular corpora spanning six natural language understanding tasks. |
| Outcome: | The proposed corpora have few negations compared to general-purpose English and are often unimportant . state-of-the-art transformers obtain significantly worse results with instances that contain negation, especially if the negations are important. |
Developmental Negation Processing in Transformer Language Models (2022.acl-short)
Copied to clipboard
| Challenge: | Negation is an important construct in language for reasoning over the truth of propositions, garnering interest from philosophy (Horn, 1989) and psycholinguistics (Zwaan, 2012). |
| Approach: | They propose to frame a natural language inference task as a problem and examine how well transformers can process negation categories. |
| Outcome: | The proposed models perform better on certain categories, suggesting clear differences in how they are processed. |
Pragmatics in the Era of Large Language Models: A Survey on Datasets, Evaluation, Opportunities and Challenges (2025.acl-long)
Copied to clipboard
Bolei Ma, Yuting Li, Wei Zhou, Ziwei Gong, Yang Janet Liu, Katja Jasinskaja, Annemarie Friedrich, Julia Hirschberg, Frauke Kreuter, Barbara Plank
| Challenge: | linguistics studies how context influences meaning of language and how people use it to convey implied meanings, emotions, and intentions. |
| Approach: | They analyze task designs, data collection methods, evaluation approaches and their relevance to real-world applications. |
| Outcome: | The findings highlight emerging trends, challenges, and gaps in existing benchmarks . the findings will contribute to more nuanced and context-aware NLP models . |
Revisiting subword tokenization: A case study on affixal negation in large language models (2024.naacl-long)
Copied to clipboard
| Challenge: | Negation is central to language understanding but is not properly captured by modern NLP methods. |
| Approach: | They propose to use subword tokenization methods to detect negation in large language models . they find that models can reliably recognize negation, despite mismatches in tokenization accuracy . |
| Outcome: | The proposed models can detect negation in English using subword tokenization methods despite some mismatches in tokenization accuracy and negation detection performance. |
A Comprehensive Taxonomy of Negation for NLP and Neural Retrievers (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a new taxonomy of negation is proposed to improve neural information retrieval models . negation types are covered in existing datasets, allowing for faster convergence . |
| Approach: | They propose a taxonomy of negation that derives from philosophical, linguistic, and logical definitions . they also propose analyzing the performance of retrieval models on existing datasets using a logic-based classification mechanism. |
| Outcome: | The proposed taxonomy produces a balanced data distribution over negation types . it also provides a better training setup that leads to faster convergence on the NevIR dataset . |
Towards the Roots of the Negation Problem: A Multilingual NLI Dataset and Model Scaling Analysis (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Negations are key to determining sentence meaning, making them essential for logical reasoning. |
| Approach: | They construct and publish two new textual entailment datasets in four languages with paired examples differing in negation. |
| Outcome: | The results show that increasing the model size may improve the models’ ability to handle negations. |
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 5: Tutorial Abstracts) (2024.acl-tutorials)
Copied to clipboard
| Challenge: | ACL tutorial session is a highlight of the conference . it aims to provide attendees with a thorough introduction to key topics in our fast-evolving research field . |
| Approach: | the ACL tutorial session is a highlight of the conference . it aims to provide attendees with a thorough introduction to key topics in the field . |
| Outcome: | the ACL tutorial session is a highlight of the conference . the review process involved multiple conferences and three reviewers . |
Commonsense Knowledge with Negation: A Resource to Enhance Negation Understanding (2026.findings-acl)
Copied to clipboard
| Challenge: | Negation is a common and important semantic feature in natural language, yet Large Language Models struggle when negation is involved in natural learning tasks. |
| Approach: | They propose to augment existing corpora with negation by automatically augmenting existing ones with negations by combining multiple triples with if-then relations. |
| Outcome: | The proposed approach yields two new corpora containing over 2M triples with if-then relations. |
The Interplay between Metaphors and NLP (2026.acl-tutorials)
Copied to clipboard
| Challenge: | This tutorial will provide an overview of the metaphor processing field. |
| Approach: | This tutorial will provide an overview of the metaphor processing field . it will focus on recent directions opened by LLMs for metaphor interpretation . |
| Outcome: | The tutorial will discuss the influence of various metaphor theories on the creation of annotated resources and models. |
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 5: Tutorial Abstracts) (2025.acl-tutorials)
Copied to clipboard
| Challenge: | ACL 2025 tutorial sessions are a cornerstone event of the conference . 76 tutorial submissions were received this year, many of which were very engaging . |
| Approach: | 76 tutorial submissions were received this year for the tutorial session at ACL 2025 . the tutorials are designed to equip you with the latest insights, tools, and methodologies . |
| Outcome: | the tutorial sessions at ACL 2025 will be held in london on november 8 . the conference received 76 tutorial submissions this year . |