Negation typology and general representation models for cross-lingual zero-shot negation scope resolution in Russian, French, and Spanish. (2021.naacl-srw)
Copied to clipboard
| Challenge: | Negation resolution remains an acute and continuously researched question in Natural Language Processing. |
| Approach: | They propose to use multilingual pre-trained general representation models to detect negation scope in languages without annotated data. |
| Outcome: | The proposed model achieves token-level F1 score between English, Spanish, French, and Russian. |
Similar Papers
NegBERT: A Transfer Learning Approach for Negation Detection and Scope Resolution (2020.lrec-1)
Copied to clipboard
| Challenge: | Negation is an important characteristic of language, and a major component of information extraction from text. |
| Approach: | They propose to use a popular transfer learning model to solve Negation Detection and Scope Resolution tasks in 3 datasets that have gained popularity over the years. |
| Outcome: | The proposed model outperforms existing systems on the BioScope Corpus, the Sherlock dataset and the SFU Review Corpus in scope resolution. |
Towards the Roots of the Negation Problem: A Multilingual NLI Dataset and Model Scaling Analysis (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Negations are key to determining sentence meaning, making them essential for logical reasoning. |
| Approach: | They construct and publish two new textual entailment datasets in four languages with paired examples differing in negation. |
| Outcome: | The results show that increasing the model size may improve the models’ ability to handle negations. |
Resolving Legalese: A Multilingual Exploration of Negation Scope Resolution in Legal Documents (2024.lrec-main)
Copied to clipboard
| Challenge: | Negation scope resolution is a challenging task for NLP because of the complexity of legal texts and lack of annotated in-domain negation corpora. |
| Approach: | They propose to use annotated court decisions to improve negation scope resolution . they release annotations in german, french, and italian to train models without legal data . |
| Outcome: | The proposed models achieve token-level F1-scores of up to 86.7% in zero-shot and multilingual settings. |
Evaluating morphological typology in zero-shot cross-lingual transfer (2021.acl-long)
Copied to clipboard
| Challenge: | morphological typology has been used to improve cross-lingual transfer . however, some language families and typologies consistently perform worse . |
| Approach: | They examine effects of morphological typology on zero-shot cross-lingual transfer . they perform part-of-speech tagging and sentiment analysis on 19 languages . |
| Outcome: | The proposed model improves on fusional and introflexive languages, but some language families and typologies perform worse. |
Detecting Negation Cues and Scopes in Spanish (2020.lrec-1)
Copied to clipboard
Salud María Jiménez-Zafra, Roser Morante, Eduardo Blanco, María Teresa Martín Valdivia, L. Alfonso Ureña López
| Challenge: | Negation is a phenomenon that "relates an expression e to another expression with a meaning that is in some way opposed to the meaning of e" previous work on negation in English has focused mostly and only recently on annotation tasks. |
| Approach: | They propose a machine learning system that processes negation in Spanish . they use a corpus from the SFU corpus to perform two tasks . |
| Outcome: | The proposed system outperforms state-of-the-art in negation cue detection and scope identification. |
Zero-shot Dependency Parsing with Pre-trained Multilingual Sentence Representations (D19-61)
Copied to clipboard
| Challenge: | Pretrained sentence representations have set the new state of the art in many language understanding tasks. |
| Approach: | They propose to use a multilingual corpus to train deep bidirectional sentence representations that are fully lexicalized to allow for the development of an unsupervised universal dependency parser. |
| Outcome: | The proposed approach outperforms the best CoNLL 2018 systems in all of the shared task’s six truly low-resource languages while using a single system. |
Frustratingly Simple but Surprisingly Strong: Using Language-Independent Features for Zero-shot Cross-lingual Semantic Parsing (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing training data is limited for languages other than English, so is the performance of the developed parsers. |
| Approach: | They propose to apply a pre-trained multilingual model to Italian, German and Dutch parsers where only a small number of manually annotated parses are available. |
| Outcome: | The proposed model improves on six parsers in English and Italian, German and Dutch, with the addition of universal dependency relations and universal POS tags as model-agnostic features. |
This is not a Dataset: A Large Negation Benchmark to Challenge Large Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have grammatical knowledge but fail to interpret negation . a recent study shows that LLMs struggle with negative sentences . |
| Approach: | They propose to use a dataset to grasp LLMs' generalization and inference capability . they also fine-tuned models to assess whether the understanding of negation can be trained . |
| Outcome: | The proposed model is able to generalize and infer negation in 400,000 sentences . but it is suboptimal when it comes to negation, a key step in natural language processing . |
AmericasNLI: Evaluating Zero-shot Natural Language Understanding of Pretrained Multilingual Models in Truly Low-resource Languages (2022.acl-long)
Copied to clipboard
Abteen Ebrahimi, Manuel Mager, Arturo Oncevay, Vishrav Chaudhary, Luis Chiruzzo, Angela Fan, John Ortega, Ricardo Ramos, Annette Rios, Ivan Vladimir Meza Ruiz, Gustavo Giménez-Lugo, Elisabeth Mager, Graham Neubig, Alexis Palmer, Rolando Coto-Solano, Thang Vu, Katharina Kann
| Challenge: | Pretrained multilingual models can perform cross-lingual transfer in a zero-shot setting, even for unseen languages. |
| Approach: | They propose to extend XNLI to 10 indigenous languages of the Americas and test multiple zero-shot and translation-based approaches. |
| Outcome: | The proposed model can perform cross-lingual transfer in a zero-shot setting even for languages unseen during pretraining. |
Improving negation detection with negation-focused pre-training (2022.naacl-main)
Copied to clipboard
| Challenge: | Negation is a common linguistic feature that is crucial in many language understanding tasks. |
| Approach: | They propose a new approach to detect negation in language models using data augmentation and negation masking. |
| Outcome: | The proposed approach improves negation detection performance and generalizability over the strong baseline NegBERT. |