MELM: Data Augmentation with Masked Entity Language Modeling for Low-Resource NER (2022.acl-long)
Copied to clipboard
| Challenge: | Named entity recognition (NER) tasks have limited amount of labeled data . data augmentation methods suffer from token-label misalignment, which leads to unsatsifactory performance. |
| Approach: | They propose a data augmentation framework that explicitly injects NER labels into sentence context and generates high-quality augmented data with novel entities. |
| Outcome: | The proposed framework outperforms baseline methods on low-resource tasks. |
Similar Papers
DAGA: Data Augmentation with a Generation Approach for Low-resource Tagging Tasks (2020.emnlp-main)
Copied to clipboard
Bosheng Ding, Linlin Liu, Lidong Bing, Canasai Kruengkrai, Thien Hai Nguyen, Shafiq Joty, Luo Si, Chunyan Miao
| Challenge: | Data augmentation techniques are widely used to improve machine learning performance . however, due to the complexity of language, it is difficult to generalize such rules for languages. |
| Approach: | They propose a method to generate high quality synthetic data for low-resource tagging tasks . they use unlabeled data only and unlabelled data plus a knowledge base . |
| Outcome: | The proposed method outperforms baselines on NER, part of speech and target based sentiment analysis tasks. |
Data Augmentation for Cross-Domain Named Entity Recognition (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for named entity recognition focus on augmenting in-domain data in low-resource scenarios where annotated data is limited. |
| Approach: | They propose a neural architecture to transform data from high-resource to low-resourced domains by learning the patterns in the text that differentiate them. |
| Outcome: | The proposed approach improves on high-resource domain representations over high- and low-resourced domains. |
Pushing the Limits of Low-Resource NER Using LLM Artificial Data Generation (2024.findings-acl)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is an important task, but it requires a large amount of labeled data to perform well. |
| Approach: | They propose to use open-source Large Language Models to generate NER data with only a few labeled examples, reducing the cost of human annotations. |
| Outcome: | The proposed method significantly improves the baseline on diverse low-resource NER datasets and can be used to augment datasets with class-imbalance problems. |
ACLM: A Selective-Denoising based Generative Data Augmentation Approach for Low-Resource Complex NER (2023.acl-long)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is a task of detecting linguistically complex named entities in low-context text. |
| Approach: | They propose a keyword-based augmentation approach to address the context-entity mismatch issue in complex name recognition (NER) they use selective masking to retain the named entities and certain keywords in the input sentence that provide contextually relevant additional knowledge or hints about the named entity. |
| Outcome: | The proposed approach outperforms baseline methods on monolingual, cross-lingual, and multilingual complex NER in various low-resource settings. |
Virtual Data Augmentation: A Robust and General Framework for Fine-tuning Pre-trained Models (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have shown that powerful pre-trained language models can be fooled by small perturbations or intentional attacks. |
| Approach: | They propose a framework for fine-tuning PLMs using a masked language model and Gaussian noise to augment semantically relevant examples with sufficient diversity. |
| Outcome: | The proposed framework improves the robustness of pre-trained language models and alleviates performance degradation under adversarial attacks. |
Getting More Data for Low-resource Morphological Inflection: Language Models and Data Augmentation (2020.lrec-1)
Copied to clipboard
| Challenge: | Morphological inflection is the process that generates the word form given its lexeme and morphological properties. |
| Approach: | They propose to use language models and data augmentation to improve morphological inflection without annotating more data. |
| Outcome: | The proposed model improves by 1.5% with the langauge model and by 9% with the data augmentation. |
MulDA: A Multilingual Data Augmentation Framework for Low-Resource Cross-Lingual NER (2021.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to cross-lingual NER are labeled sequence translation and instance-based transfer via machine translation (MT) Existing methods to cross NER include label projection and labeling, but they are expensive and time-consuming. |
| Approach: | They propose a simple but effective labeled sequence translation method to translate source-language training data to target languages and avoids word order change and entity span determination. |
| Outcome: | The proposed method avoids word order change and entity span determination and can be generalized with the language-specific features from the target-language synthetic data and the language independent features from multilingual synthetic data. |
Generalized Data Augmentation for Low-Resource Translation (P19-1)
Copied to clipboard
| Challenge: | Low-resource language pairs with a lack of parallel data pose challenges for machine translation . data augmentation using monolingual data is an effective way to alleviate the problem . |
| Approach: | They propose a general framework for data augmentation for low-resource machine translation using monolingual data and a related high-resourced language. |
| Outcome: | The proposed method improves translation quality by 1.5 to 8 BLEU points under extreme low-resource settings compared to baselines. |
Making More of Little Data: Improving Low-Resource Automatic Speech Recognition Using Data Augmentation (2023.acl-long)
Copied to clipboard
| Challenge: | Using self-training or text-to-speech (TTS) to improve low-resource ASR performance is costly and can lead to catastrophic forgetting. |
| Approach: | They examine whether data augmentation techniques could help improve low-resource ASR performance . they use self-training to generate transcriptions, which are combined with original data to train new system . |
| Outcome: | The proposed approach yields a 20.5% reduction in WER compared to a system trained on 24 minutes of manually transcribed speech. |
An Analysis of Simple Data Augmentation for Named Entity Recognition (2020.coling-main)
Copied to clipboard
| Challenge: | Recent studies have focused on using data augmentation techniques on sentence-level and sentence-pair natural language processing tasks such as text classification. |
| Approach: | They propose to use data augmentation techniques for named entity recognition to increase model performance. |
| Outcome: | The proposed techniques boost performance for both recurrent and transformer-based models, especially for small training sets. |