MANNER: A Variational Memory-Augmented Model for Cross Domain Few-Shot Named Entity Recognition (2023.acl-long)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is a fundamental NLP task that aims at classifying mention spans into entity types. |
| Approach: | They propose a variational memory-augmented few-shot named entity recognition model that uses a memory module to store information from source domain and retrieve relevant information from the memory to augment few-shot task in target domain. |
| Outcome: | The proposed model can adapt the learned knowledge from source domain to target domain and achieve superior performance on English and Chinese cross domain few-shot NER datasets. |
Similar Papers
Improving Few-Shot Cross-Domain Named Entity Recognition by Instruction Tuning a Word-Embedding based Retrieval Augmented Large Language Model (2024.emnlp-industry)
Copied to clipboard
| Challenge: | Existing approaches to named entity recognition are domain specific and require a domain specific architecture. |
| Approach: | They propose a retrieval augmented large language model for Named Entity Recognition . the model uses word-embedding over sentence-level embedding to fine tune . |
| Outcome: | The proposed model outperforms existing models on the CrossNER dataset. |
FactMix: Using a Few Labeled In-domain Examples to Generalize to Cross-domain Named Entity Recognition (2022.coling-1)
Copied to clipboard
| Challenge: | Existing approaches for few-shot Named Entity Recognition (NER) are evaluated mainly under in-domain settings, but little is known about how these models perform in cross-domain NER using labeled in- domain examples. |
| Approach: | They propose to use a rationale-centric data augmentation method to improve model generalization ability by allowing model to learn from a few labeled examples in a new target domain. |
| Outcome: | The proposed method improves the performance of cross-domain NER tasks compared to the counterfactual data augmentation and prompt-tuning methods. |
Structure and Label Constrained Data Augmentation for Cross-domain Few-shot NER (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Named entity recognition (NER) tasks require large datasets with accurate annotations that are labor-intensive and time-consuming. |
| Approach: | They propose a method to leverage domain gaps to model cross-domain few-shot named entity recognition (NER) NER is a natural language processing task to detect entity mentions and classify them into predefined labels . |
| Outcome: | The proposed method achieves state-of-the-art or competitive results on standard datasets. |
Data Augmentation for Cross-Domain Named Entity Recognition (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for named entity recognition focus on augmenting in-domain data in low-resource scenarios where annotated data is limited. |
| Approach: | They propose a neural architecture to transform data from high-resource to low-resourced domains by learning the patterns in the text that differentiate them. |
| Outcome: | The proposed approach improves on high-resource domain representations over high- and low-resourced domains. |
CONTaiNER: Few-Shot Named Entity Recognition via Contrastive Learning (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods for Named Entity Recognition only learn class-specific semantic features and intermediate representations from source domains, resulting in suboptimal performance. |
| Approach: | They propose a contrastive learning technique that optimizes the inter-token distribution distance for Few-Shot NER. |
| Outcome: | The proposed technique outperforms existing methods by 3%-13% absolute F1 points while showing consistent performance trends. |
PDALN: Progressive Domain Adaptation over a Pre-trained Model for Low-Resource Cross-Domain Named Entity Recognition (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to Named Entity Recognition (NER) are limited in labeled resources and domain shift. |
| Approach: | They propose a progressive domain adaptation knowledge distillation approach to adapt high-resource domains to low-resourced target domains by employing three components to achieve superior domain adaptability. |
| Outcome: | The proposed approach can adapt high-resource domains to low-resourced target domains even if they are diverse in terms and writing styles. |
Few-Shot Named Entity Recognition: An Empirical Baseline Study (2021.emnlp-main)
Copied to clipboard
Jiaxin Huang, Chunyuan Li, Krishan Subudhi, Damien Jose, Shobana Balakrishnan, Weizhu Chen, Baolin Peng, Jianfeng Gao, Jiawei Han
| Challenge: | Existing methods to build named entity recognition systems with limited labeled data are lacking. |
| Approach: | They propose three orthogonal schemes to build named entity recognition systems when labeled data is limited. |
| Outcome: | The proposed NER systems outperform existing methods on few-shot and training-free settings. |
Few-Shot Class-Incremental Learning for Named Entity Recognition (2022.acl-long)
Copied to clipboard
| Challenge: | Existing models of Named Entity Recognition (NER) are trained on large datasets with predefined entity classes, but data of new classes arrives constantly. Existing work on NER relies on the assumption that there exists abundance of labeled data for the training of new class. |
| Approach: | They propose a few-shot class-incremental learning problem where NER model is trained with only few labeled samples of the new classes without forgetting knowledge of the old ones. |
| Outcome: | The proposed model improves over existing baselines by reconstructing training data of old classes and real data from the training set. |
Learning from Miscellaneous Other-Class Words for Few-shot Named Entity Recognition (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods to classify named entity mentions with fewshots fail to differentiate rich semantics in other-class words, which will aggravate overfitting under few shot scenario. |
| Approach: | They propose a model that can automatically induce different unde- fined classes from the other class to improve few-shot Named Entity Recognition (NER) . |
| Outcome: | The proposed model outperforms five state-of-the-art models in 1- shot and 5-shots settings on four NER bench marks. |
Causal Intervention-based Few-Shot Named Entity Recognition (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to perform few-shot named entity recognition are limited and overfitting is caused by the spurious correlation resulting from the bias in selecting a few samples. |
| Approach: | They propose a causal intervention-based few-shot named entity recognition method that blocks the backdoor path between context and label. |
| Outcome: | The proposed method achieves state-of-the-art in a few-shot named entity recognition (NER) task. |