| Challenge: | Named entity recognition (NER) is the task of identifying spans that belong to particular categories, such as person, location, organization, etc. |
| Approach: | They propose a method that integrates named entity’s type information into BERT by an adapter layer and integrates it into a gazetteer. |
| Outcome: | The proposed method outperforms baselines in multiple corpus. |
Similar Papers
Entity Enhanced BERT Pre-training for Chinese NER (2020.emnlp-main)
Copied to clipboard
| Challenge: | Character-level BERT pre-trained in Chinese suffers from lacking lexicon information, which shows effectiveness for Chinese NER. |
| Approach: | They propose a semi-supervised method to integrate lexicon into pre-trained LMs in Chinese . they extract an entity lexiconal from raw text and integrate it into BERT . |
| Outcome: | The proposed method is highly effective and achieves the best results on a news dataset and two datasets annotated by the authors. |
Toward Recognizing More Entity Types in NER: An Efficient Implementation using Only Entity Lexicons (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing named entity recognition systems require large scale labeled data to perform, while annotation of NER data is laborious and time-consuming. |
| Approach: | They propose to adjust an existing named entity recognition system to recognize entity types not defined in the system. |
| Outcome: | The proposed method can be quickly adjusted to a named entity recognition system. |
E-BERT: Efficient-Yet-Effective Entity Embeddings for BERT (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to enhance BERT with factual knowledge about entities require no additional pretraining and no changes to the encoder itself. |
| Approach: | They propose a way to inject factual knowledge into the pretrained BERT model by aligning Wikipedia2Vec entity vectors with BERT's native wordpiece vector space and feeding the aligned entity vector into BERT as if they were wordpieces. |
| Outcome: | The proposed version outperforms baseline models on unsupervised question answering, supervised relation classification and entity linking tasks. |
Toward Fully Exploiting Heterogeneous Corpus:A Decoupled Named Entity Recognition Model with Two-stage Training (2021.findings-acl)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is a fundamental and widely used task in natural language processing. |
| Approach: | They propose a decoupled NER model with two-stage training to take advantage of heterogeneous corpus, including dictionaries, distantly supervised instances, and human-annotated instances. |
| Outcome: | Empirical results show that the proposed model improves against baselines and can be scaled to a large extent. |
A Primer in BERTology: What We Know About How BERT Works (2020.tacl-1)
Copied to clipboard
| Challenge: | a new study examines the current state of knowledge about the BERT model . the model is a stack of transformer encoder layers that are based on multiple self-attention ''heads'' |
| Approach: | They present a survey of over 150 studies of the popular Transformer-based model BERT . they discuss the current state of knowledge about how BERT works and how it is represented . |
| Outcome: | The proposed model is based on the Transformer-based model with state-of-the-art results . the proposed model has little cognitive motivation and is too small to perform ablation studies . |
TEBNER: Domain Specific Named Entity Recognition with Type Expanded Boundary-aware Network (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to label data and identify entities require large amounts of manually annotated texts for training supervised models. |
| Approach: | They propose a dictionary extension method which extracts new entities through the type expanded model. |
| Outcome: | The proposed method outperforms state-of-the-art supervised systems on different types of datasets and surpasses supervised models. |
ToNER: Type-oriented Named Entity Recognition with Generative Language Model (2024.lrec-main)
Copied to clipboard
| Challenge: | Input too many potential entity types would distract the model inevitably. |
| Approach: | They propose to use a generative model to exploit entity types' merit on promoting NER task by appending a type matching model to identify the entity types most likely to appear in the sentence. |
| Outcome: | The proposed framework exploits entity types' merit on promoting NER task by adding auxiliary task to the model to discover the entity types. |
Taxonomy Expansion for Named Entity Recognition (2023.emnlp-main)
Copied to clipboard
Karthikeyan K, Yogarshi Vyas, Jie Ma, Giovanni Paolini, Neha John, Shuai Wang, Yassine Benajiba, Vittorio Castelli, Dan Roth, Miguel Ballesteros
| Challenge: | Training a Named Entity Recognition model involves fixing a taxonomy of entity types . however, requirements evolve and a model may need to recognize additional entity types. |
| Approach: | They propose a method that uses only partially annotated datasets to train a model to recognize additional entity types. |
| Outcome: | The proposed approach performs better with partially annotated datasets than other approaches . the gap between the proposed approach and other approaches is large in additional datasets . |
Towards Improving Neural Named Entity Recognition with Gazetteers (P19-1)
Copied to clipboard
| Challenge: | Currently, neural models for named entity recognition are based on data-driven models, with a strong emphasis on getting rid of the efforts for collecting external resources or designing hand-crafted features. |
| Approach: | They propose to use external gazetteers to efficiently access annotated data to generalize beyond the annotation of entities. |
| Outcome: | The proposed model can access external gazetteers while avoiding the effort to design hand-crafted features. |
Extending Multilingual BERT to Low-Resource Languages (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Multilingual BERT (M-BERT) has been a huge success in both supervised and zero-shot cross-lingual transfer learning. |
| Approach: | They propose a simple but effective approach to extend multilingual BERT to any new language and show an increase in F1 on M-BERT and new languages. |
| Outcome: | The proposed approach improves on languages already in M-BERT and out of it on other languages. |