Challenge: Existing named entity recognition systems require large amounts of human annotated training data.
Approach: They propose a fully unsupervised named entity recognition model which takes clues from pre-trained word embeddings.
Outcome: The proposed model can be trained on two CoNLL benchmark datasets without annotating lexicon or corpus.

Similar Papers

Distantly Supervised Named Entity Recognition using Positive-Unlabeled Learning (P19-1)

Copied to clipboard

Challenge: Empirical studies on four public NER datasets demonstrate the effectiveness of our proposed method.
Approach: They propose a method to perform named entity recognition using unlabeled data and named entity dictionaries.
Outcome: The proposed method can estimate task loss as if there is fully labeled data.
Coarse-to-Fine Pre-training for Named Entity Recognition (2020.emnlp-main)

Copied to clipboard

Challenge: Named Entity Recognition (NER) is a task of discovering information entities and identifying their corresponding categories.
Approach: They propose a NER-specific framework to inject coarse-to-fine named entity knowledge into pre-trained models by using a remote supervision strategy.
Outcome: The proposed framework achieves significant improvements against several pre-trained base-lines, demonstrating its effectiveness in label-few and low-resource scenarios.
CleanCoNLL: A Nearly Noise-Free Named Entity Recognition Dataset (2023.emnlp-main)

Copied to clipboard

Challenge: Existing models achieve F1-scores comparable to or exceed noise level in CoNLL-03 . current models have significant annotation errors, incompleteness, and inconsistencies in the data .
Approach: They propose to add a layer of entity linking annotation to the CoNLL-03 corpus to correct 7.0% of all labels.
Outcome: The proposed approach corrects 7.0% of all labels in the English CoNLL-03 dataset.
Nested Named Entity Recognition with Span-level Graphs (2022.acl-long)

Copied to clipboard

Challenge: Named entity recognition is one of the major subtasks of information extraction for extracting categorized named entities from unstructured text.
Approach: They propose to use retrieval-based span-level graphs to connect spans and entities in the training data based on n-gram features to integrate information of similar neighbor entities into the span representation.
Outcome: The proposed method achieves general improvements on all three benchmarks and special superiority on low frequency entities.
Deep Exhaustive Model for Nested Named Entity Recognition (D18-1)

Copied to clipboard

Challenge: Named entity recognition (NER) is a task of finding entities with specific semantic types such as Protein, Cell, and RNA in text.
Approach: They propose a deep neural model for nested named entity recognition . they enumerate all possible regions or spans as potential entity mentions .
Outcome: The proposed model outperforms state-of-the-art models on nested and flat NER . it achieves 77.1% and 78.4% respectively in terms of F-score, without external knowledge resources.
Robust Lexical Features for Improved Neural Network Named-Entity Recognition (C18-1)

Copied to clipboard

Challenge: Named-Entity Recognition (NER) uses word embeddings to extend, rather than replace, hand-crafted features.
Approach: They propose to embed words and entity types into a low-dimensional vector space and compute a feature vector representing each word offline.
Outcome: The proposed representations outperform existing models and achieve state-of-the-art performance.
Self-Adaptive Named Entity Recognition by Retrieving Unstructured Knowledge (2023.eacl-main)

Copied to clipboard

Challenge: Named entity recognition (NER) is costly because of lack of training data and domain experts.
Approach: They propose a self-adaptive neural model that retrieves external knowledge from unstructured text to learn the usages of entities that have not been learned well.
Outcome: The proposed model outperforms strong baselines on cross-neuro-ner datasets by 2.35 points in F1 metric.
Enhancing Deep Learning with Embedded Features for Arabic Named Entity Recognition (2022.lrec-1)

Copied to clipboard

Challenge: Word embeddings can capture the semantics of words and other hidden features, but the Arabic language is complex and requires a large amount of information to process.
Approach: They propose to add morphological and syntactical features to Arabic word embeddings to train the model.
Outcome: The proposed model outperforms the previous systems to the best of our knowledge.
Named Entity Recognition as Dependency Parsing (2020.acl-main)

Copied to clipboard

Challenge: Named Entity Recognition (NER) is a fundamental task in Natural Language Processing, concerned with identifying spans of text expressing references to entities.
Approach: They propose a method to handle both types of NEs in one system by using a biaffine dependency parsing model which scores pairs of start and end tokens in a sentence.
Outcome: The proposed model performs well on 8 corpora and achieves accuracy gains of up to 2.2 percentage points.
Distantly-Supervised Named Entity Recognition with Noise-Robust Learning and Language Model Augmented Self-Training (2021.emnlp-main)

Copied to clipboard

Challenge: Named entity recognition models require abundant high-quality annotations to train . distant supervision may induce incomplete and noisy labels, making supervised learning ineffective.
Approach: They propose a noise-robust learning scheme for training named entity recognition models using only distantly-labeled data and a self-training method that uses contextualized augmentations created by pre-trained language models.
Outcome: The proposed method outperforms existing supervised NER models on three datasets by significant margins.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations