| Challenge: | Recent approaches to sequence labeling have been based on statistical models but a challenge is from the data sparsity problem. |
| Approach: | They propose to use local context reconstruction to implicitly incorporate contextual information into their representations. |
| Outcome: | The proposed model outperforms all previous methods on multiple benchmark datasets and achieves new start-of-the-art results. |
Similar Papers
Noise-Robust Training with Dynamic Loss and Contrastive Learning for Distantly-Supervised Named Entity Recognition (2023.findings-acl)
Copied to clipboard
| Challenge: | Named entity recognition (NER) is a task in natural language processing that aims at locating entity mentions in a given sentence and assigning them to certain types. |
| Approach: | They propose to use a dynamic loss function to better adapt to the changing noise during the training process and incorporate token level contrastive learning to fully utilize the noisy data. |
| Outcome: | The proposed method outperforms existing NER models on three benchmark datasets and outperformed existing models by significant margins. |
Distantly-Supervised Named Entity Recognition with Noise-Robust Learning and Language Model Augmented Self-Training (2021.emnlp-main)
Copied to clipboard
| Challenge: | Named entity recognition models require abundant high-quality annotations to train . distant supervision may induce incomplete and noisy labels, making supervised learning ineffective. |
| Approach: | They propose a noise-robust learning scheme for training named entity recognition models using only distantly-labeled data and a self-training method that uses contextualized augmentations created by pre-trained language models. |
| Outcome: | The proposed method outperforms existing supervised NER models on three datasets by significant margins. |
Robust Lexical Features for Improved Neural Network Named-Entity Recognition (C18-1)
Copied to clipboard
| Challenge: | Named-Entity Recognition (NER) uses word embeddings to extend, rather than replace, hand-crafted features. |
| Approach: | They propose to embed words and entity types into a low-dimensional vector space and compute a feature vector representing each word offline. |
| Outcome: | The proposed representations outperform existing models and achieve state-of-the-art performance. |
Design Challenges and Misconceptions in Neural Sequence Labeling (C18-1)
Copied to clipboard
| Challenge: | Existing neural sequence labeling models have been used for many tasks such as POS tagging, chunking and named entity recognition (NER). |
| Approach: | They propose to replicate twelve neural sequence labeling models and compare them to three benchmarks to find out which models are effective and which are inconsistent. |
| Outcome: | The proposed models are compared on NER, Chunking, and POS tagging benchmarks. |
Learning from Noisy Labels for Entity-Centric Information Extraction (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent information extraction approaches can easily overfit noisy labels and suffer from performance degradation. |
| Approach: | They propose a co-regularization framework for entity-centric information extraction that optimizes neural models with task-specific losses and regularizes them to generate similar predictions based on agreement loss. |
| Outcome: | The proposed framework is optimized with task-specific losses and generates similar predictions based on agreement loss. |
Overcoming the Rare Word Problem for low-resource language pairs in Neural Machine Translation (D19-52)
Copied to clipboard
| Challenge: | Despite above approaches can improve the prediction of rare words, they still have challenges which have adverse effects on its effectiveness. |
| Approach: | They propose three ways to address rare-word problem in neural machine translation systems . they propose an algorithm to learn morphology of unknown words for English in supervised way to minimize adverse effect of rare- word problem. |
| Outcome: | The proposed approaches improve accuracy on two low-resource language pairs. |
Improving Lexical Choice in Neural Machine Translation (N18-1)
Copied to clipboard
| Challenge: | False positives: the output layer rewards frequent words disproportionately, we argue . Falsibles: a model that learns word representations in continuous space tends to translate rare words . |
| Approach: | They propose to fix the norms of both vectors to a constant value and integrate a lexical module which is jointly trained with the rest of the model. |
| Outcome: | The proposed approach achieves improvements of up to +4.3 BLEU surpassing phrase-based translation in nearly all settings. |
Towards Improving Neural Named Entity Recognition with Gazetteers (P19-1)
Copied to clipboard
| Challenge: | Currently, neural models for named entity recognition are based on data-driven models, with a strong emphasis on getting rid of the efforts for collecting external resources or designing hand-crafted features. |
| Approach: | They propose to use external gazetteers to efficiently access annotated data to generalize beyond the annotation of entities. |
| Outcome: | The proposed model can access external gazetteers while avoiding the effort to design hand-crafted features. |
Entity Disambiguation on a Tight Labeling Budget (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to training entity disambiguation models require a small labeling budget . a defense research analyst might need to map military equipment to a knowledge base describing emergent defense technologies. |
| Approach: | They propose a method that combines feature diversity with low rank correction . they use bilinear tensor models to train a model that uses a rich representation of context . |
| Outcome: | The proposed approach reduces the amount of labeled data necessary to achieve a given performance. |
Learning Named Entity Tagger using Domain-Specific Dictionary (D18-1)
Copied to clipboard
| Challenge: | Existing methods to build reliable named entity recognition systems require large amounts of manually-labeled training data. |
| Approach: | They propose a revised fuzzy CRF layer to handle tokens with multiple possible labels to address noisy distant supervision. |
| Outcome: | The proposed model can handle tokens with multiple possible labels under the traditional framework and improves on the existing model with a new Tie or Break scheme. |