| Challenge: | Existing Entity typing models suffer from noisy labels due to distant supervision . |
| Approach: | They propose to enhance existing entity typing models with language model enhancement to measure compatibility between context sentences and labels. |
| Outcome: | The proposed model significantly outperforms the state-of-the-art model on benchmark datasets and is available on github. |
Similar Papers
Improving Fine-grained Entity Typing with Entity Linking (D19-1)
Copied to clipboard
| Challenge: | Existing methods for fine-grained entity typing require a large tag set and knowledge of the context. |
| Approach: | They propose a deep neural model that uses context and information from entity linking to improve fine-grained entity typing. |
| Outcome: | The proposed model achieves 5% absolute strict accuracy improvement over the state of the art on two datasets. |
Ultra-Fine Entity Typing with Weak Supervision from a Masked Language Model (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for fine-grained entity typing use weak labels that are automatically generated. |
| Approach: | They propose to obtain training data by using a BERT Masked Language Model (MLM) given a mention in a sentence, they construct an input for the MLM so it predicts context dependent hypernyms of the mention, which can be used as type labels. |
| Outcome: | The proposed model improves performance by using type labels generated from a BERT Masked Language Model given a mention in a sentence. |
Ultra-fine Entity Typing with Indirect Supervision from Natural Language Inference (2022.tacl-1)
Copied to clipboard
| Challenge: | Existing methods for ultra-fine entity typing fail to capture type semantics because of the large number of types and the scarcity of data per type. |
| Approach: | They propose a method that formulates entity typing as a natural language inference problem . they use indirect supervision from NLI to infer type information as textual hypotheses . |
| Outcome: | The proposed method achieves state-of-the-art performance on the ultra-fine entity typing task with limited training data. |
Does Your Model Classify Entities Reasonably? Diagnosing and Mitigating Spurious Correlations in Entity Typing (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing entity typing models are subject to spurious correlations due to shortcuts and biased training. |
| Approach: | They propose a method to augment existing model biases by combining spurious correlations with debiasedcounterparts to improve generalization. |
| Outcome: | The proposed method improves generalization of different entity typing models on the original and debiased test sets. |
Generative Entity Typing with Curriculum Learning (2022.emnlp-main)
Copied to clipboard
| Challenge: | Entity typing fails to assign an entity to the types beyond the predefined type set. |
| Approach: | They propose a generative entity typing paradigm that assigns types to entities . traditional classification-based approaches fail to assign entities to the types beyond the predefined set . they employ curriculum learning to train the model on heterogeneous data . |
| Outcome: | The proposed model outperforms the state-of-the-art model on heterogeneous training data. |
Injecting Entity Types into Entity-Guided Text Generation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in deep generative modeling have led to significant advances in natural language generation (NLG). |
| Approach: | They propose to model the entity type carefully in the decoding phase to generate contextual words accurately. |
| Outcome: | The proposed model produces a target sequence based on a given list of entities. |
mLUKE: The Power of Entity Representations in Multilingual Pretrained Language Models (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods for improving multilingual models only use entity information in pretraining and do not explicitly use entities in downstream tasks. |
| Approach: | They propose to leverage Wikipedia entity representations for downstream tasks . they train a multilingual language model with 24 languages with entity representation . |
| Outcome: | The proposed model outperforms word-based models in cross-lingual transfer tasks. |
Building Language Models for Text with Named Entities (P18-1)
Copied to clipboard
| Challenge: | Existing language models fail to predict the entity names due to their wide variations. |
| Approach: | They propose a language model which can learn the entity names by leveraging their entity type information. |
| Outcome: | The proposed model achieves 52.2% better perplexity in recipe generation and 22.06% on code generation than state-of-the-art language models. |
EnCore: Fine-Grained Entity Typing by Pre-Training Entity Encoders on Coreference Chains (2024.eacl-long)
Copied to clipboard
| Challenge: | Entity typing is the task of assigning semantic types to entities mentioned in text. |
| Approach: | They propose to pre-train an entity encoder such that embeddings of coreferring entities are more similar to each other. |
| Outcome: | The proposed method improves state-of-the-art on fine-grained entity typing and entity extraction. |
Denoising Enhanced Distantly Supervised Ultrafine Entity Typing (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent work on distantly supervised (DS) ultra-fine entity typing has received significant attention . however, DS data is noisy and often suffers from missing or wrong labeling issues resulting in low precision and low recall. |
| Approach: | They propose a noise model to estimate unknown labeling noise distribution over input contexts and noisy type labels and a model to train on denoised data. |
| Outcome: | The proposed model outperforms baseline methods on the Ultra-Fine entity typing dataset and OntoNotes dataset. |