Challenge: Existing studies have addressed this problem with partial-label loss, but they suffer from confirmation bias, which means the classifier fit a pseudo data distribution given by itself.
Approach: They propose to regularize distantly supervised models with Compact Latent Space Clustering to bypass this problem and effectively utilize noisy data yet.
Outcome: The proposed model outperforms state-of-the-art models on standard benchmarks on fine-grained entity typing (FET) by a significant margin.

Similar Papers

Leveraging Label Semantics and Entity Description Generation for LLM-based Fine-grained Entity Typing (2026.findings-acl)

Copied to clipboard

Challenge: Fine-grained entity typing (FET) aims to assign semantically rich and contextually appropriate types to entity mentions.
Approach: They propose a descriptor-based retrieval-augmented framework that reduces effective label space . they propose to use natural language descriptores as an intermediate semantic representation .
Outcome: The proposed framework outperforms existing methods under noisy supervision.
Ultra-Fine Entity Typing with Prior Knowledge about Labels: A Simple Clustering Based Strategy (2023.findings-emnlp)

Copied to clipboard

Challenge: Ultra-fine entity typing is a task of inferring the semantic types from a large set of fine-grained candidates that apply to a given entity mention.
Approach: They propose to use pre-trained label embeddings to cluster the labels into semantic domains and treat them as additional types.
Outcome: The proposed method improves the performance of existing models with high quality embeddings.
Neural Fine-Grained Entity Type Classification with Hierarchy-Aware Loss (N18-1)

Copied to clipboard

Challenge: Existing methods for fine-grained type classification rely on distant supervision and are susceptible to noisy labels that can be out-of-context or overly-specific.
Approach: They propose a neural network model that uses cross-entropy loss function to handle out-of-context labels and hierarchical loss normalization to cope with overly-specific ones.
Outcome: The proposed model outperforms the state-of-the-art on established benchmarks for the task.
EnCore: Fine-Grained Entity Typing by Pre-Training Entity Encoders on Coreference Chains (2024.eacl-long)

Copied to clipboard

Challenge: Entity typing is the task of assigning semantic types to entities mentioned in text.
Approach: They propose to pre-train an entity encoder such that embeddings of coreferring entities are more similar to each other.
Outcome: The proposed method improves state-of-the-art on fine-grained entity typing and entity extraction.
From Ultra-Fine to Fine: Fine-tuning Ultra-Fine Entity Typing Models to Fine-grained (2023.acl-long)

Copied to clipboard

Challenge: Existing approaches to fine-grained entity typing are limited by the errors in the annotation process.
Approach: They propose a method that can be used to fine-tune a model to a new type schema without creating distantly labeled data.
Outcome: The proposed approach outperforms state-of-the-art weak supervision based methods under the few-shot setting.
Learning to Denoise Distantly-Labeled Data for Entity Typing (N19-1)

Copied to clipboard

Challenge: Distantly-labeled data can be used to scale up statistical models, but it is noisy . specialized probabilistic models can be employed to scale the training of models, however, they require sophisticated probabilistic inference for the training.
Approach: They propose a method for denoising and denoising noisy data with supervised training.
Outcome: The proposed method outperforms models trained on clean and denoised data on an ultra-fine entity typing task.
Fine-grained Entity Typing without Knowledge Base (2021.emnlp-main)

Copied to clipboard

Challenge: Existing work on fine-grained entity typing (FET) relies on knowledge bases as distant supervision, but lack of or incompleteness of KB can hinder training.
Approach: They propose a two-step framework that trains FET models without accessing any knowledge base.
Outcome: The proposed framework achieves competitive performance with respect to the models trained on the original KB-supervised datasets.
Improving Fine-grained Entity Typing with Entity Linking (D19-1)

Copied to clipboard

Challenge: Existing methods for fine-grained entity typing require a large tag set and knowledge of the context.
Approach: They propose a deep neural model that uses context and information from entity linking to improve fine-grained entity typing.
Outcome: The proposed model achieves 5% absolute strict accuracy improvement over the state of the art on two datasets.
Label Refinement via Contrastive Learning for Distantly-Supervised Named Entity Recognition (2022.findings-naacl)

Copied to clipboard

Challenge: Existing methods to locate and classify entities using knowledge bases and unlabeled corpus are expensive and limited application.
Approach: They propose to use a method to directly learn the distant label refinement knowledge by imitating annotations of different qualities and comparing them in contrastive learning frameworks.
Outcome: The proposed method can give modified suggestions on distant data without additional supervised labels and thus reduces the requirement on the quality of the knowledge bases.
Denoising Enhanced Distantly Supervised Ultrafine Entity Typing (2023.findings-acl)

Copied to clipboard

Challenge: Recent work on distantly supervised (DS) ultra-fine entity typing has received significant attention . however, DS data is noisy and often suffers from missing or wrong labeling issues resulting in low precision and low recall.
Approach: They propose a noise model to estimate unknown labeling noise distribution over input contexts and noisy type labels and a model to train on denoised data.
Outcome: The proposed model outperforms baseline methods on the Ultra-Fine entity typing dataset and OntoNotes dataset.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations