Challenge: Existing methods for relation extraction treat labels as independent and meaningless one-hot vectors, which cause a loss of potential label information for selecting valid instances.
Approach: They propose a multi-layer attention-based model to improve relation extraction with joint label embedding by gating integration and using the embeddable entities as an atten- tion.
Outcome: The proposed model significantly outperforms state-of-the-art methods in relation extraction with joint label embedding.

Similar Papers

Label-Free Distant Supervision for Relation Extraction via Knowledge Graph Embedding (D18-1)

Copied to clipboard

Challenge: Existing methods to generate large scale labeled data for relation extraction produce noisy relation labels when there are multiple relationships between entities.
Approach: They propose a method which assumes that a pair of entities appears in a Knowledge Graph and trains a relation classifier.
Outcome: The proposed method performs well in the current distant supervision dataset.
Global Relation Embedding for Relation Extraction (N18-1)

Copied to clipboard

Challenge: Existing methods to extract textual relations with distant supervision are limited by their reliance on supervised training data.
Approach: They propose to embed relations with global statistics of relations to combat the wrong labeling problem of distant supervision.
Outcome: The proposed method is more robust to training noise introduced by distant supervision and improves relation extraction models.
Distantly-Supervised Joint Extraction with Noise-Robust Learning (2024.findings-acl)

Copied to clipboard

Challenge: Existing approaches to identifying entity pairs and relations with a single model are noisy . Existing methods only consider one source of noise or make decisions using external knowledge .
Approach: They propose a framework that aligns entity mentions with corresponding tags for joint extraction . they propose DENRL, which employs a lightweight transformer backbone for joint tagging .
Outcome: The proposed framework outperforms baseline models on two benchmark datasets with better interpretability.
Combining Distant and Direct Supervision for Neural Relation Extraction (N19-1)

Copied to clipboard

Challenge: Existing methods to train relation extraction with distant supervision use noisy labels and implicitly assumes that all the KB facts are mentioned in the text.
Approach: They propose to combine distant supervision data with additional directly-supervised data to train relation extraction models by using sigmoidal attention weights with max pooling.
Outcome: The proposed method achieves state-of-the-art on the widely used FB-NYT dataset.
Hierarchical Relation Extraction with Coarse-to-Fine Grained Attention (D18-1)

Copied to clipboard

Challenge: Existing methods for relation extraction use knowledge graphs to automatically label training data . but, it suffers from the wrong labeling problem because not all sentences containing two entities can express their relations in KGs .
Approach: They propose a distant supervision approach to automatically label training instances . they integrate hierarchical information of relations into distantly supervised relation extraction .
Outcome: The proposed model outperforms baseline models on a large-scale dataset.
Learning Attention-based Embeddings for Relation Prediction in Knowledge Graphs (P19-1)

Copied to clipboard

Challenge: Existing knowledge graphs (KGs) are incomplete or partial information, in the form of missing relations between entities, which gives rise to the task of knowledge base completion (also known as relation prediction).
Approach: They propose to capture both entity and relation features in any given neighborhood and encapsulate relation clusters and multi-hop relations in their attention-based model.
Outcome: The proposed model captures both entity and relation features in any given neighborhood and also encapsulates relation clusters and multi-hop relations.
Entity or Relation Embeddings? An Analysis of Encoding Strategies for Relation Extraction (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to relation extraction use concatenating embeddings of head and tail entities . however, such representations capture the types of the entities involved, leading to false positives and confusion between relations involving entities of the same type.
Approach: They propose a model which combines [MASK] embeddings with entity embedds to learn relation embeddations.
Outcome: The proposed model outperforms the state-of-the-art on several benchmarks . it uses a self-supervised pre-training strategy which further improves the results.
Joint Embedding of Words and Labels for Text Classification (P18-1)

Copied to clipboard

Challenge: Existing approaches to text classification use word embeddings to capture semantic regularities between words.
Approach: They propose to view text classification as a label-word joint embedding problem . they use a framework that measures compatibility between text sequences and labels .
Outcome: The proposed framework outperforms the state-of-the-art methods on large text datasets.
CARE: Co-Attention Network for Joint Entity and Relation Extraction (2024.lrec-main)

Copied to clipboard

Challenge: Existing joint entity and relation extraction methods suffer from feature confusion or inadequate interaction between the two subtasks.
Approach: They propose a Co-Attention network for joint entity and relation extraction that adopts a parallel encoding strategy to learn separate representations for each subtask.
Outcome: The proposed model outperforms existing models on three datasets . it uses a parallel encoding strategy to learn separate representations for each subtask .
Relabel the Noise: Joint Extraction of Entities and Relations via Cooperative Multiagents (2020.acl-main)

Copied to clipboard

Challenge: Existing methods for entity and relation extraction require light human annotation efforts.
Approach: They propose a method to re-label noisy instances with a cooperative group . they use a confidence consensus module to gather the wisdom of all agents .
Outcome: The proposed model outperforms state-of-the-art methods on two real-world datasets.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations