Challenge: Existing relationships between entities can be reliable indicators for classifying sensitive information, such as commercially sensitive information.
Approach: They propose to represent entities and relations within a single embedding to better capture the relationship between the entities.
Outcome: The proposed method significantly improves the effectiveness of sensitivity classification compared to existing methods.

Similar Papers

Entity or Relation Embeddings? An Analysis of Encoding Strategies for Relation Extraction (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to relation extraction use concatenating embeddings of head and tail entities . however, such representations capture the types of the entities involved, leading to false positives and confusion between relations involving entities of the same type.
Approach: They propose a model which combines [MASK] embeddings with entity embedds to learn relation embeddations.
Outcome: The proposed model outperforms the state-of-the-art on several benchmarks . it uses a self-supervised pre-training strategy which further improves the results.
PairRE: Knowledge Graph Embeddings via Paired Relation Vectors (2021.acl-long)

Copied to clipboard

Challenge: Existing knowledge graph embedding methods fail to solve two major problems at the same time, leading to unsatisfactory results.
Approach: They propose a model with paired vectors for each relation representation that can be adaptively adjusted to fit for different complex relations.
Outcome: Experiments on two knowledge graph datasets show the proposed model can handle complex relations and encode relation patterns.
Knowledge Graph Alignment with Entity-Pair Embedding (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods for Knowledge Graph (KG) alignment are not satisfactory.
Approach: They propose a method that directly learns embeddings of entity-pairs for KG alignment.
Outcome: The proposed approach can achieve state-of-the-art on five real-world datasets.
Distilling Relation Embeddings from Pretrained Language Models (2021.emnlp-main)

Copied to clipboard

Challenge: Pre-trained language models capture a surprisingly rich amount of lexical knowledge, but it is unclear to what extent relation embeddings can be used to encode relational knowledge.
Approach: They found that word vector differences capture lexical relations . relationship embeddings can be used to encode relational knowledge .
Outcome: The results are highly competitive on analogy (unsupervised) and relation classification (supervised) benchmarks, even without any task-specific fine-tuning.
Label-Free Distant Supervision for Relation Extraction via Knowledge Graph Embedding (D18-1)

Copied to clipboard

Challenge: Existing methods to generate large scale labeled data for relation extraction produce noisy relation labels when there are multiple relationships between entities.
Approach: They propose a method which assumes that a pair of entities appears in a Knowledge Graph and trains a relation classifier.
Outcome: The proposed method performs well in the current distant supervision dataset.
Retrofitting Distributional Embeddings to Knowledge Graphs with Functional Relations (C18-1)

Copied to clipboard

Challenge: Existing methods for retrofitting knowledge graph embeddings assume connected entities have similar embeddments, but these assumptions are not true for large knowledge graphs.
Approach: They propose to retrofit distributional and relational data to a knowledge graph structure . they propose to explicitly model pairwise relations to overcome these limitations .
Outcome: The proposed framework outperforms existing retrofitting methods on complex knowledge graphs and loses no accuracy on simpler graphs.
A Semantic Filter Based on Relations for Knowledge Graph Completion (2021.emnlp-main)

Copied to clipboard

Challenge: Knowledge graph embedding is a new form of knowledge graphing that allows for better link prediction.
Approach: They propose to use relational embedding to fit symmetry/antisymmetry and combination relationships.
Outcome: The proposed model can fit symmetry/antisymmetry and combination relationships.
Jointly Learning Entity and Relation Representations for Entity Alignment (D19-1)

Copied to clipboard

Challenge: Entity alignment is a viable method for integrating heterogeneous knowledge among different knowledge graphs (KGs).
Approach: They propose a Graph Convolutional Network-based framework for learning relation representations by embedding relation seeds into entities and incorporating relation approximation into entities to iteratively improve alignment.
Outcome: The proposed approach outperforms state-of-the-art methods on three real-world cross-lingual datasets.
Improving Knowledge Graph Embedding Using Simple Constraints (P18-1)

Copied to clipboard

Challenge: Recent efforts focused on designing more complicated models or incorporating extra information beyond triples.
Approach: They propose to use non-negativity constraints on entity representations and approximate entailment constraints on relation representations to improve KG embedding.
Outcome: The proposed model outperforms baseline models on WordNet, Freebase, and DBpedia.
Enhancing Contextual Word Representations Using Embedding of Neighboring Entities in Knowledge Graphs (2022.coling-1)

Copied to clipboard

Challenge: Existing methods for pre-trained language models lack explicit grounding in real-world entities.
Approach: They propose a mechanism that integrates the structure of a KG into recent PLM architectures by generalizing the embeddings of neighboring entities.
Outcome: The proposed method improves a classification task, entity typing task and language comprehension tasks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations