Deep Bidirectional Transformers for Relation Extraction without Supervision (D19-61)
Copied to clipboard
| Challenge: | Existing frameworks for relation extraction use distant supervision instead of annotated data. |
| Approach: | They propose a framework to deal with relation extraction tasks without supervision . they use syntactic parsing and pre-trained word embeddings to extract relations . |
| Outcome: | The proposed framework outperforms baselines on four biomedical datasets and achieves slightly worse results than the state-of-the-art in three out of four data sets. |
Similar Papers
Fine-tuning Pre-Trained Transformer Language Models to Distantly Supervised Relation Extraction (P19-1)
Copied to clipboard
| Challenge: | Current relation extraction methods suffer from noisy labels and incomplete knowledge base information. |
| Approach: | They propose a pre-trained language model that captures semantic and syntactic features and a significant amount of “common-sense” knowledge. |
| Outcome: | The proposed model achieves state-of-the-art AUC score of 0.422 on the NYT10 dataset and performs especially well at higher recall levels. |
Pretrained Knowledge Base Embeddings for improved Sentential Relation Extraction (2022.acl-srw)
Copied to clipboard
| Challenge: | Existing models that perform explicit on-task training of graph embeddings are inadequate. |
| Approach: | They propose to combine pretrained knowledge base graph embeddings with transformer based language models to improve performance on sentential Relation Extraction task. |
| Outcome: | The proposed model outperforms state-of-the-art models on the sentential Relation Extraction task. |
Label-Free Distant Supervision for Relation Extraction via Knowledge Graph Embedding (D18-1)
Copied to clipboard
| Challenge: | Existing methods to generate large scale labeled data for relation extraction produce noisy relation labels when there are multiple relationships between entities. |
| Approach: | They propose a method which assumes that a pair of entities appears in a Knowledge Graph and trains a relation classifier. |
| Outcome: | The proposed method performs well in the current distant supervision dataset. |
GAN Driven Semi-distant Supervision for Relation Extraction (N19-1)
Copied to clipboard
| Challenge: | Existing methods for relation extraction are limited to costly hand-labeled training sets and hard to be extended to large-scale relations. |
| Approach: | They propose a semi-distant supervision approach for relation extraction by constructing a small accurate dataset and properly leveraging numerous instances without relation labels. |
| Outcome: | The proposed approach achieves significant improvements over baselines on real-world datasets. |
Denoising Relation Extraction from Document-level Distant Supervision (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to generate auto-labeled sentences for relation extraction (RE) are difficult to extend to document-level relation extraction as noise from DS may be even multiplied in documents. |
| Approach: | They propose a pre-trained model which de-emphasizes noisy DS data via multiple pre-training tasks. |
| Outcome: | The proposed model can capture useful information from noisy data and achieve promising results on the large-scale DocRE benchmark. |
Dependency Parsing-Based Syntactic Enhancement of Relation Extraction in Scientific Texts (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a pipeline approach to extract entities and relations from scientific text is challenging due to long sentences with densely packed entities. |
| Approach: | They propose a syntactic filtering method that prunes unlikely entity pairs before relation prediction. |
| Outcome: | The proposed method improves Rel+ F1 scores on SciERC, SciER, and ACE05 datasets. |
Semi-automatic Data Enhancement for Document-Level Relation Extraction with Distant Supervision from Large Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Document-level Relation Extraction (DocRE) is a task that aims to extract relations from a long context. |
| Approach: | They propose an automated annotation method that integrates an LLM and a natural language inference module to generate relation triples. |
| Outcome: | The proposed method can extract relations from document-level relation datasets with minimal human effort. |
Global Relation Embedding for Relation Extraction (N18-1)
Copied to clipboard
| Challenge: | Existing methods to extract textual relations with distant supervision are limited by their reliance on supervised training data. |
| Approach: | They propose to embed relations with global statistics of relations to combat the wrong labeling problem of distant supervision. |
| Outcome: | The proposed method is more robust to training noise introduced by distant supervision and improves relation extraction models. |
Uncover the Ground-Truth Relations in Distant Supervision: A Neural Expectation-Maximization Framework (D19-1)
Copied to clipboard
| Challenge: | Existing methods for relation extraction assume that text is noisy, but its corresponding labels are clean. |
| Approach: | They propose a framework that combines neural network and probabilistic modelling to denoise noisy relation labels. |
| Outcome: | The proposed framework improves the current art in uncovering the ground-truth relation labels. |
Combining Distant and Direct Supervision for Neural Relation Extraction (N19-1)
Copied to clipboard
| Challenge: | Existing methods to train relation extraction with distant supervision use noisy labels and implicitly assumes that all the KB facts are mentioned in the text. |
| Approach: | They propose to combine distant supervision data with additional directly-supervised data to train relation extraction models by using sigmoidal attention weights with max pooling. |
| Outcome: | The proposed method achieves state-of-the-art on the widely used FB-NYT dataset. |