Challenge: Existing methods for labeling relational facts require significant expert labor to write relation-specific patterns, which makes them too sophisticated to generalize quickly.
Approach: They propose a neural pattern diagnosis framework that can summarize and refine relation-specific patterns with human experts in the loop.
Outcome: The proposed framework can summarize and refine high-quality relational patterns from noise data with human experts in the loop.

Similar Papers

Uncover the Ground-Truth Relations in Distant Supervision: A Neural Expectation-Maximization Framework (D19-1)

Copied to clipboard

Challenge: Existing methods for relation extraction assume that text is noisy, but its corresponding labels are clean.
Approach: They propose a framework that combines neural network and probabilistic modelling to denoise noisy relation labels.
Outcome: The proposed framework improves the current art in uncovering the ground-truth relation labels.
PARE: A Simple and Strong Baseline for Monolingual and Multilingual Distantly Supervised Relation Extraction (2022.acl-short)

Copied to clipboard

Challenge: Recent approaches to distantly supervised relation extraction (DS-RE) encode each sentence in an entity-pair bag separately.
Approach: They propose a simple baseline approach where sentences of a bag are concatenated into a passage of sentences and encoded jointly using BERT.
Outcome: The proposed approach outperforms state-of-the-art models in monolingual and multilingual datasets.
Towards Accurate and Consistent Evaluation: A Dataset for Distantly-Supervised Relation Extraction (2020.coling-main)

Copied to clipboard

Challenge: Distant Supervision (DS) generates large-scale annotated data but has wrong labels that result in incorrect evaluation scores during testing.
Approach: They build a dataset using DS-generated data as training data and hire annotators to label test data.
Outcome: The proposed dataset NYTH has a much larger test set and performs more accurate and consistent evaluation.
Distantly-Supervised Joint Extraction with Noise-Robust Learning (2024.findings-acl)

Copied to clipboard

Challenge: Existing approaches to identifying entity pairs and relations with a single model are noisy . Existing methods only consider one source of noise or make decisions using external knowledge .
Approach: They propose a framework that aligns entity mentions with corresponding tags for joint extraction . they propose DENRL, which employs a lightweight transformer backbone for joint tagging .
Outcome: The proposed framework outperforms baseline models on two benchmark datasets with better interpretability.
Fine-tuning Pre-Trained Transformer Language Models to Distantly Supervised Relation Extraction (P19-1)

Copied to clipboard

Challenge: Current relation extraction methods suffer from noisy labels and incomplete knowledge base information.
Approach: They propose a pre-trained language model that captures semantic and syntactic features and a significant amount of “common-sense” knowledge.
Outcome: The proposed model achieves state-of-the-art AUC score of 0.422 on the NYT10 dataset and performs especially well at higher recall levels.
Two Training Strategies for Improving Relation Extraction over Universal Graph (2021.eacl-main)

Copied to clipboard

Challenge: Existing methods for Distantly Supervised Relation Extraction (DS-RE) with a UG may lead to degradation in performance.
Approach: They propose to use a Universal Graph (UG) to train a distantly supervised relation extraction model.
Outcome: The proposed training strategies on biomedical and NYT10 datasets prove the robustness of the proposed methods and achieve state-of-the-art results.
Combining Distant and Direct Supervision for Neural Relation Extraction (N19-1)

Copied to clipboard

Challenge: Existing methods to train relation extraction with distant supervision use noisy labels and implicitly assumes that all the KB facts are mentioned in the text.
Approach: They propose to combine distant supervision data with additional directly-supervised data to train relation extraction models by using sigmoidal attention weights with max pooling.
Outcome: The proposed method achieves state-of-the-art on the widely used FB-NYT dataset.
Denoising Relation Extraction from Document-level Distant Supervision (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods to generate auto-labeled sentences for relation extraction (RE) are difficult to extend to document-level relation extraction as noise from DS may be even multiplied in documents.
Approach: They propose a pre-trained model which de-emphasizes noisy DS data via multiple pre-training tasks.
Outcome: The proposed model can capture useful information from noisy data and achieve promising results on the large-scale DocRE benchmark.
Manual Evaluation Matters: Reviewing Test Protocols of Distantly Supervised Relation Extraction (2021.findings-acl)

Copied to clipboard

Challenge: Distantly supervised relation extraction (RE) has attracted much attention in the past few years . previous methods to evaluate models manually or directly on autolabeled data have produced inaccurate evaluations .
Approach: They propose to use distant supervision to generate large-scale autolabeled data . they build manually-annotated test sets for two DS-RE datasets and evaluate models .
Outcome: The proposed method produces 53% wrong labels at the entity pair level in the popular NYT10 dataset.
Active Testing: An Unbiased Evaluation Method for Distantly Supervised Relation Extraction (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for distantly supervised relation extraction suffer from low quality of test set, which leads to considerable biased performance evaluation.
Approach: They propose a method to evaluate distantly supervised relation extraction using noisy test sets and manual annotations.
Outcome: Experiments on a widely used benchmark show that the proposed method can yield approximately unbiased evaluations for distantly supervised relation extractors.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations