Challenge: Existing work on distant supervision denoising introduces false-positive (FP) and falsenegative (FN) training instances to the generated datasets.
Approach: They propose a hierarchical false-negative denoising framework for distant supervision relation extraction that denoises false-positive and false- negative training instances.
Outcome: The proposed framework can revise FN instances correctly and maintain high F1 scores even when 50% of instances have been turned into negatives.

Similar Papers

Robust Distant Supervision Relation Extraction via Deep Reinforcement Learning (P18-1)

Copied to clipboard

Challenge: Distant supervision is an efficient method for relation extraction, but it is noisy.
Approach: They propose a deep reinforcement learning strategy to generate false-positive indicators . they redistribute false positives into negative examples to reduce false positive problem .
Outcome: The proposed method significantly improves the performance of distant supervision compared to state-of-the-art systems.
Knowing False Negatives: An Adversarial Training Method for Distantly Supervised Relation Extraction (2021.emnlp-main)

Copied to clipboard

Challenge: Existing methods for relation extraction ignore the incompleteness of existing knowledge bases . current methods are too weak and cause noises when training and testing are not based on training data.
Approach: They propose a method to automatically align unstructured text with relation instances in a knowledge base . they use heuristics to leverage the memory mechanism of deep neural networks to find out possible FN samples .
Outcome: Experiments on two wildly-used benchmark datasets show the effectiveness of the proposed method.
HiCLRE: A Hierarchical Contrastive Learning Framework for Distantly Supervised Relation Extraction (2022.findings-acl)

Copied to clipboard

Challenge: Existing approaches of distantly supervised relation extraction (DSRE) focus on sentence-level or bag-level de-noising, neglecting the explicit interaction with cross levels.
Approach: They propose a hierarchical contrastive learning framework for distantly supervised relation extraction to reduce noisy sentences.
Outcome: The proposed framework outperforms baselines in various mainstream DSRE datasets.
Denoising Relation Extraction from Document-level Distant Supervision (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods to generate auto-labeled sentences for relation extraction (RE) are difficult to extend to document-level relation extraction as noise from DS may be even multiplied in documents.
Approach: They propose a pre-trained model which de-emphasizes noisy DS data via multiple pre-training tasks.
Outcome: The proposed model can capture useful information from noisy data and achieve promising results on the large-scale DocRE benchmark.
Uncover the Ground-Truth Relations in Distant Supervision: A Neural Expectation-Maximization Framework (D19-1)

Copied to clipboard

Challenge: Existing methods for relation extraction assume that text is noisy, but its corresponding labels are clean.
Approach: They propose a framework that combines neural network and probabilistic modelling to denoise noisy relation labels.
Outcome: The proposed framework improves the current art in uncovering the ground-truth relation labels.
SENT: Sentence-level Distant Relation Extraction via Negative Training (2021.acl-long)

Copied to clipboard

Challenge: Existing methods for relation extraction use bag labels, which introduce noise, to train the model.
Approach: They propose to use negative training to train a model using complementary labels to separate the noisy data from the training data.
Outcome: The proposed method improves on previous methods on sentence-level evaluation and de-noise effect.
GAN Driven Semi-distant Supervision for Relation Extraction (N19-1)

Copied to clipboard

Challenge: Existing methods for relation extraction are limited to costly hand-labeled training sets and hard to be extended to large-scale relations.
Approach: They propose a semi-distant supervision approach for relation extraction by constructing a small accurate dataset and properly leveraging numerous instances without relation labels.
Outcome: The proposed approach achieves significant improvements over baselines on real-world datasets.
ToHRE: A Top-Down Classification Strategy with Hierarchical Bag Representation for Distantly Supervised Relation Extraction (2020.coling-main)

Copied to clipboard

Challenge: Existing methods to find relational facts from texts lack hierarchical information of relations.
Approach: They propose a hierarchical classification framework which extracts relation in a top-down manner.
Outcome: The proposed method significantly outperforms state-of-the-art methods on NYT dataset . the proposed method generates large amounts of training data by aligning KBs with unlabeled corpora .
DSGAN: Generative Adversarial Training for Distant Supervision Relation Extraction (P18-1)

Copied to clipboard

Challenge: Distant supervision can effectively label data for relation extraction, but suffers from the noise labeling problem.
Approach: They propose a sentence-level true-positive generator to learn a true-negative generator from a fuzzy sentence bag.
Outcome: The proposed method significantly improves the performance of distant supervision relation extraction compared to state-of-the-art systems.
Revisiting the Negative Data of Distantly Supervised Relation Extraction (2021.acl-long)

Copied to clipboard

Challenge: Existing methods for relation extraction with distant supervision generate plenty of training samples but noisy labels and imbalanced training data cause problems.
Approach: They propose a method that automatically labels a sentence with relational triples from a knowledge base.
Outcome: The proposed method outperforms existing methods even with false positive samples.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations