Challenge: Existing methods to generate auto-labeled sentences for relation extraction (RE) are difficult to extend to document-level relation extraction as noise from DS may be even multiplied in documents.
Approach: They propose a pre-trained model which de-emphasizes noisy DS data via multiple pre-training tasks.
Outcome: The proposed model can capture useful information from noisy data and achieve promising results on the large-scale DocRE benchmark.

Similar Papers

Uncover the Ground-Truth Relations in Distant Supervision: A Neural Expectation-Maximization Framework (D19-1)

Copied to clipboard

Challenge: Existing methods for relation extraction assume that text is noisy, but its corresponding labels are clean.
Approach: They propose a framework that combines neural network and probabilistic modelling to denoise noisy relation labels.
Outcome: The proposed framework improves the current art in uncovering the ground-truth relation labels.
SENT: Sentence-level Distant Relation Extraction via Negative Training (2021.acl-long)

Copied to clipboard

Challenge: Existing methods for relation extraction use bag labels, which introduce noise, to train the model.
Approach: They propose to use negative training to train a model using complementary labels to separate the noisy data from the training data.
Outcome: The proposed method improves on previous methods on sentence-level evaluation and de-noise effect.
Uncertainty Guided Label Denoising for Document-level Distant Relation Extraction (2023.acl-long)

Copied to clipboard

Challenge: Document-level relation extraction (DocRE) aims to extract semantic relations between entities in a document.
Approach: They propose a Document-level distant relation extraction framework with unreliable pseudo labels to denoise DS data.
Outcome: The proposed framework outperforms strong baselines on two public datasets.
Noise-Robust Semi-Supervised Learning for Distantly Supervised Relation Extraction (2023.findings-emnlp)

Copied to clipboard

Challenge: Distantly supervised relation extraction (DSRE) methods are not capable of extracting relation labels for individual sentences.
Approach: They propose a semi-supervised learning relation extraction framework for sentence-level DSRE . they discard only the labels of the noisy samples and utilize them as unlabeled samples .
Outcome: The proposed framework achieves significant performance enhancements on two real-world datasets.
Distantly Supervised Relation Extraction in Federated Settings (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to label training datasets using distant supervision are expensive and cannot cover all walks of life.
Approach: They propose a federated denoising framework to suppress label noise in federation . they propose to use a multiple instance learning based denoisation method to select reliable sentences .
Outcome: The proposed method can select reliable sentences via cross-platform collaboration.
DSGAN: Generative Adversarial Training for Distant Supervision Relation Extraction (P18-1)

Copied to clipboard

Challenge: Distant supervision can effectively label data for relation extraction, but suffers from the noise labeling problem.
Approach: They propose a sentence-level true-positive generator to learn a true-negative generator from a fuzzy sentence bag.
Outcome: The proposed method significantly improves the performance of distant supervision relation extraction compared to state-of-the-art systems.
Semi-automatic Data Enhancement for Document-Level Relation Extraction with Distant Supervision from Large Language Models (2023.emnlp-main)

Copied to clipboard

Challenge: Document-level Relation Extraction (DocRE) is a task that aims to extract relations from a long context.
Approach: They propose an automated annotation method that integrates an LLM and a natural language inference module to generate relation triples.
Outcome: The proposed method can extract relations from document-level relation datasets with minimal human effort.
Revisiting Distant Supervision for Relation Extraction (L18-1)

Copied to clipboard

Challenge: Existing approaches for relation extraction (RE) use supervised learning on relation-specific training data, which is expensive to acquire.
Approach: They propose to use a new testing dataset to re-examine distant supervision approaches . they aim to draw new conclusions based on the new testing data .
Outcome: The proposed method can generate training data without noise and bias issues . the proposed method is annotated by the researchers on Amzaon Mechanical Turk .
Distantly Supervised Relation Extraction using Multi-Layer Revision Network and Confidence-based Multi-Instance Learning (2021.emnlp-main)

Copied to clipboard

Challenge: Distantly supervised relation extraction is used in knowledge bases but its low quality and noisy sentences are present in sentence bags.
Approach: They propose a multi-layer revision network which emphasizes inner-sentence correlations before extracting relevant information within sentences.
Outcome: The proposed method improves on two New York Times datasets.
Revisiting the Negative Data of Distantly Supervised Relation Extraction (2021.acl-long)

Copied to clipboard

Challenge: Existing methods for relation extraction with distant supervision generate plenty of training samples but noisy labels and imbalanced training data cause problems.
Approach: They propose a method that automatically labels a sentence with relational triples from a knowledge base.
Outcome: The proposed method outperforms existing methods even with false positive samples.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations