| Challenge: | Existing approaches for relation extraction (RE) use supervised learning on relation-specific training data, which is expensive to acquire. |
| Approach: | They propose to use a new testing dataset to re-examine distant supervision approaches . they aim to draw new conclusions based on the new testing data . |
| Outcome: | The proposed method can generate training data without noise and bias issues . the proposed method is annotated by the researchers on Amzaon Mechanical Turk . |
Similar Papers
Enhanced Distant Supervision with State-Change Information for Relation Extraction (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing methods for enhancing distant supervision with state-change information for relation extraction are limited. |
| Approach: | They propose a method for enhancing distant supervision with state-change information for relation extraction by adding temporal information to a curation dataset. |
| Outcome: | The proposed method reduces noise when used for static relation extraction and can be used to train a relation-extraction system that detects a change of state in relations. |
Uncover the Ground-Truth Relations in Distant Supervision: A Neural Expectation-Maximization Framework (D19-1)
Copied to clipboard
| Challenge: | Existing methods for relation extraction assume that text is noisy, but its corresponding labels are clean. |
| Approach: | They propose a framework that combines neural network and probabilistic modelling to denoise noisy relation labels. |
| Outcome: | The proposed framework improves the current art in uncovering the ground-truth relation labels. |
GAN Driven Semi-distant Supervision for Relation Extraction (N19-1)
Copied to clipboard
| Challenge: | Existing methods for relation extraction are limited to costly hand-labeled training sets and hard to be extended to large-scale relations. |
| Approach: | They propose a semi-distant supervision approach for relation extraction by constructing a small accurate dataset and properly leveraging numerous instances without relation labels. |
| Outcome: | The proposed approach achieves significant improvements over baselines on real-world datasets. |
Active Testing: An Unbiased Evaluation Method for Distantly Supervised Relation Extraction (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for distantly supervised relation extraction suffer from low quality of test set, which leads to considerable biased performance evaluation. |
| Approach: | They propose a method to evaluate distantly supervised relation extraction using noisy test sets and manual annotations. |
| Outcome: | Experiments on a widely used benchmark show that the proposed method can yield approximately unbiased evaluations for distantly supervised relation extractors. |
Combining Distant and Direct Supervision for Neural Relation Extraction (N19-1)
Copied to clipboard
| Challenge: | Existing methods to train relation extraction with distant supervision use noisy labels and implicitly assumes that all the KB facts are mentioned in the text. |
| Approach: | They propose to combine distant supervision data with additional directly-supervised data to train relation extraction models by using sigmoidal attention weights with max pooling. |
| Outcome: | The proposed method achieves state-of-the-art on the widely used FB-NYT dataset. |
Manual Evaluation Matters: Reviewing Test Protocols of Distantly Supervised Relation Extraction (2021.findings-acl)
Copied to clipboard
Tianyu Gao, Xu Han, Yuzhuo Bai, Keyue Qiu, Zhiyu Xie, Yankai Lin, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou
| Challenge: | Distantly supervised relation extraction (RE) has attracted much attention in the past few years . previous methods to evaluate models manually or directly on autolabeled data have produced inaccurate evaluations . |
| Approach: | They propose to use distant supervision to generate large-scale autolabeled data . they build manually-annotated test sets for two DS-RE datasets and evaluate models . |
| Outcome: | The proposed method produces 53% wrong labels at the entity pair level in the popular NYT10 dataset. |
Revisiting the Negative Data of Distantly Supervised Relation Extraction (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for relation extraction with distant supervision generate plenty of training samples but noisy labels and imbalanced training data cause problems. |
| Approach: | They propose a method that automatically labels a sentence with relational triples from a knowledge base. |
| Outcome: | The proposed method outperforms existing methods even with false positive samples. |
Global Relation Embedding for Relation Extraction (N18-1)
Copied to clipboard
| Challenge: | Existing methods to extract textual relations with distant supervision are limited by their reliance on supervised training data. |
| Approach: | They propose to embed relations with global statistics of relations to combat the wrong labeling problem of distant supervision. |
| Outcome: | The proposed method is more robust to training noise introduced by distant supervision and improves relation extraction models. |
Denoising Relation Extraction from Document-level Distant Supervision (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to generate auto-labeled sentences for relation extraction (RE) are difficult to extend to document-level relation extraction as noise from DS may be even multiplied in documents. |
| Approach: | They propose a pre-trained model which de-emphasizes noisy DS data via multiple pre-training tasks. |
| Outcome: | The proposed model can capture useful information from noisy data and achieve promising results on the large-scale DocRE benchmark. |
Distantly Supervised Relation Extraction in Federated Settings (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to label training datasets using distant supervision are expensive and cannot cover all walks of life. |
| Approach: | They propose a federated denoising framework to suppress label noise in federation . they propose to use a multiple instance learning based denoisation method to select reliable sentences . |
| Outcome: | The proposed method can select reliable sentences via cross-platform collaboration. |