Leveraging Information Redundancy of Real-World Data through Distant Supervision (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for annotation of health care notes are promising but they are limited due to privacy regulations. |
| Approach: | They propose a text labeling method that leverages the redundancy of temporal information in a data lake to create a large programmatically annotated corpus and train transformer models using distant supervision. |
| Outcome: | The proposed method reduces expert annotation time, a scarce and expensive resource. |
Similar Papers
Learning to Denoise Distantly-Labeled Data for Entity Typing (N19-1)
Copied to clipboard
| Challenge: | Distantly-labeled data can be used to scale up statistical models, but it is noisy . specialized probabilistic models can be employed to scale the training of models, however, they require sophisticated probabilistic inference for the training. |
| Approach: | They propose a method for denoising and denoising noisy data with supervised training. |
| Outcome: | The proposed method outperforms models trained on clean and denoised data on an ultra-fine entity typing task. |
Distant Supervision from Disparate Sources for Low-Resource Part-of-Speech Tagging (D18-1)
Copied to clipboard
| Challenge: | Low-resource languages lack manual annotated data to learn basic models such as part-of-speech (POS) taggers. |
| Approach: | They propose a cross-lingual neural part-of-speech tagger that learns from disparate sources of distant supervision in a uniform framework. |
| Outcome: | The proposed model scales to hundreds of low-resource languages without access to gold annotated data. |
Open-Domain Event Detection using Distant Supervision (C18-1)
Copied to clipboard
| Challenge: | Existing work on restricted domains and event annotation has limited coverage of events. |
| Approach: | They propose a distant supervision method that generates high-quality training data . they use a manually annotated corpus as a model to investigate events in various domains . |
| Outcome: | The proposed method outperforms supervised models in a manually annotated event corpus despite no direct supervision . |
GAN Driven Semi-distant Supervision for Relation Extraction (N19-1)
Copied to clipboard
| Challenge: | Existing methods for relation extraction are limited to costly hand-labeled training sets and hard to be extended to large-scale relations. |
| Approach: | They propose a semi-distant supervision approach for relation extraction by constructing a small accurate dataset and properly leveraging numerous instances without relation labels. |
| Outcome: | The proposed approach achieves significant improvements over baselines on real-world datasets. |
Enhanced Distant Supervision with State-Change Information for Relation Extraction (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing methods for enhancing distant supervision with state-change information for relation extraction are limited. |
| Approach: | They propose a method for enhancing distant supervision with state-change information for relation extraction by adding temporal information to a curation dataset. |
| Outcome: | The proposed method reduces noise when used for static relation extraction and can be used to train a relation-extraction system that detects a change of state in relations. |
Uncover the Ground-Truth Relations in Distant Supervision: A Neural Expectation-Maximization Framework (D19-1)
Copied to clipboard
| Challenge: | Existing methods for relation extraction assume that text is noisy, but its corresponding labels are clean. |
| Approach: | They propose a framework that combines neural network and probabilistic modelling to denoise noisy relation labels. |
| Outcome: | The proposed framework improves the current art in uncovering the ground-truth relation labels. |
Distantly Supervised Relation Extraction in Federated Settings (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to label training datasets using distant supervision are expensive and cannot cover all walks of life. |
| Approach: | They propose a federated denoising framework to suppress label noise in federation . they propose to use a multiple instance learning based denoisation method to select reliable sentences . |
| Outcome: | The proposed method can select reliable sentences via cross-platform collaboration. |
Exploiting Noisy Data in Distant Supervision Relation Classification (N19-1)
Copied to clipboard
| Challenge: | Existing approaches to relation classification are noisy and time-consuming . RCEND uses noisy data to split noisy data into correctly and incorrectly labeled data . |
| Approach: | They propose a framework to enhance relation classification by exploiting noisy data . they use an instance discriminator with reinforcement learning to split noisy data into correctly and incorrectly labeled data based on the noisy data. |
| Outcome: | The proposed method outperforms the state-of-the-art models on relation classification . the proposed method is based on a semi-supervised learning method . |
Noise-Robust Training with Dynamic Loss and Contrastive Learning for Distantly-Supervised Named Entity Recognition (2023.findings-acl)
Copied to clipboard
| Challenge: | Named entity recognition (NER) is a task in natural language processing that aims at locating entity mentions in a given sentence and assigning them to certain types. |
| Approach: | They propose to use a dynamic loss function to better adapt to the changing noise during the training process and incorporate token level contrastive learning to fully utilize the noisy data. |
| Outcome: | The proposed method outperforms existing NER models on three benchmark datasets and outperformed existing models by significant margins. |
META: Metadata-Empowered Weak Supervision for Text Classification (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for weakly supervised text classification use text data alone to generate pseudo-labels . strong label indicators exist in metadata and it has been long overlooked due to challenges . |
| Approach: | They propose a framework that leverages metadata as an additional source of weak supervision by combining text data and metadata into a text-rich network. |
| Outcome: | The proposed framework exploits metadata as an additional source of weak supervision. |