ULF: Unsupervised Labeling Function Correction using Cross-Validation for Weak Supervision (2023.emnlp-main)
Copied to clipboard
| Challenge: | A cost-effective alternative to manual data labeling is weak supervision (WS), where data samples are automatically annotated using a predefined set of labeling functions (LFs). |
| Approach: | They propose an algorithm which denoises WS data by leveraging models trained on all but some LFs to identify and correct biases specific to the held-out LF. |
| Outcome: | The proposed algorithm denoises WS data by leveraging models trained on all but some LFs to identify and correct biases specific to the held-out LF. |
Similar Papers
Denoising Multi-Source Weak Supervision for Neural Text Classification (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Recent years have witnessed the rapid development of deep neural networks (DNNs) for text classification problems. |
| Approach: | They propose a label denoiser which estimates the source reliability using a conditional soft attention mechanism and reduces label noise by aggregating rule-annotated weak labels. |
| Outcome: | The proposed model outperforms state-of-the-art methods on sentiment, topic, and relation classifications and achieves comparable performance with fully-supervised methods even without labeled data. |
Named Entity Recognition through Deep Representation Learning and Weak Supervision (2021.findings-acl)
Copied to clipboard
| Challenge: | Weakly supervised named entity recognition (NER) uses noisy labels to estimate the true labels of a dataset. |
| Approach: | They propose a model to learn optimal assignments of latent NER tags using observed tokens and weak labels provided by labeling functions. |
| Outcome: | The proposed model improves the quality of weak labels on four public datasets. |
skweak: Weak Supervision Made Easy for NLP (2021.acl-demo)
Copied to clipboard
| Challenge: | skweak is a Python-based toolkit for NLP developers to use weak supervision . labelled data remains a scarce resource in many practical NLP scenarios . |
| Approach: | They present a Python-based toolkit that allows NLP developers to use weak supervision . skweak is designed to facilitate the use of weak supervision for NLP tasks . |
| Outcome: | skweak is a Python-based toolkit that facilitates weak supervision . the toolkit provides a simple interface to apply labels to a large corpus of text data . |
Unsupervised Cross-Lingual Representation Learning (P19-4)
Copied to clipboard
| Challenge: | a comprehensive survey of cutting-edge weakly-supervised and unsupervised cross-lingual word representations is presented . |
| Approach: | This tutorial provides a comprehensive survey of recent work on weakly-supervised and unsupervised cross-lingual word representations. |
| Outcome: | This tutorial provides a comprehensive survey of cutting-edge weakly-supervised and unsupervised word representations. |
Self-Training with Weak Supervision (2021.naacl-main)
Copied to clipboard
| Challenge: | State-of-the-art deep neural networks require large amounts of labeled training data that is expensive to obtain or not available for many tasks. |
| Approach: | They propose a weak supervision framework that leverages all available data for a given task . they leverage task-specific unlabeled data through self-training with a model that predicts pseudo-labels for instances that may not be covered by weak rules . |
| Outcome: | The proposed framework improves on state-of-the-art datasets on six benchmark tasks. |
Cross-task Knowledge Transfer for Extremely Weakly Supervised Text Classification (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for text classification with extremely weak supervision impose stricter supervision constraints than those under regular weak supervision. |
| Approach: | They propose a framework that creates weak labels by leveraging recent developments in zero-shot text classification. |
| Outcome: | The proposed framework outperforms existing methods on weak labels generated by weakly supervise classification. |
Weaker Than You Think: A Critical Look at Weakly Supervised Learning (2023.acl-long)
Copied to clipboard
| Challenge: | Weakly supervised learning is a popular approach for training machine learning models in low-resource settings. |
| Approach: | They propose to use weakly supervised learning to train models with noisy labels from weak sources instead of collecting expensive human annotations. |
| Outcome: | The proposed methods outperform weakly supervised methods on various NLP datasets and tasks on the test sets. |
SepLL: Separating Latent Class Labels from Weak Supervision Noise (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for learning from weak labels use heuristics and heurism to create weak labels. |
| Approach: | They propose a weakly supervised learning paradigm that uses human intuitions to create weak (noisy) labels. |
| Outcome: | The proposed model is competitive with the state-of-the-art and yields a new best average performance. |
Open-world Multi-label Text Classification with Extremely Weak Supervision (2024.emnlp-main)
Copied to clipboard
| Challenge: | Similar single-label XWS settings cannot be easily adapted for multi-l label classification. |
| Approach: | They propose a novel method for open-world multi-label text classification under extremely weak supervision where the user provides a brief description without any labels or ground-truth label space. |
| Outcome: | The proposed method exhibits a remarkable increase in ground-truth label space coverage on various datasets. |
FAIR: Filtering of Automatically Induced Rules (2024.eacl-long)
Copied to clipboard
| Challenge: | Existing methods to reduce the human annotation efforts require a diverse set of rules to assign labels to unlabeled data. |
| Approach: | They propose an automatic rule-filtering algorithm to filter out a large set of automatically created rules from a small set of labeled features. |
| Outcome: | The proposed approach achieves statistically significant results over existing methods. |