| Challenge: | Alfred is the first system for programmatic weak supervision (PWS) that creates training data for machine learning by prompting. |
| Approach: | They propose to use Python to create training data by prompting for machine learning . they find that it improves query throughput by 2.9x versus a naive approach . |
| Outcome: | The proposed system improves query throughput by 2.9x versus a naive approach. |
Similar Papers
A Benchmark on Extremely Weakly Supervised Text Classification: Reconcile Seed Matching and Prompting Approaches (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for XWS-TC rely on minimal human guidance . X-WS-tc methods require no humanannotated datasets . |
| Approach: | They propose a benchmarking method to compare two approaches to XWS-TC . they use seed-matching and prompting a language model with instructions to decode label words . |
| Outcome: | The proposed methods are more tolerant to human guidance and more robust to model-based methods. |
skweak: Weak Supervision Made Easy for NLP (2021.acl-demo)
Copied to clipboard
| Challenge: | skweak is a Python-based toolkit for NLP developers to use weak supervision . labelled data remains a scarce resource in many practical NLP scenarios . |
| Approach: | They present a Python-based toolkit that allows NLP developers to use weak supervision . skweak is designed to facilitate the use of weak supervision for NLP tasks . |
| Outcome: | skweak is a Python-based toolkit that facilitates weak supervision . the toolkit provides a simple interface to apply labels to a large corpus of text data . |
Prompt-Based Rule Discovery and Boosting for Interactive Weakly-Supervised Learning (2022.acl-long)
Copied to clipboard
| Challenge: | Weakly-supervised learning (WSL) has shown promising results in addressing label scarcity on many NLP tasks, but manual designing a comprehensive, high-quality set of labeling rules is tedious and difficult. |
| Approach: | They propose a weakly-supervised learning model that iterates and discovers new labeling rules from data to improve the WSL model. |
| Outcome: | The proposed model outperforms state-of-the-art models on four tasks and bridges the gaps with fully supervised models. |
PIEClass: Weakly-Supervised Text Classification with Prompting and Noise-Robust Iterative Ensemble Training (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for text classification use label names of target classes as the only supervision. |
| Approach: | They propose a method that uses keyword-based keyword matching to generate pseudo labels . they propose 'pieclass' module that iteratively trains classifiers and updates pseudo labels. |
| Outcome: | The proposed method achieves better performance than existing strong baselines on seven benchmark datasets and similar performance to fully-supervised classifiers on sentiment classification tasks. |
Cross-task Knowledge Transfer for Extremely Weakly Supervised Text Classification (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for text classification with extremely weak supervision impose stricter supervision constraints than those under regular weak supervision. |
| Approach: | They propose a framework that creates weak labels by leveraging recent developments in zero-shot text classification. |
| Outcome: | The proposed framework outperforms existing methods on weak labels generated by weakly supervise classification. |
Open-world Multi-label Text Classification with Extremely Weak Supervision (2024.emnlp-main)
Copied to clipboard
| Challenge: | Similar single-label XWS settings cannot be easily adapted for multi-l label classification. |
| Approach: | They propose a novel method for open-world multi-label text classification under extremely weak supervision where the user provides a brief description without any labels or ground-truth label space. |
| Outcome: | The proposed method exhibits a remarkable increase in ground-truth label space coverage on various datasets. |
Less than One-shot: Named Entity Recognition via Extremely Weak Supervision (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Named entity recognition (NER) problem is performed under extremely weak supervision . XWS setting is considered weaker than 1-shot since example entity is given in context-free way . |
| Approach: | They propose a method that uses extremely weak supervision to train named entity recognition models. |
| Outcome: | The proposed method outperforms the state-of-the-art few-shot methods with 1-shot supervision and ChatGPT annotations significantly. |
Distant Supervision from Disparate Sources for Low-Resource Part-of-Speech Tagging (D18-1)
Copied to clipboard
| Challenge: | Low-resource languages lack manual annotated data to learn basic models such as part-of-speech (POS) taggers. |
| Approach: | They propose a cross-lingual neural part-of-speech tagger that learns from disparate sources of distant supervision in a uniform framework. |
| Outcome: | The proposed model scales to hundreds of low-resource languages without access to gold annotated data. |
Weakly Supervised Text Classification using Supervision Signals from a Language Model (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing weakly supervised text classification methods require a large number of annotated data and human annotations are expensive. |
| Approach: | They propose to query a masked language model with cloze style prompts to obtain supervision signals. |
| Outcome: | The proposed method outperforms baseline methods on three datasets by 2%, 4%, and 3%. |
Contextualized Weak Supervision for Text Classification (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for weakly supervised text classification generate pseudo-labels in a context-free manner, thus, the ambiguous, context-dependent nature of human language has been long overlooked. |
| Approach: | They propose a framework that provides contextualized weak supervision for text classification . they leverage contextualized representations of word occurrences and seed word information . |
| Outcome: | The proposed framework provides contextualized weak supervision for text classification . it leverages representations of word occurrences and seed word information to differentiate interpretations . the proposed framework also disambiguates initial seed words, making it fully contextualized . |