Debiasing Made State-of-the-art: Revisiting the Simple Seed-based Weak Supervision for Text Classification (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in weakly supervised text classification focus on designing sophisticated methods to turn high-level human heuristics into quality pseudo-labels. |
| Approach: | They propose to use a seed matching-based method to generate quality pseudo-labels by deleting the seed words present in the matched input text. |
| Outcome: | The proposed method can be improved significantly by deleting the seed words in the matched input text with a high deletion ratio. |
Similar Papers
LIME: Weakly-Supervised Text Classification without Seeds (2022.coling-1)
Copied to clipboard
| Challenge: | Existing approaches to weakly-supervised text classification use only label names as sources of supervision. |
| Approach: | They propose a framework for weakly-supervised text classification that replaces seed-word generation with entailment-based pseudo-classification. |
| Outcome: | The proposed framework outperforms baselines and state-of-the-art in 4 benchmarks. |
Contextualized Weak Supervision for Text Classification (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for weakly supervised text classification generate pseudo-labels in a context-free manner, thus, the ambiguous, context-dependent nature of human language has been long overlooked. |
| Approach: | They propose a framework that provides contextualized weak supervision for text classification . they leverage contextualized representations of word occurrences and seed word information . |
| Outcome: | The proposed framework provides contextualized weak supervision for text classification . it leverages representations of word occurrences and seed word information to differentiate interpretations . the proposed framework also disambiguates initial seed words, making it fully contextualized . |
Seed Word Selection for Weakly-Supervised Text Classification with Unsupervised Error Estimation (2021.naacl-srw)
Copied to clipboard
| Challenge: | Weakly-supervised text classification aims to induce text classifiers from only a handful of user-provided seed words. |
| Approach: | They propose to use user-provided seed words to induce text classifiers using only a handful of carefully chosen seed words. |
| Outcome: | The proposed method outperforms baseline model using only category name seed words and achieves comparable performance as a counterpart using expert-annotated seed words. |
META: Metadata-Empowered Weak Supervision for Text Classification (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for weakly supervised text classification use text data alone to generate pseudo-labels . strong label indicators exist in metadata and it has been long overlooked due to challenges . |
| Approach: | They propose a framework that leverages metadata as an additional source of weak supervision by combining text data and metadata into a text-rich network. |
| Outcome: | The proposed framework exploits metadata as an additional source of weak supervision. |
A Benchmark on Extremely Weakly Supervised Text Classification: Reconcile Seed Matching and Prompting Approaches (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for XWS-TC rely on minimal human guidance . X-WS-tc methods require no humanannotated datasets . |
| Approach: | They propose a benchmarking method to compare two approaches to XWS-TC . they use seed-matching and prompting a language model with instructions to decode label words . |
| Outcome: | The proposed methods are more tolerant to human guidance and more robust to model-based methods. |
Extremely Weakly-supervised Text Classification with Wordsets Mining and Sync-Denoising (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing methods for weakly-supervised text classification use only class names as supervision . Existing approaches to classify texts without labeled data have significant flaws, including zero-shot instability and context-dependent ambiguities. |
| Approach: | They propose to use wordsets to generate pseudo-labels for unlabeled texts . they propose to train the classifier using a hybrid learning strategy called sync-denoising . |
| Outcome: | The proposed method outperforms all existing prompt and seed methods on 11 datasets by an impressive average of 8 points. |
Denoising Multi-Source Weak Supervision for Neural Text Classification (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Recent years have witnessed the rapid development of deep neural networks (DNNs) for text classification problems. |
| Approach: | They propose a label denoiser which estimates the source reliability using a conditional soft attention mechanism and reduces label noise by aggregating rule-annotated weak labels. |
| Outcome: | The proposed model outperforms state-of-the-art methods on sentiment, topic, and relation classifications and achieves comparable performance with fully-supervised methods even without labeled data. |
X-Class: Text Classification with Extremely Weak Supervision (2021.naacl-main)
Copied to clipboard
| Challenge: | Weak supervision is a problem in text classification, but it requires corpusspecific knowledge. |
| Approach: | They propose a framework for extremely weak supervision that can be used to train a text classifier. |
| Outcome: | The proposed framework outperforms seed-driven weakly supervised methods on 7 benchmark datasets. |
Weaker Than You Think: A Critical Look at Weakly Supervised Learning (2023.acl-long)
Copied to clipboard
| Challenge: | Weakly supervised learning is a popular approach for training machine learning models in low-resource settings. |
| Approach: | They propose to use weakly supervised learning to train models with noisy labels from weak sources instead of collecting expensive human annotations. |
| Outcome: | The proposed methods outperform weakly supervised methods on various NLP datasets and tasks on the test sets. |
Ranking-Based Automatic Seed Selection and Noise Reduction for Weakly Supervised Relation Extraction (P18-2)
Copied to clipboard
| Challenge: | et al., 1998: bootstrapping for relation extraction uses minimally supervised methods . etudes show that proposed methods for automatic seed selection and noise reduction are better than baseline systems . |
| Approach: | They propose automatic seed selection and noise reduction for distantly supervised relation extraction tasks. |
| Outcome: | The proposed methods achieve better performance than baseline systems in both tasks. |