A Pseudo Label based Dataless Naive Bayes Algorithm for Text Classification with Seed Words (C18-1)
Copied to clipboard
| Challenge: | Existing supervised text classifications require a large number of manually labeled documents. |
| Approach: | They develop a pseudo-label based dataless Naive Bayes classifier with seed words . they initialize pseudo-labels for each document using seed word occurrences . |
| Outcome: | The proposed classifier outperforms traditional supervised text classification algorithms with seed words on an imbalanced dataset. |
Similar Papers
Debiasing Made State-of-the-art: Revisiting the Simple Seed-based Weak Supervision for Text Classification (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in weakly supervised text classification focus on designing sophisticated methods to turn high-level human heuristics into quality pseudo-labels. |
| Approach: | They propose to use a seed matching-based method to generate quality pseudo-labels by deleting the seed words present in the matched input text. |
| Outcome: | The proposed method can be improved significantly by deleting the seed words in the matched input text with a high deletion ratio. |
LIME: Weakly-Supervised Text Classification without Seeds (2022.coling-1)
Copied to clipboard
| Challenge: | Existing approaches to weakly-supervised text classification use only label names as sources of supervision. |
| Approach: | They propose a framework for weakly-supervised text classification that replaces seed-word generation with entailment-based pseudo-classification. |
| Outcome: | The proposed framework outperforms baselines and state-of-the-art in 4 benchmarks. |
Contextualized Weak Supervision for Text Classification (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for weakly supervised text classification generate pseudo-labels in a context-free manner, thus, the ambiguous, context-dependent nature of human language has been long overlooked. |
| Approach: | They propose a framework that provides contextualized weak supervision for text classification . they leverage contextualized representations of word occurrences and seed word information . |
| Outcome: | The proposed framework provides contextualized weak supervision for text classification . it leverages representations of word occurrences and seed word information to differentiate interpretations . the proposed framework also disambiguates initial seed words, making it fully contextualized . |
PIEClass: Weakly-Supervised Text Classification with Prompting and Noise-Robust Iterative Ensemble Training (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for text classification use label names of target classes as the only supervision. |
| Approach: | They propose a method that uses keyword-based keyword matching to generate pseudo labels . they propose 'pieclass' module that iteratively trains classifiers and updates pseudo labels. |
| Outcome: | The proposed method achieves better performance than existing strong baselines on seven benchmark datasets and similar performance to fully-supervised classifiers on sentiment classification tasks. |
Prototype-Guided Pseudo Labeling for Semi-Supervised Text Classification (2023.acl-long)
Copied to clipboard
| Challenge: | Existing semi-supervised text classification methods suffer from categorical boundary issues . existing methods suffer by ambiguous categoric boundaries, making it difficult to generate reliable pseudo-labels for each category. |
| Approach: | They propose a semi-supervised framework that assigns pseudo-labels to unlabeled data . they exploit categorical prototypes to assimilate instance representations within the same category . |
| Outcome: | Empirical studies show that the proposed framework is effective . it uses prototypical cluster separation and prototypical-center data selection . |
Calibrating Pseudo-Labeling with Class Distribution for Semi-supervised Text Classification (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies develop effective pseudo-labeling methods, but they struggle with unlabeled data that have imbalanced classes mismatched with the labeled data. |
| Approach: | They propose to use pseudo-labeling to train text classification models with few labeled data and massive unlabeled data. |
| Outcome: | Empirical results show that the proposed model outperforms state-of-the-art methods on 3 common benchmarks. |
PseudoReasoner: Leveraging Pseudo Labels for Commonsense Knowledge Base Population (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Commonsense Knowledge Base (CSKB) Population aims at reasoning over unseen entities and assertions on CSKBs, but it requires out-of-domain generalization ability as the source CSMB for training is of a relatively smaller scale (1M) . |
| Approach: | They propose a semi-supervised learning framework that uses a teacher model to provide pseudo labels on the unlabeled candidate dataset for a student model to learn from. |
| Outcome: | The proposed framework can improve the backbone model KG-BERT (RoBERTa-large) by 3.3 points on the overall performance and especially, 5.3 points on out-of-domain performance. |
Unsupervised Label Refinement Improves Dataless Text Classification (2021.findings-acl)
Copied to clipboard
| Challenge: | Prior work has shown that dataless classifiers can classify text into categories without using annotated training data. |
| Approach: | They propose a clustering-based approach that assigns a score to any document paired with a label description. |
| Outcome: | The proposed method improves classification performance across multiple datasets and makes it more robust to label descriptions. |
Neural Networks Against (and For) Self-Training: Classification with Small Labeled and Large Unlabeled Sets (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing models for text classification suffer from the semantic drift problem, which is a problem for self-training. |
| Approach: | They propose a semi-supervised text classifier based on self-training using one positive and one negative property of neural networks. |
| Outcome: | The proposed model outperforms ten baseline models in five benchmarks and is additive to language model pretraining. |
Weakly-supervised Text Classification Based on Keyword Graph (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for text classification ignore keyword correlation, thus ignoring it . existing methods treat keywords independently, thus not exploiting correlation between them . |
| Approach: | They propose a framework to explore keyword-keyword correlation on keyword graph by GNN . they use a self-supervised task to pretrain annotators and fine-tune them . |
| Outcome: | The proposed method outperforms existing methods on long- and short-text datasets. |