Challenge: Open-Set Semi-Supervised Text Classification (OSTC) aims to train a classification model on a limited set of labeled texts along with plenty of unlabeled examples.
Approach: They propose to train a classification model on a limited set of labeled texts alongside plenty of unlabeled examples that include both in-distribution and out-of-difference examples.
Outcome: The proposed model improves on outlier detection and abnormal example detection and calibration.

Similar Papers

Rank-Aware Negative Training for Semi-Supervised Text Classification (2023.tacl-1)

Copied to clipboard

Challenge: Semi-supervised text classification-based paradigms employ the spirit of self-training, but the accuracy of pseudo-labels can be a problem in real-world scenarios.
Approach: They propose a Rank-aware Negative Training framework to address SSTC in noisy label learning . they rank unlabeled texts based on evidential support from the labeled texts.
Outcome: The proposed framework overcomes state-of-the-art alternatives and achieves competitive performance in other scenarios.
JointMatch: A Unified Approach for Diverse and Collaborative Pseudo-Labeling to Semi-Supervised Text Classification (2023.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to semi-supervised text classification suffer from pseudo-label bias and error accumulation.
Approach: They propose a pseudo-labeling approach to semi-supervised text classification that unifies ideas from semi-semi-supervised learning and the task of learning with noise.
Outcome: The proposed approach achieves a significant improvement on benchmark datasets even in the extremely-scarce-label setting.
Calibrating Pseudo-Labeling with Class Distribution for Semi-supervised Text Classification (2025.emnlp-main)

Copied to clipboard

Challenge: Existing studies develop effective pseudo-labeling methods, but they struggle with unlabeled data that have imbalanced classes mismatched with the labeled data.
Approach: They propose to use pseudo-labeling to train text classification models with few labeled data and massive unlabeled data.
Outcome: Empirical results show that the proposed model outperforms state-of-the-art methods on 3 common benchmarks.
Semi-Supervised Text Classification with Balanced Deep Representation Distributions (2021.acl-long)

Copied to clipboard

Challenge: Semi-Supervised Text Classification (SSTC) is a type of self-training that uses labeled and unlabeled data to perform certain applications.
Approach: They propose a method to initialize a deep classifier by training over labeled texts . they then alternatively predict unlabeled texts as their pseudo-labels and train them over the mixture .
Outcome: Empirical results show that the proposed method is more accurate when labeled texts are scarce.
Adversarial Self-Supervised Learning for Out-of-Domain Detection (2021.naacl-main)

Copied to clipboard

Challenge: Existing methods for detecting out-of-domain (OOD) intents are unsupervised and require extensive labeled data.
Approach: They propose a self-supervised contrastive learning framework to model discriminative semantic features from unlabeled data.
Outcome: The proposed framework outperforms baseline methods on two public benchmark datasets with a statistically significant margin.
Exploring Ordinality in Text Classification: A Comparative Study of Explicit and Implicit Techniques (2024.findings-acl)

Copied to clipboard

Challenge: Ordinal classification (OC) is a key task in natural language processing with applications in various domains such as sentiment analysis, rating prediction, and more.
Approach: They propose to tackle ordinal classification (OC) through the implicit semantics of the labels . they propose to use a classical explicit approach and an implicit approach that organically engages the semantics.
Outcome: The proposed methods are based on pre-trained language models and offer strategic recommendations based upon specific settings.
Neural Networks Against (and For) Self-Training: Classification with Small Labeled and Large Unlabeled Sets (2023.findings-acl)

Copied to clipboard

Challenge: Existing models for text classification suffer from the semantic drift problem, which is a problem for self-training.
Approach: They propose a semi-supervised text classifier based on self-training using one positive and one negative property of neural networks.
Outcome: The proposed model outperforms ten baseline models in five benchmarks and is additive to language model pretraining.
Instances and Labels: Hierarchy-aware Joint Supervised Contrastive Learning for Hierarchical Multi-Label Text Classification (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to hierarchical multi-label text classification (HMTC) ignore the correlation between similar samples and introduce noise .
Approach: They propose a semi-supervised method that uses a label hierarchy to bring text and label embeddings closer to each other by supervised contrastive learning.
Outcome: The proposed method bridges the gap between supervised contrastive learning and HMTC by bringing text and label embeddings closer.
BOLT: Benchmarking Open-World Learning for Text Classification (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks focus on out-of-distribution (OOD) detection while overlooking broader challenges such as the discovery of novel categories.
Approach: They propose a unified Benchmark and evaluation toolkit supporting Open-world learning for text classification.
Outcome: The proposed methods overfit training distributions and struggle to generalize to unseen classes.
Semi-supervised Adversarial Text Generation based on Seq2Seq models (2022.emnlp-industry)

Copied to clipboard

Challenge: In contrast, adversarial training has been used in computer vision to improve models’ robustness due to the discrete nature of text.
Approach: They propose a way to generate adversarial samples by using pseudo-labeled in-domain text data to train a seq2seq model for adversarials and combine it with paraphrase detection.
Outcome: The proposed model generates realistic and relevant adversarial samples compared to other state-of-the-art models and recovers up to 70% of errors.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations