Challenge: Existing approaches to semi-supervised text classification suffer from pseudo-label bias and error accumulation.
Approach: They propose a pseudo-labeling approach to semi-supervised text classification that unifies ideas from semi-semi-supervised learning and the task of learning with noise.
Outcome: The proposed approach achieves a significant improvement on benchmark datasets even in the extremely-scarce-label setting.

Similar Papers

MultiMatch: Multihead Consistency Regularization Matching for Semi-Supervised Text Classification (2025.emnlp-main)

Copied to clipboard

Challenge: **MultiMatch** is a semi-supervised learning (SSL) algorithm that combines co-training and consistency regularization with pseudo-labeling.
Approach: They propose a semi-supervised learning algorithm that integrates co-training and consistency regularization with pseudo-labeling.
Outcome: The proposed algorithm outperforms the second-best approach on 8 out of 10 setups from 5 natural language processing datasets and outperformed the second best by 3.26%.
Calibrating Pseudo-Labeling with Class Distribution for Semi-supervised Text Classification (2025.emnlp-main)

Copied to clipboard

Challenge: Existing studies develop effective pseudo-labeling methods, but they struggle with unlabeled data that have imbalanced classes mismatched with the labeled data.
Approach: They propose to use pseudo-labeling to train text classification models with few labeled data and massive unlabeled data.
Outcome: Empirical results show that the proposed model outperforms state-of-the-art methods on 3 common benchmarks.
Prototype-Guided Pseudo Labeling for Semi-Supervised Text Classification (2023.acl-long)

Copied to clipboard

Challenge: Existing semi-supervised text classification methods suffer from categorical boundary issues . existing methods suffer by ambiguous categoric boundaries, making it difficult to generate reliable pseudo-labels for each category.
Approach: They propose a semi-supervised framework that assigns pseudo-labels to unlabeled data . they exploit categorical prototypes to assimilate instance representations within the same category .
Outcome: Empirical studies show that the proposed framework is effective . it uses prototypical cluster separation and prototypical-center data selection .
Semi-Supervised Text Classification with Balanced Deep Representation Distributions (2021.acl-long)

Copied to clipboard

Challenge: Semi-Supervised Text Classification (SSTC) is a type of self-training that uses labeled and unlabeled data to perform certain applications.
Approach: They propose a method to initialize a deep classifier by training over labeled texts . they then alternatively predict unlabeled texts as their pseudo-labels and train them over the mixture .
Outcome: Empirical results show that the proposed method is more accurate when labeled texts are scarce.
Rank-Aware Negative Training for Semi-Supervised Text Classification (2023.tacl-1)

Copied to clipboard

Challenge: Semi-supervised text classification-based paradigms employ the spirit of self-training, but the accuracy of pseudo-labels can be a problem in real-world scenarios.
Approach: They propose a Rank-aware Negative Training framework to address SSTC in noisy label learning . they rank unlabeled texts based on evidential support from the labeled texts.
Outcome: The proposed framework overcomes state-of-the-art alternatives and achieves competitive performance in other scenarios.
Instances and Labels: Hierarchy-aware Joint Supervised Contrastive Learning for Hierarchical Multi-Label Text Classification (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to hierarchical multi-label text classification (HMTC) ignore the correlation between similar samples and introduce noise .
Approach: They propose a semi-supervised method that uses a label hierarchy to bring text and label embeddings closer to each other by supervised contrastive learning.
Outcome: The proposed method bridges the gap between supervised contrastive learning and HMTC by bringing text and label embeddings closer.
Jointprop: Joint Semi-supervised Learning for Entity and Relation Extraction with Heterogeneous Graph-based Propagation (2023.acl-long)

Copied to clipboard

Challenge: Named Entity Recognition and Relation Extraction are two crucial tasks in Information Extraction.
Approach: They propose a framework for joint semi-supervised entity and relation extraction that captures the global structure information between tasks and exploits interactions within unlabeled data.
Outcome: The proposed framework outperforms state-of-the-art semi-supervised approaches on NER and RE tasks.
Multi-Task Learning of Pairwise Sequence Classification Tasks over Disparate Label Spaces (N18-1)

Copied to clipboard

Challenge: Multi-task learning and semi-supervised learning are successful paradigms for learning in scenarios with limited labelled data.
Approach: They propose to induce a joint embedding space between disparate label spaces and learning transfer functions between label embeddments to leverage unlabelled data and auxiliary, annotated datasets.
Outcome: The proposed approach outperforms strong single and multi-task baselines and achieves state of the art on aspect-based and topic-based sentiment analysis.
Towards Better Representations for Multi-Label Text Classification with Multi-granularity Information (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing studies have shown that pre-trained language models generate word frequency-oriented text representations, causing texts with different labels to be closely distributed in a narrow region, which is difficult to classify.
Approach: They propose a framework to refine the text representation for multi-label text classification using contrastive learning and multi-task learning modules.
Outcome: The proposed framework improves the quality of the representations and yields stable and competitive improvements.
VerifyMatch: A Semi-Supervised Learning Paradigm for Natural Language Inference with Confidence-Aware MixUp (2024.emnlp-main)

Copied to clipboard

Challenge: Natural language inference (NLI) is a key task for evaluating a model's ability to perform natural language understanding and reasoning.
Approach: They propose to construct pseudo-generated samples using class-specific fine-tuned large language models (LLMs) . they retain all pseudo-labeled samples, but use MixUp to ensure unlabele .
Outcome: The proposed approach achieves competitive accuracy compared to strong baselines for NLI datasets in low-resource settings.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations