Distinct Label Representations for Few-Shot Text Classification (2021.acl-short)
Copied to clipboard
| Challenge: | Existing methods for few-shot text classification ignore the semantic relevance of labels and are difficult to train because of the lack of training examples. |
| Approach: | They propose a method that generates distinct label representations that embed information specific to each label. |
| Outcome: | The proposed method significantly improves few-shot text classification across models and datasets. |
Similar Papers
Automatically Identifying Words That Can Serve as Labels for Few-Shot Text Classification (2020.coling-main)
Copied to clipboard
| Challenge: | Existing approaches to few-shot text classification require domain expertise and an understanding of the language model's abilities to define the mapping between words and labels. |
| Approach: | They propose a method that converts textual inputs to cloze questions that contain some form of task description and processes them with a pretrained language model to map the predicted words to labels. |
| Outcome: | The proposed approach performs almost as well as hand-crafted label-to-word mappings for a number of tasks with small amounts of training data. |
Few-Shot and Zero-Shot Multi-Label Learning for Structured Label Spaces (D18-1)
Copied to clipboard
| Challenge: | Large multi-label datasets contain labels that occur thousands of times (frequent group), those that occur only a few times (few-shot group) and labels that never appear in the training dataset (zero-shot groups). |
| Approach: | They perform a fine-grained evaluation to understand how state-of-the-art methods perform on infrequent labels. |
| Outcome: | The proposed methods improve on two publicly available datasets for multi-label text classification. |
Label Semantics for Few Shot Named Entity Recognition (2022.findings-acl)
Copied to clipboard
Jie Ma, Miguel Ballesteros, Srikanth Doss, Rishita Anubhai, Sunil Mallya, Yaser Al-Onaizan, Dan Roth
| Challenge: | Named entity recognition (NER) is a fundamental natural language understanding task that requires large amounts of high quality annotated in-domain data. |
| Approach: | They propose a neural architecture that leverages the semantic information in the names of the labels to give the model additional signal and enriched priors. |
| Outcome: | The proposed model is especially effective in low resource settings. |
Don’t Miss the Labels: Label-semantic Augmented Meta-Learner for Few-Shot Text Classification (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing studies focus on building a meta-learner from input text but ignore abundant semantic information beneath class labels. |
| Approach: | They propose a framework to make full use of label semantics in few-shot text classification systems. |
| Outcome: | The proposed framework can be plugged into the existing few-shot text classification system. |
Few-Shot Text Classification with Edge-Labeling Graph Neural Network-Based Prototypical Network (2020.coling-main)
Copied to clipboard
| Challenge: | a few-shot text classification method is proposed to solve the few-sshot text problem . supervised learning methods require large corpus of labeled data, making them hindered in practical application. |
| Approach: | They propose a few-shot text classification method that takes advantage of advanced pre-trained language models to extract the semantic features of each document. |
| Outcome: | The proposed method achieves state-of-the-art on sentiment analysis and relation datasets. |
Leveraging Text-to-Text Transformers as Classifier Chain for Few-Shot Multi-Label Classification (2025.emnlp-main)
Copied to clipboard
| Challenge: | Multilabel text classification (MLTC) is an essential task in NLP applications. |
| Approach: | They propose a distillation-based T5 generalist model for zero-shot MLTC and few-shot fine-tuning. |
| Outcome: | The proposed model outperforms baselines of similar size on three few-shot tasks. |
The Benefits of Label-Description Training for Zero-Shot Text Classification (2023.emnlp-main)
Copied to clipboard
| Challenge: | Pretrained language models have improved zero-shot text classification by allowing the transfer of semantic knowledge from the training data to classify among specific label sets in downstream tasks. |
| Approach: | They propose to use a small finetuning dataset to describe the labels for a task and to use it to further improve zero-shot accuracies. |
| Outcome: | The proposed model is more accurate than zero-shot by 17-19% absolute across topic and sentiment datasets and more robust to choices required for zero- shot classification. |
Multi-label Few/Zero-shot Learning with Knowledge Aggregated from Multiple Label Graphs (2020.emnlp-main)
Copied to clipboard
| Challenge: | Few/zero-shot learning is a big challenge of many classification tasks, where a classifier is required to recognise instances of classes that have very few or even no training samples. |
| Approach: | They propose a multi-graph aggregation model that fuses knowledge from multiple label graphs encoding different semantic label relationships to improve multi-label zero/few-shot document classification. |
| Outcome: | The proposed model improves on two large clinical datasets and the EU legislation dataset on few/zero-shot labels. |
X-Shot: A Unified System to Handle Frequent, Few-shot and Zero-shot Learning Simultaneously in Classification (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have focused on few-shot and zero-shot learning, but label occurrences vary widely . authors propose a new classification challenge that can be used to manage labels across the full frequency spectrum . |
| Approach: | They propose a new classification challenge that allows for label co-occurrences without predefined limits. |
| Outcome: | The proposed system can handle freq-shot, few-shot and zero-shot labels without limits. |
Incremental Few-shot Text Classification with Multi-round New Classes: Formulation, Dataset and System (2021.naacl-main)
Copied to clipboard
| Challenge: | Text classification is usually studied by labeling texts with relevant categories from a predefined set. |
| Approach: | They propose a task where a system incrementally handles multiple rounds of new classes . they propose two entailment approaches, ENTAILMENT and HYBRID, which show promise . |
| Outcome: | The proposed task is based on a few-shot text classification task in the NLP domain. |