BYOC: Personalized Few-Shot Classification with Co-Authored Class Descriptions (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to text classification require large annotated corpora to train or long context to fit many examples. |
| Approach: | They propose a method to few-shot text classification using an LLM. |
| Outcome: | The proposed approach yields high accuracy classifiers within 79% of the performance of models trained with larger datasets while using only 1% of their training sets. |
Similar Papers
Incremental Few-shot Text Classification with Multi-round New Classes: Formulation, Dataset and System (2021.naacl-main)
Copied to clipboard
| Challenge: | Text classification is usually studied by labeling texts with relevant categories from a predefined set. |
| Approach: | They propose a task where a system incrementally handles multiple rounds of new classes . they propose two entailment approaches, ENTAILMENT and HYBRID, which show promise . |
| Outcome: | The proposed task is based on a few-shot text classification task in the NLP domain. |
Automatically Identifying Words That Can Serve as Labels for Few-Shot Text Classification (2020.coling-main)
Copied to clipboard
| Challenge: | Existing approaches to few-shot text classification require domain expertise and an understanding of the language model's abilities to define the mapping between words and labels. |
| Approach: | They propose a method that converts textual inputs to cloze questions that contain some form of task description and processes them with a pretrained language model to map the predicted words to labels. |
| Outcome: | The proposed approach performs almost as well as hand-crafted label-to-word mappings for a number of tasks with small amounts of training data. |
Automated Few-Shot Classification with Instruction-Finetuned Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing few-shot learning approaches combine language models with prompts, but they often require domain knowledge and substantial guesswork. |
| Approach: | They propose a method to eliminate the need for handcrafted prompts by generating two distinct, semantically meaningful class descriptions and a selection mechanism via cross-validation. |
| Outcome: | The proposed method outperforms state-of-the-art few-shot learning methods over 12 datasets, spanning 8 classification tasks. |
Making Pre-trained Language Models Better Few-shot Learners (2021.acl-long)
Copied to clipboard
| Challenge: | Recent studies show that the GPT-3 model can perform few-shots on language understanding tasks with a natural-language prompt and a few task demonstrations. |
| Approach: | They propose a technique for fine-tuning language models using a few examples . they propose LM-BFF, which uses prompt-based fine-uning and a pipeline for automating prompt generation . |
| Outcome: | The proposed approach outperforms standard fine-tuning procedures on a range of NLP tasks. |
Enhancing Few-Shot Topic Classification with Verbalizers. a Study on Automatic Verbalizer and Ensemble Methods (2024.lrec-main)
Copied to clipboard
Quang Anh Nguyen, Nadi Tomeh, Mustapha Lebbah, Thierry Charnois, Hanene Azzag, Santiago Cordoba Muñoz
| Challenge: | Pretrained language models are increasingly being used for many tasks. |
| Approach: | They propose to use verbalizers to help interpret masked word distributions into output predictions. |
| Outcome: | The proposed approach outperforms models trained with individual templates while using significantly less resources. |
Zero-Shot Text Classification with Self-Training (2022.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in large pretrained language models have increased attention to zero-shot text classification. |
| Approach: | They propose a plug-and-play method to bridge this gap by requiring only class names along with an unlabeled dataset. |
| Outcome: | The proposed model can be trained on a natural language inference dataset and performs on dozens of unseen tasks without the need for domain expertise or trial and error. |
Few-shot Personalization of LLMs with Mis-aligned Responses (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing approaches have limited successes in personalizing large language models due to the lack of personalized learning or the reliance on shared personal data. |
| Approach: | They propose a few-shot personalization of large language models with mis-aligned responses using LLMs by learning a set of personalized prompts for each user based on user profile and examples of previous opinions. |
| Outcome: | The proposed method significantly improves performance across benchmarks compared to best-performing baselines. |
Active Few-Shot Learning for Text Classification (2025.naacl-long)
Copied to clipboard
Saeed Ahmadnia, Arash Yousefi Jordehi, Mahsa Hosseini Khasheh Heyran, Seyed Abolghasem Mirroshandel, Owen Rambow, Cornelia Caragea
| Challenge: | Recent advances in Large Language Models (LLMs) have boosted the use of Few-Shot Learning (FSL) methods in natural language processing. |
| Approach: | They propose a method that identifies effective support instances from the unlabeled pool and can work with different LLMs. |
| Outcome: | The proposed method improves on five tasks on which it is tested on five LLMs. |
Few-Shot NLG with Pre-Trained Language Model (2020.acl-main)
Copied to clipboard
| Challenge: | Neural-based approaches to natural language generation are data-hungry and difficult to adopt in real-world applications. |
| Approach: | They propose a task of few-shot natural language generation from structured data or knowledge to generate coherent sentences from input data and language modeling to compose coherent sentences. |
| Outcome: | The proposed approach outperforms the strongest baseline approach by over 8.0 BLEU points improvement. |
Enhancing Low-Resource LLMs Classification with PEFT and Synthetic Data (2024.lrec-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) operating in 0-shot or few-shot settings achieve competitive results in Text Classification tasks. |
| Approach: | They propose to make Large Language Models (LLMs) operating in 0-shot or few-shot settings as efficient as 0- shot text classifiers by leveraging a small number of samples. |
| Outcome: | The proposed model is able to perform better on multiple datasets than existing models on 0-shot or few-shot settings. |