| Challenge: | Conventional supervised training is a pervasive paradigm for NLP problems . however, examples of the same problem may vary widely . a few-shot meta-learning scenario is used to learn multiple models . |
| Approach: | They propose a learning protocol that treats each example as a unique pseudo-task . they use a few-shot meta-learning scenario to reduce the original learning problem to a single example . |
| Outcome: | The proposed learning protocol achieves 1.1%–5.4% accuracy gains over non-meta-learning counterparts on a WikiSQL dataset. |
Similar Papers
Meta-Learning for Domain Generalization in Semantic Parsing (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches to parsing use standard supervised learning, but little attention has been given to domain generalization. |
| Approach: | They propose a meta-learning framework which targets zero-shot domain generalization for semantic parsing. |
| Outcome: | The proposed framework significantly boosts parser performance on English and Chinese spider datasets. |
MetaICL: Learning to Learn In Context (2022.naacl-main)
Copied to clipboard
| Challenge: | Large language models can do in-context learning by conditioning on a few training examples with no parameter updates or task-specific templates. |
| Approach: | They propose a meta-training framework where a pretrained language model is tuned to do in-context learning on a large set of training tasks. |
| Outcome: | The proposed framework outperforms baseline models on 142 NLP datasets and a range of target tasks with domain shifts. |
Meta Learning and Its Applications to Natural Language Processing (2021.acl-tutorials)
Copied to clipboard
| Challenge: | Meta-learning is a new technique that aims to learn better learning algorithms, including better parameter initialization, optimization strategy, network architecture, distance metrics, and beyond. |
| Approach: | This tutorial introduces Meta-learning approaches and the theory behind them, and then reviews the works of applying this technology to NLP problems. |
| Outcome: | This tutorial will introduce Meta-learning approaches and the theory behind them, and then review the works of applying this technology to NLP problems. |
Meta-training with Demonstration Retrieval for Efficient Few-shot Learning (2023.findings-acl)
Copied to clipboard
| Challenge: | Large language models have impressive fewshot performance on many NLP tasks and domains. |
| Approach: | They propose a meta-training approach that uses demonstration retrieval to train parameter-efficient models that generalize well on a larger variety of tasks. |
| Outcome: | The proposed approach outperforms many parameter-efficient methods on QA, NLI, and text classification tasks. |
Self-Supervised Meta-Learning for Few-Shot Natural Language Classification Tasks (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for supervised meta-learning require many training tasks to generalize . cloze-style objectives can be used to generate a large, rich, meta-training task distribution from unlabeled text. |
| Approach: | They propose a self-supervised approach to generate a large, rich, meta-learning task distribution from unlabeled text. |
| Outcome: | The proposed approach generates a large, rich, meta-learning task distribution from unlabeled text. |
Meta Learning for Natural Language Processing: A Survey (2022.naacl-main)
Copied to clipboard
| Challenge: | Meta-learning is an emerging field in machine learning, but there is no systematic survey of these approaches in NLP. |
| Approach: | They propose to introduce meta-learning and the common approaches and summarize their work and review their work in the NLP community. |
| Outcome: | The proposed methods improve performance in many NLP tasks but are limited to domains, languages, countries, or styles. |
Meta-Learning Adversarial Domain Adaptation Network for Few-Shot Text Classification (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches for few-shot text classification rely on exploitation of lexical features and distributional signatures on training data, while neglecting to strengthen the model's ability to adapt to new tasks. |
| Approach: | They propose a meta-learning framework integrated with an adversarial domain adaptation network to improve the model's adaptive ability and generate high-quality text embedding for new classes. |
| Outcome: | The proposed framework outperforms the state-of-the-art models on four datasets and shows clear superiority over existing models. |
Improve Meta-learning for Few-Shot Text Classification with All You Can Acquire from the Tasks (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for few-shot text classification often encounter problems drawing accurate class prototypes from support set samples. |
| Approach: | They propose a meta-learning method that leverages the information within the task itself . they propose Query-Data-Augmenter and Label-Adapter to build a task-adaptive metric space . |
| Outcome: | The proposed method shows obvious advantages over state-of-the-art models on eight benchmark datasets. |
Few-shot initializing of Active Learner via Meta-Learning (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in few-shot and zero-shot learning have limited performance in domain specific applications. |
| Approach: | They propose to initialize an active learner with meta-learned parameters and generate task dependent softmax weights for active learning. |
| Outcome: | The proposed method performs better than the baseline at low budget, the authors show . they show that adding meta-learned learning rates and generating the softmax have negative consequences . |
Meta-Learning a Cross-lingual Manifold for Semantic Parsing (2023.tacl-1)
Copied to clipboard
| Challenge: | Recent work has found success with machine translation or zero-shot methods . however, these approaches can struggle to model how native speakers ask questions . |
| Approach: | They propose a meta-learning algorithm to leverage minimal annotated examples in new languages for few-shot cross-lingual semantic parsing. |
| Outcome: | The proposed approach trains a parser with maximum sample efficiency in six languages on ATIS. |