Continual Learning for Natural Language Generation in Task-oriented Dialog Systems (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing neural approaches for natural language generation are typically developed offline for specific domains. |
| Approach: | They propose a method to expand NLG knowledge incrementally to new domains . major challenge is catastrophic forgetting, meaning a model forgets the knowledge it has learned before . |
| Outcome: | The proposed method outperforms other methods by effectively mitigating catastrophic forgetting issue. |
Similar Papers
Continual Learning in Task-Oriented Dialogue Systems (2021.emnlp-main)
Copied to clipboard
Andrea Madotto, Zhaojiang Lin, Zhenpeng Zhou, Seungwhan Moon, Paul Crook, Bing Liu, Zhou Yu, Eunjoon Cho, Pascale Fung, Zhiguang Wang
| Challenge: | Existing continuous learning systems are not designed to add new domains and functionalities through time without incurring the high cost of retraining the whole system. |
| Approach: | They propose a first-ever continual learning benchmark for task-oriented dialogue systems . they propose 'architecture' method based on residual adapters to implement continual training . |
| Outcome: | The proposed architectural method performs better than multitask learning while being 20X faster in learning new domains. |
Continual Training of Language Models for Few-Shot Learning (2022.emnlp-main)
Copied to clipboard
| Challenge: | Recent work on applying large language models (LMs) achieves impressive performance in many NLP applications. |
| Approach: | They propose to continuously post-train an LM with unlabeled domains to expand its knowledge without forgetting previous skills. |
| Outcome: | The proposed system improves few-shot end-task learning in these domains. |
Exploring Continual Learning for Code Generation Models (2023.acl-short)
Copied to clipboard
Prateek Yadav, Qing Sun, Hantian Ding, Xiaopeng Li, Dejiao Zhang, Ming Tan, Parminder Bhatia, Xiaofei Ma, Ramesh Nallapati, Murali Krishna Ramanathan, Mohit Bansal, Bing Xiang
| Challenge: | Large-scale code generation models such as Copilot and CodeT5 are expensive to train and re-train. |
| Approach: | They propose a benchmark for Continual Learning (CL) that covers a wide range of tasks with different input and output programming languages. |
| Outcome: | The proposed method improves on Prompt Pooling with Teacher Forcing, which suffers catastrophic forgetting due to stark distribution shifts in coding tasks. |
Continual Reinforcement Learning for Controlled Text Generation (2024.lrec-main)
Copied to clipboard
| Challenge: | Controlled Text Generation (CTG) aims to steer text generation towards texts possessing a desired attribute. |
| Approach: | They propose an algorithm that steers the generation of continuations of a given context . they propose a Continual Learning problem to learn at every step to steer next-word generation . |
| Outcome: | The proposed algorithm is based on a plug-and-play language model and exhibits promising results. |
Alternating Recurrent Dialog Model with Large-scale Pre-trained Language Models (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing dialog system models require extensive human annotations and are difficult to generalize to different tasks. |
| Approach: | They propose a framework that uses pre-trained language to model each speaker separately . it can be generalized to more challenging, non-collaborative tasks such as persuasion . |
| Outcome: | The proposed framework outperforms or is on par with state-of-the-art methods on two popular datasets: CamRest676 and MultiWOZ. |
Fine-tuned Language Models are Continual Learners (2022.emnlp-main)
Copied to clipboard
| Challenge: | Recent work on large language models relies on intuition that most tasks can be described via natural language instructions. |
| Approach: | They propose that a model should be able to keep extending its knowledge without forgetting previous skills. |
| Outcome: | The proposed model can learn 8 new diverse language generation tasks while maintaining good performance on previous tasks, spanning in total of 70 datasets. |
Class-Incremental Learning based on Label Generation (2023.acl-short)
Copied to clipboard
| Challenge: | Existing studies on pre-trained language models focus on task-incremental learning (TIL) but they perform poorly in a more challenging setting of class-incremental learning. |
| Approach: | They propose a method which solves CIL based on label generation by using sparse vocabulary and creates pseudo-replay samples by using label semantics. |
| Outcome: | The proposed method outperforms baseline models by a large margin in the class-incremental learning setting. |
Self-generated Replay Memories for Continual Neural Machine Translation (2024.naacl-long)
Copied to clipboard
| Challenge: | Neural Machine Translation systems exhibit strong performance in several different languages, but their ability to learn continuously is limited by catastrophic forgetting. |
| Approach: | They propose a method that leverages a key property of encoder-decoder Transformers, i.e. their generative ability, to continuously learn Neural Machine Translation systems. |
| Outcome: | The proposed approach can counteract catastrophic forgetting without explicit memorization of training data. |
Multi-task Learning for Natural Language Generation in Task-Oriented Dialogue (D19-1)
Copied to clipboard
| Challenge: | Existing methods to generate natural language for task-oriented dialogues lack naturalness and variation in language. |
| Approach: | They propose a multi-task learning framework for natural language generation that explicitly targets for naturalness in generated responses via an unconditioned language model. |
| Outcome: | The proposed framework outperforms existing models across multiple datasets in the study of natural language generation. |
Task-wrapped Continual Learning in Task-Oriented Dialogue Systems (2025.findings-naacl)
Copied to clipboard
| Challenge: | Continual learning is vital for task-oriented dialogue systems (ToDs), but its performance is limited by training separate adapters for each task, preventing global knowledge sharing. |
| Approach: | They propose a framework that employs task-wrapped Adapters to learn global and task-specific information through parameter sharing. |
| Outcome: | The proposed framework outperforms AdapterCL in 37 domains while using only 46% of the parameters. |