Multi-task Learning for Natural Language Generation in Task-Oriented Dialogue (D19-1)
Copied to clipboard
| Challenge: | Existing methods to generate natural language for task-oriented dialogues lack naturalness and variation in language. |
| Approach: | They propose a multi-task learning framework for natural language generation that explicitly targets for naturalness in generated responses via an unconditioned language model. |
| Outcome: | The proposed framework outperforms existing models across multiple datasets in the study of natural language generation. |
Similar Papers
Adaptive Natural Language Generation for Task-oriented Dialogue via Reinforcement Learning (2022.coling-1)
Copied to clipboard
| Challenge: | In task-oriented dialogue systems, the role of the natural language generation component is to convert a system's intentions, called dialogue acts (DAs), into natural language utterances and to convey DAs accurately to users. |
| Approach: | They propose a method for Adaptive Natural language generation for Task-Oriented dialogue via Reinforcement learning that incorporates a natural language understanding module into the objective function of RL. |
| Outcome: | The proposed method generates adaptive utterances against speech recognition errors and the different vocabulary levels of users in a multi-world task-oriented dialogue system. |
Controlled Language Generation for Language Learning Items (2022.emnlp-industry)
Copied to clipboard
| Challenge: | Recent advances in pre-trained language models have resulted in success in generating fluent English text. |
| Approach: | They propose to employ natural language generation to rapidly generate English language items . they experiment with deep pretrained models and develop methods for controlling items for factors relevant in language learning . |
| Outcome: | The proposed framework shows high grammatically scores for all models and higher complexity over baseline models. |
Natural Language Processing for Multilingual Task-Oriented Dialogue (2022.acl-tutorials)
Copied to clipboard
| Challenge: | a tutorial will examine the challenges and gaps in multilingual ToD research . multilingual systems are difficult to build, and are limited to English and other languages . |
| Approach: | This tutorial will discuss the importance of multilingual task-oriented dialogue systems . it will provide an overview of current research gaps, challenges and initiatives related to multilingual ToD systems - with a particular focus on their connections to current research and challenges in multilingual and low-resource NLP. |
| Outcome: | This tutorial will provide an overview of current research gaps, challenges and initiatives related to multilingual ToD systems. |
Dual Supervised Learning for Natural Language Understanding and Generation (P19-1)
Copied to clipboard
| Challenge: | Natural language understanding and natural language generation are important research topics in the NLP and dialogue fields. |
| Approach: | They propose a dual-supervised learning framework for natural language understanding and generation on top of dual supervised learning. |
| Outcome: | The proposed framework boosts the performance of both tasks simultaneously in the benchmark experiments. |
Few-shot Natural Language Generation for Task-Oriented Dialog (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for NLG depend on heavily annotated data, which is infeasible for new domains. |
| Approach: | They propose a system that converts a dialog act into a response in natural language . they propose 'nuclear language generation' to simulate a few-shot learning setting . |
| Outcome: | The proposed model outperforms existing methods on a large set of annotated datasets. |
Modelling Context Emotions using Multi-task Learning for Emotion Controlled Dialog Generation (2021.eacl-main)
Copied to clipboard
| Challenge: | Recent research has tackled this task using neural generative methods by augmenting emotion classes with the input sequences. |
| Approach: | They propose to use a self-attention based encoder and a decoder with dot product attention mechanism to generate a viable response with a specified emotion. |
| Outcome: | The proposed model outperforms baselines on automatic evaluation measures such as F1 and BLEU scores, thus resulting in more fluent and adequate responses. |
Knowledge-Grounded Dialogue Generation with Pre-trained Language Models (2020.emnlp-main)
Copied to clipboard
| Challenge: | Empirical results indicate that pre-trained language models can significantly outperform state-of-the-art methods in both automatic evaluation and human judgment. |
| Approach: | They propose to equip a pre-trained language model with a knowledge selection module to generate knowledge-grounded dialogues. |
| Outcome: | The proposed model outperforms state-of-the-art methods in evaluation and human judgment. |
A Generative Model for Joint Natural Language Understanding and Generation (2020.acl-main)
Copied to clipboard
| Challenge: | Natural language understanding (NLU) and natural language generation (NLG) have opposite goals. |
| Approach: | They propose a generative model which couples NLU and NLG through a shared latent variable. |
| Outcome: | The proposed model achieves state-of-the-art performance on two dialogue datasets with flat and tree-structured formal representations. |
Hello, It’s GPT-2 - How Can I Help You? Towards the Use of Pretrained Language Models for Task-Oriented Dialogue Systems (D19-56)
Copied to clipboard
| Challenge: | Statistical conversational systems are complex, timeintensive, expensive, and not easily transferable due to data scarcity. |
| Approach: | They propose a task-oriented dialogue model that operates on text input . they validate it on multi-domain task-orientated dialogues from a multi-word dataset . |
| Outcome: | The proposed model bypasses explicit policy and language generation modules on multi-domain task-oriented dialogues from the MultiWOZ dataset. |
Dual Inference for Improving Language Understanding and Generation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies have exploited the duality of the task pairs in machine translation and speech recognition. |
| Approach: | They propose to leverage the duality in the inference stage without retraining whole models. |
| Outcome: | The proposed method is effective in both NLU and NLG tasks, providing the great potential of practical use. |