On the Compositional Generalization in Versatile Open-domain Dialogue (2023.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to multi-task learning suffer from interference among datasets or fail to effectively reuse knowledge and skills learned from other datasets. |
| Approach: | They propose a sparsely activated modular network with a well-rounded set of operators and instantiate each operator with an independent module. |
| Outcome: | The proposed model outperforms state-of-the-art supervised approaches on 4 datasets with only 10% training data thanks to the modular architecture and multi-task learning. |
Similar Papers
Re-framing Incremental Deep Language Models for Dialogue Processing with Multi-task Learning (2020.coling-main)
Copied to clipboard
| Challenge: | Using a multi-task learning framework, we train a universal incremental dialogue processing model with four tasks of disfluency detection, language modelling, part-of-speech tagging and utterance segmentation in a simple deep recurrent setting. |
| Approach: | They propose a multi-task learning framework to train a universal incremental dialogue processing model with four tasks of disfluency detection, language modelling, part-of-speech tagging and utterance segmentation in a simple deep recurrent setting. |
| Outcome: | The proposed model outperforms individual tasks and delivers competitive performance. |
Generalizable and Explainable Dialogue Generation via Explicit Action Learning (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Conditioned response generation for task-oriented dialogues implicitly optimizes task completion and language quality. |
| Approach: | They propose to learn natural language actions that represent utterances as a span of words. |
| Outcome: | The proposed approach outperforms latent action baselines on a multi-domain dataset. |
Learning a Simple and Effective Model for Multi-turn Response Generation with Auxiliary Tasks (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to multi-turn response generation for open-domain dialogues have a complexity problem . auxiliary tasks that relate to context understanding can guide the learning of the generation model . |
| Approach: | They propose a multi-turn response generation model that has a simple structure yet can effectively leverage conversation contexts for response generation. |
| Outcome: | The proposed model outperforms state-of-the-art models in response quality and human judgment . it also enjoys a faster decoding process . |
Hello, It’s GPT-2 - How Can I Help You? Towards the Use of Pretrained Language Models for Task-Oriented Dialogue Systems (D19-56)
Copied to clipboard
| Challenge: | Statistical conversational systems are complex, timeintensive, expensive, and not easily transferable due to data scarcity. |
| Approach: | They propose a task-oriented dialogue model that operates on text input . they validate it on multi-domain task-orientated dialogues from a multi-word dataset . |
| Outcome: | The proposed model bypasses explicit policy and language generation modules on multi-domain task-oriented dialogues from the MultiWOZ dataset. |
Compositional Generalization in Grounded Language Learning via Induced Model Sparsity (2022.naacl-srw)
Copied to clipboard
| Challenge: | induced model sparsity can help achieve compositional generalization and sample efficiency in grounded language learning problems. |
| Approach: | They propose a model that encourages sparse correlations between words and attributes to find a goal in a language-conditioned navigation problem with disentangled observations. |
| Outcome: | The proposed agent maintains high performance even when learning from a handful of demonstrations. |
Robust Task-Oriented Dialogue Generation with Contrastive Pre-training and Adversarial Filtering (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Task-oriented dialogue models can learn non-transferable generalizations by using shortcuts in the data. |
| Approach: | They propose a contrastive learning framework to encourage models to ignore cues and focus on generalisable patterns. |
| Outcome: | The proposed framework performs exceptionally well on task-oriented dialogue datasets. |
Finding needles in a haystack: Sampling Structurally-diverse Training Sets from Synthetic Data for Compositional Generalization (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent research shows that automatic generation of synthetic utterance-program pairs can alleviate the first problem, but its potential for the second has thus far been under-explored. |
| Approach: | They propose to generate synthetic utterance-program pairs for improving compositional generalization in semantic parsing by using structurally-diverse examples. |
| Outcome: | The proposed approach leads to dramatic improvements in compositional generalization and moderate improvements in the traditional i.i.d setup. |
Can You Put it All Together: Evaluating Conversational Agents’ Ability to Blend Skills (2020.acl-main)
Copied to clipboard
| Challenge: | Existing work has focused on learning specific qualities of conversational agents, but it remains unclear how to combine them. |
| Approach: | They propose to combine models trained towards isolated capabilities with multi-task training to improve conversation performance. |
| Outcome: | The proposed dataset compares models trained towards isolated capabilities with models trained on a single skill. |
Multi-Domain Dialogue Acts and Response Co-Generation (2020.acl-main)
Copied to clipboard
| Challenge: | Existing pipeline approaches for task-oriented dialogue systems tend to predict multiple dialogue acts first and use them to assist response generation. |
| Approach: | They propose a neural co-generation model that generates dialogue acts and responses concurrently and preserves semantic structures of multi-domain dialogue acts. |
| Outcome: | The proposed model improves over state-of-the-art models in automatic and human evaluations on a large-scale dataset. |
Learning to Control the Specificity in Neural Response Generation (P18-1)
Copied to clipboard
| Challenge: | Existing generative conversational models tend to favor general and trivial responses which appear frequently. |
| Approach: | They propose a controlled response generation mechanism to handle different utterance-response relationships in terms of specificity. |
| Outcome: | The proposed model outperforms state-of-the-art models under automatic and human evaluations. |