Simulated Chats for Building Dialog Systems: Learning to Generate Conversations from Instructions (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Popular dialog datasets such as MultiWOZ are created by providing crowd workers with instructions that describe the task to be accomplished. |
| Approach: | They propose a data creation strategy that uses a pre-trained language model to simulate the interaction between crowd workers by creating a user bot and an agent bot. |
| Outcome: | The proposed data creation strategy improves on two publicly available datasets using a pre-trained language model and a smaller percentage of actual crowd-generated conversations and their corresponding instructions. |
Similar Papers
Controllable Dialogue Simulation with In-context Learning (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to generate annotated dialogues require crowdsourcing, which is expensive and time-consuming. |
| Approach: | They propose a dialogue simulation method based on large language model in-context learning that generates new dialogues and annotations in a controllable way. |
| Outcome: | The proposed method can expand a small set of dialogue data with minimum or zero human involvement and parameter update. |
Learning Health-Bots from Training Data that was Automatically Created using Paraphrase Detection and Expert Knowledge (2020.coling-main)
Copied to clipboard
| Challenge: | Current dialog models require large quantities of training data due to privacy issues . current methods require large amounts of training and are even scarcer in the health domain . |
| Approach: | They propose a method for creating dialog corpora from physician-patient interaction data . they combine expert knowledge provided by physicians with automatic paraphrase extraction techniques . |
| Outcome: | The proposed method outperforms existing models in the health domain . it provides a natural way of guiding learning and improves quality of human-machine interactions . |
Towards Exploiting Background Knowledge for Building Conversation Systems (D18-1)
Copied to clipboard
| Challenge: | Existing dialog datasets contain a sequence of utterances without any explicit background knowledge associated with them. |
| Approach: | They propose to use movie chats to generate responses by copying unstructured background knowledge . they use a dataset of 9K conversations to test whether responses are generated by copy-and-modify models . |
| Outcome: | The proposed model mimics human process of conversing by copying and/or modifying sentences from unstructured background knowledge. |
Hello, It’s GPT-2 - How Can I Help You? Towards the Use of Pretrained Language Models for Task-Oriented Dialogue Systems (D19-56)
Copied to clipboard
| Challenge: | Statistical conversational systems are complex, timeintensive, expensive, and not easily transferable due to data scarcity. |
| Approach: | They propose a task-oriented dialogue model that operates on text input . they validate it on multi-domain task-orientated dialogues from a multi-word dataset . |
| Outcome: | The proposed model bypasses explicit policy and language generation modules on multi-domain task-oriented dialogues from the MultiWOZ dataset. |
Large Scale Multi-Actor Generative Dialog Modeling (2020.acl-main)
Copied to clipboard
| Challenge: | Non-goal oriented dialog agents typically exhibit inconsistent personality across conversations or the average personality of all users. |
| Approach: | They propose a model that conditionally models past conversations to probabilistically model multi-turn conversations in the actor’s persona. |
| Outcome: | The proposed model improves perplexity on 1.7M held out Reddit conversations by 0.47 on scaling from 117M to 8.3B parameters. |
q2d: Turning Questions into Dialogs to Teach Models How to Search (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent dialog generation models use external search APIs to generate grounded responses. |
| Approach: | They propose an automatic data generation pipeline that generates dialogs from questions . they use a large language model to create conversational versions of question answering datasets . |
| Outcome: | The proposed method improves query generation models on a QReCC dataset. |
Grounding in social media: An approach to building a chit-chat dialogue model (2022.naacl-srw)
Copied to clipboard
| Challenge: | Existing open-domain dialogue models fail to capture and utilize external knowledge, leading to repetitive or generic responses to unseen utterances. |
| Approach: | They propose to use social media comments to improve the raw conversation ability of open-domain dialogue systems. |
| Outcome: | The proposed model improves the raw conversation ability of open-domain dialogue systems by mimicking human responses through casual interactions found on social media. |
Taskmaster-1: Toward a Realistic and Diverse Dialog Dataset (D19-1)
Copied to clipboard
Bill Byrne, Karthik Krishnamoorthi, Chinnadhurai Sankar, Arvind Neelakantan, Ben Goodrich, Daniel Duckworth, Semih Yavuz, Amit Dubey, Kyu-Young Kim, Andy Cedilnik
| Challenge: | a lack of high quality conversational data is limiting progress in dialog systems . we present a dataset of 13,215 task-based dialogs . |
| Approach: | They propose a task-based dialog dataset which includes 13,215 task-related dialogs . they use a two-person, spoken "Wizard of Oz" approach and a "self-dialog" approach . |
| Outcome: | The taskmaster-1 dataset contains 13,215 task-based dialogs comprising six domains. |
PRAL: A Tailored Pre-Training Model for Task-Oriented Dialog Generation (2021.acl-short)
Copied to clipboard
| Challenge: | Existing approaches to building task-oriented dialog systems require a substantial amount of annotations and thus are labor-intensive. |
| Approach: | They propose a Pre-trainedRole Alternating Language model (PRAL) that is explicitly designed for task-oriented dialog tasks. |
| Outcome: | The proposed model outperforms or is on par with state-of-the-art models on task-oriented dialog tasks. |
ChartDialogs: Plotting from Natural Language Instructions (2020.acl-main)
Copied to clipboard
| Challenge: | a new dataset of conversational plotting agents is developed to facilitate the development of such agents. |
| Approach: | They propose a dataset that contains over 15,000 dialog turns from matplotlib's most popular plotting library. |
| Outcome: | The proposed system achieves 61% plotting accuracy, compared to the previous method. |