| Challenge: | Recent advances in dialogue generation have inspired a number of studies on dialogue systems . however, current datasets are limited in size and the environment for training agents is relatively unsophisticated. |
| Approach: | They propose to use a context-generator to generate travel and flight restrictions to train agents. |
| Outcome: | The proposed model achieves a score of 0.17 while humans can reach 0.91 . the proposed model is based on a large dataset that contains 301,427 goal-oriented conversations . |
Similar Papers
Context-Aware Language Modeling for Goal-Oriented Dialogue Systems (2022.findings-naacl)
Copied to clipboard
| Challenge: | Goal-oriented dialogue systems face a trade-off between fluent language generation and task-specific control. |
| Approach: | They propose a method to fine-tune language models in a goal-aware way . they evaluate a flight-booking method with a context-assisted language model . |
| Outcome: | The proposed method outperforms the state-of-the-art method on a flight-booking task by 7% in terms of task success. |
Alexa Conversations: An Extensible Data-driven Approach for Building Task-oriented Dialogue Systems (2021.naacl-demos)
Copied to clipboard
Anish Acharya, Suranjit Adhikari, Sanchit Agarwal, Vincent Auvray, Nehal Belgamwar, Arijit Biswas, Shubhra Chandra, Tagyoung Chung, Maryam Fazel-Zarandi, Raefer Gabriel, Shuyang Gao, Rahul Goel, Dilek Hakkani-Tur, Jan Jezabek, Abhay Jha, Jiun-Yu Kao, Prakash Krishnan, Peter Ku, Anuj Goyal, Chien-Wei Lin, Qing Liu, Arindam Mandal, Angeliki Metallinou, Vishal Naik, Yi Pan, Shachi Paul, Vittorio Perera, Abhishek Sethi, Minmin Shen, Nikko Strom, Eddie Wang
| Challenge: | Traditional goal-oriented dialogue systems require annotations which are hard to obtain for every new domain, limiting scalability. |
| Approach: | They propose a data-driven approach to building goal-oriented dialogue systems . they use a seed dialogue simulator to generate annotated conversations instead of collecting annotations . |
| Outcome: | The proposed system improves turn-level action signature prediction accuracy by 50% . the system is scalable, extensible and data efficient . |
AirConcierge: Generating Task-Oriented Dialogue via Efficient Large-Scale Knowledge Retrieval (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing neural task-oriented dialogue systems cannot be encoded by memory networks, such as memory networks. |
| Approach: | They propose an end-to-end trainable text-to SQL guided framework to learn a neural agent that interacts with KBs using the generated SQL queries. |
| Outcome: | The proposed method significantly improves on the AirDialogue dataset, which contains the conversations of customers booking flight tickets from the agent. |
What Should I Ask? Using Conversationally Informative Rewards for Goal-oriented Visual Dialog. (P19-1)
Copied to clipboard
| Challenge: | a new study challenges the ability of artificial agents to engage in goal-oriented conversations . goal-orientated visual dialogue is a challenging task since it requires a strategy and contextual information to achieve a goal. |
| Approach: | They propose a goal-oriented visual dialogue system that combines reinforcement learning with regularized information gain. |
| Outcome: | The proposed system outperforms current state-of-the-art models on the GuessWhat?! dataset. |
CHAI: A CHatbot AI for Task-Oriented Dialogue with Offline Reinforcement Learning (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches to training dialogue agents are supervised learning, but this is prohibitively expensive and time-consuming. |
| Approach: | They propose offline reinforcement learning methods that can be used to train dialogue agents . offline reinforcement learn methods can be combined with language models to yield realistic dialogue agents. |
| Outcome: | The proposed method can be combined with language models to produce realistic dialogue agents . the results show that the offline method can achieve the goal of the proposed system . |
Towards a Progression-Aware Autonomous Dialogue Agent (2022.naacl-main)
Copied to clipboard
| Challenge: | Recent advances in large-scale language modeling and generation have enabled the creation of dialogue agents that exhibit human-like responses in a wide range of conversational scenarios. |
| Approach: | They propose a framework in which dialogue agents can evaluate the progression of a conversation toward or away from desired outcomes and use this signal to inform planning for subsequent responses. |
| Outcome: | The proposed framework evaluates the progression of a conversation toward or away from desired outcomes and uses this signal to inform planning for subsequent responses. |
Situated Dialogue Learning through Procedural Environment Generation (2022.acl-long)
Copied to clipboard
| Challenge: | a key hypothesis in the pursuit towards creating goal-driven natural language-based agents is interactivity and environment grounding is critical for effective language learning. |
| Approach: | They augment LIGHT by learning to procedurally generate additional novel textual worlds and quests to create a curriculum of steadily increasing difficulty for training agents. |
| Outcome: | The authors augment LIGHT by learning to procedurally generate additional novel textual worlds and quests to create a curriculum of increasing difficulty for training agents to achieve such goals. |
Rethinking Supervised Learning and Reinforcement Learning in Task-Oriented Dialogue Systems (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Dialogue policy learning for task-oriented dialogue systems has enjoyed great progress through using reinforcement learning methods. |
| Approach: | They propose a dialogue action decoder and a simulator-free adversarial learning method to improve dialogue agent performance without using reinforcement learning. |
| Outcome: | The proposed methods achieve more stable and higher performance with fewer efforts, such as the domain knowledge required to design a user simulator and the intractable parameter tuning in reinforcement learning. |
HybriDialogue: An Information-Seeking Dialogue Dataset Grounded on Tabular and Textual Data (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing datasets focused on multiturn dialogue systems focus on text or table information. |
| Approach: | They propose a dataset that consists of crowdsourced conversations grounded on Wikipedia text and tables. |
| Outcome: | The proposed dataset shows that there is still ample opportunity for improvement in the current state of dialogue systems. |
Adaptive Natural Language Generation for Task-oriented Dialogue via Reinforcement Learning (2022.coling-1)
Copied to clipboard
| Challenge: | In task-oriented dialogue systems, the role of the natural language generation component is to convert a system's intentions, called dialogue acts (DAs), into natural language utterances and to convey DAs accurately to users. |
| Approach: | They propose a method for Adaptive Natural language generation for Task-Oriented dialogue via Reinforcement learning that incorporates a natural language understanding module into the objective function of RL. |
| Outcome: | The proposed method generates adaptive utterances against speech recognition errors and the different vocabulary levels of users in a multi-world task-oriented dialogue system. |