| Challenge: | Currently, open-domain chatbots are far from satisfactory. |
| Approach: | They propose a unified, readily scalable neural approach which reconciles all subtasks like intent prediction and knowledge retrieval. |
| Outcome: | The proposed approach outperforms commercial systems replying on complex rules on static and interactive tests and shows that the results are remarkably good. |
Similar Papers
Recipes for Building an Open-Domain Chatbot (2021.eacl-main)
Copied to clipboard
Stephen Roller, Emily Dinan, Naman Goyal, Da Ju, Mary Williamson, Yinhan Liu, Jing Xu, Myle Ott, Eric Michael Smith, Y-Lan Boureau, Jason Weston
| Challenge: | Existing work shows that scaling models in the number of parameters and the size of the data they are trained on gives improved results, but other factors are important. |
| Approach: | They propose to build open-domain chatbots that can be scaled to improve their performance . they use a blend of cognitive and cognitive skills to build a model that combines these skills . |
| Outcome: | The proposed models outperform existing approaches in multi-turn dialogue on engagingness and humanness measurements. |
LiveChat: A Large-Scale Personalized Dialogue Dataset Automatically Constructed from Live Streaming (2023.acl-long)
Copied to clipboard
| Challenge: | a recent study shows that open-domain dialogue systems are not able to perform well in fast-growing scenarios such as live streaming due to the domain gap between online-post constructed data and those required in downstream conversational tasks. |
| Approach: | They propose to train a conversational agent based on large social media datasets with multiple domains to improve response in live streaming scenarios. |
| Outcome: | The proposed model improves response modeling and addressee recognition in live open-domain scenarios. |
TicketTalk: Toward human-level performance with end-to-end, transaction-based dialog systems (2021.acl-long)
Copied to clipboard
| Challenge: | TicketTalk dataset with 23,789 annotated dialogs is a data-driven, end-to-end approach to transaction-based dialog systems that performs at near-human levels in terms of verbal response quality and factual grounding accuracy. |
| Approach: | They propose a data-driven, end-to-end approach to transaction-based dialog systems that performs at near-human levels in terms of verbal response quality and factual grounding accuracy. |
| Outcome: | The proposed model generates verbal responses and API call predictions on a movie ticketing dialog dataset with 23,789 annotated conversations. |
Deep Chit-Chat: Deep Learning for ChatBots (D18-3)
Copied to clipboard
| Challenge: | tutorial focuses on building conversational models with deep learning approaches for chatbots. |
| Approach: | This tutorial focuses on building conversational models with deep learning approaches for chatbots. |
| Outcome: | The tutorial summarizes the fundamental challenges in modeling open domain dialogues . it also covers some new trends of research of chatbots - such as how to "control" conversations with specific information . |
Building a Role Specified Open-Domain Dialogue System Leveraging Large-Scale Language Models (2022.naacl-main)
Copied to clipboard
| Challenge: | Recent large-scale language models have produced human-like responses in open-domain dialogue systems. |
| Approach: | They propose a framework for imposing roles on open-domain dialogue systems . they use few-shot learning to build a Korean dialogue dataset from scratch . |
| Outcome: | The proposed framework meets role specifications while maintaining conversational abilities. |
Beyond Goldfish Memory: Long-Term Open-Domain Conversation (2022.acl-long)
Copied to clipboard
| Challenge: | Despite recent improvements in open-domain dialogue models, state of the art models are trained and evaluated on short conversations with little context. |
| Approach: | They propose to use retrieval-augmented methods to summarize and recall past conversations to improve their models. |
| Outcome: | The proposed models outperform the current state-of-the-art models on human-human chat sessions in both automatic and human evaluations. |
Enhancing Chat Language Models by Scaling High-quality Instructional Conversations (2023.emnlp-main)
Copied to clipboard
| Challenge: | a recent study validates the effectiveness of chat language models by fine-tuning instruction data. |
| Approach: | They propose to use a large-scale dataset of instructional conversations to fine-tune a conversational model on instruction data. |
| Outcome: | The proposed model outperforms open-source models in key metrics including scale, average length, diversity, coherence, etc. |
A Corpus of Controlled Opinionated and Knowledgeable Movie Discussions for Training Neural Conversation Models (2020.lrec-1)
Copied to clipboard
| Challenge: | Fully data driven Chatbots suffer from inconsistent behaviour across their turns due to a general difficulty in controlling parameters like their assumed background personality and knowledge of facts. |
| Approach: | They propose a model that is based on pre-specified facts and opinions and validates the dialogues for adherence to their given fact and opinion profile. |
| Outcome: | The proposed model is able to generate opinionated responses that are judged to be natural and knowledgeable and show attentiveness. |
Towards Boosting the Open-Domain Chatbot with Human Feedback (2023.acl-long)
Copied to clipboard
| Challenge: | Existing frameworks for pre-training open-domain dialogue models with social media comments generate coherent replies but have difficulties producing engaging responses. |
| Approach: | They propose a framework to boost the open-domain chatbot by leveraging human feedback and annotating the model's candidate responses. |
| Outcome: | The proposed framework boosts the open-domain chatbot by leveraging human demonstrated responses and leveraging the implicit preference in the data collection process. |
Prompted LLMs as Chatbot Modules for Long Open-domain Conversation (2023.findings-acl)
Copied to clipboard
| Challenge: | Using pre-trained large language models (LLMs) as individual modules for long-term consistency and flexibility is a challenge for open-domain chatbots due to the computational burden of updating models with billions of parameters and the scarcity of data in the dialogue domain. |
| Approach: | They propose a method that uses pre-trained large language models as individual modules for long-term consistency and flexibility. |
| Outcome: | The proposed method is on par with fine-tuned chatbot models in open-domain conversations, showing it can create consistent and engaging chatbots. |