Recommendation as a Communication Game: Self-Supervised Bot-Play for Goal-oriented Dialogue (D19-1)
Copied to clipboard
| Challenge: | Traditional recommendation systems produce static rather than interactive recommendations invariant to a user’s specific requests, clarifications, or current mood. |
| Approach: | They use a goal-driven recommendation dialogue dataset to develop an end-to-end dialogue system that can simultaneously converse and recommend. |
| Outcome: | The proposed system can converse and recommend movies to humans without considering the task goal itself. |
Similar Papers
Dialogue in the Wild: Learning from a Deployed Role-Playing Game with Humans and Bots (2021.findings-acl)
Copied to clipboard
| Challenge: | prevailing paradigm in natural language processing research is to build a fixed dataset and freeze it, without any ability for the model to interact with humans using language at training time at all. |
| Approach: | They build and deploy a role-playing game where players converse with learning agents situated in an open-domain fantasy world. |
| Outcome: | The proposed game enables human players to learn from human conversations and improves on their models. |
Rethinking Supervised Learning and Reinforcement Learning in Task-Oriented Dialogue Systems (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Dialogue policy learning for task-oriented dialogue systems has enjoyed great progress through using reinforcement learning methods. |
| Approach: | They propose a dialogue action decoder and a simulator-free adversarial learning method to improve dialogue agent performance without using reinforcement learning. |
| Outcome: | The proposed methods achieve more stable and higher performance with fewer efforts, such as the domain knowledge required to design a user simulator and the intractable parameter tuning in reinforcement learning. |
Towards Conversational Recommendation over Multi-Type Dialogs (2020.acl-main)
Copied to clipboard
| Challenge: | In recent years, there has been a significant increase in the work of conversational recommendation due to the rise of voice-based bots. |
| Approach: | They use a Chinese dialog dataset DuRecDial to study conversational recommendation in the context of multi-type dialogs where bots can proactively lead a conversation from a non-recommendation dialog to a recommendation dialog. |
| Outcome: | The proposed dataset allows to investigate different parts of the overall problem, e.g., how to naturally lead a dialog, how interact with users for recommendation. |
Zero-Shot Prompting for Implicit Intent Prediction and Recommendation with Commonsense Reasoning (2023.findings-acl)
Copied to clipboard
| Challenge: | Currently, intelligent assistants require explicit user requests to perform tasks or services, leading to lengthy and complex conversations. |
| Approach: | They propose a framework that automatically infers implicit intents from user utterances and prompts a large pre-trained language model to suggest suitable task-oriented bots. |
| Outcome: | The proposed framework reduces interaction complexity and integrates domains and tasks. |
ProMISe: A Proactive Multi-turn Dialogue Dataset for Information-seeking Intent Resolution (2024.findings-eacl)
Copied to clipboard
| Challenge: | Work done during internship at Amazon Alexa AI. |
| Approach: | They propose to use iterative suggested question-answering conversation to improve the trade-off between satisfaction of the user’s intent and keeping the information exchange natural. |
| Outcome: | The proposed proposed question-answering conversation improves the satisfaction of the user’s intent while keeping the information exchange natural and cognitive load of the interaction minimal on the users. |
AirDialogue: An Environment for Goal-Oriented Dialogue Research (D18-1)
Copied to clipboard
| Challenge: | Recent advances in dialogue generation have inspired a number of studies on dialogue systems . however, current datasets are limited in size and the environment for training agents is relatively unsophisticated. |
| Approach: | They propose to use a context-generator to generate travel and flight restrictions to train agents. |
| Outcome: | The proposed model achieves a score of 0.17 while humans can reach 0.91 . the proposed model is based on a large dataset that contains 301,427 goal-oriented conversations . |
Bootstrapping a Neural Conversational Agent with Dialogue Self-Play, Crowdsourcing and On-Line Reinforcement Learning (N18-3)
Copied to clipboard
| Challenge: | End-to-end neural models for conversational agents require large corpus of dialogues to learn effectively. |
| Approach: | They propose a method for building an agent for arbitrary tasks by combining dialogue self-play and crowd-sourcing. |
| Outcome: | The proposed approach can be quickly bootstrapped to deploy in front of users and further optimized via interactive learning from actual users. |
Looking for Confirmations: An Effective and Human-Like Visual Dialogue Strategy (2021.emnlp-main)
Copied to clipboard
| Challenge: | State-of-the-art systems generate questions that sound unnatural to humans and are grammatically correct. |
| Approach: | They propose to use beam search re-ranking to generate a model that guides an effective goal-oriented strategy by asking questions that confirm the model’s conjecture about the referent. |
| Outcome: | The proposed model is more natural and effective than beam search decoding without re-ranking on the GuessWhat?! game. |
Learn What Is Possible, Then Choose What Is Best: Disentangling One-To-Many Relations in Language Through Text-based Games (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Language models pre-trained on large self-supervised corpora, followed by task-specific fine-tuning has become the dominant paradigm in NLP. |
| Approach: | They propose to train language models pre-trained on large self-supervised corpora, followed by task-specific fine-tuning on the target domain. |
| Outcome: | The proposed model improves on the previous state-of-the-art model on the Jericho Walkthroughs dataset by 49%. |
Toward Safe and Human-Aligned Game Conversational Recommendation via Multi-Agent Decomposition (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing systems for conversational recommender systems (CRS) have strong results in movies, but games present distinct challenges . MATCHA framework provides specialized agents for intent parsing, tool-augmented retrieval, multi-LLM ranking, and stronger safety. |
| Approach: | They propose a framework for conversational recommender systems that assigns specialized agents for intent parsing, tool-augmented retrieval, multi-LLM ranking and risk control. |
| Outcome: | MATCHA outperforms baselines on real user request dataset, improves Hit@5 by 20%, reduces popularity bias by 24%, and achieves 97.9% adversarial defense. |