Challenge: Existing research on taskoriented dialog systems mainly includes pipeline and end-to-end methods due to its non-differentiable nature.
Approach: They propose a multi-level reward modeling approach that factorizes a reward into a three-level hierarchy: domain, act, and slot.
Outcome: The proposed approach significantly improves performance and speed of training in a wide range of dialog systems.

Similar Papers

Guided Dialog Policy Learning: Reward Estimation for Multi-Domain Task-Oriented Dialog (D19-1)

Copied to clipboard

Challenge: Existing methods to learn dialog policy require elaborate design and user goals.
Approach: They propose an algorithm that estimates the reward signal and infers the user goal in dialog sessions.
Outcome: The proposed algorithm achieves higher task success than state-of-the-art models on a multi-domain task-oriented dialog dataset.
Rewarding What Matters: Step-by-Step Reinforcement Learning for Task-Oriented Dialogue (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing RL methods focus on generation tasks while neglecting dialogue state tracking (DST) for understanding.
Approach: They propose a method that integrates RL into both understanding and generation tasks by introducing step-by-step rewards throughout the token generation.
Outcome: The proposed approach achieves state-of-the-art results on three widely used datasets.
Human-centric dialog training via offline reinforcement learning (2020.emnlp-main)

Copied to clipboard

Challenge: a novel offline RL method can train dialog models to produce better conversations without the risk of humans teaching it harmful chat behaviors.
Approach: They develop offline reinforcement learning algorithms that use human feedback to train dialog models . they use language similarity, laughter, sentiment, and more to identify positive feedback .
Outcome: The proposed method improves on existing methods with 80 users in an open-domain setting.
Dual-Axis Generative Reward Model Toward Semantic and Turn-taking Robustness in Interactive Spoken Dialogue Models (2026.acl-long)

Copied to clipboard

Challenge: Reinforcement learning (RL) has improved text- and vision-language models, but its application in SDMs is hindered.
Approach: They propose a dual-axis Generative Reward Model that provides semantic quality and interaction timing for SDMs.
Outcome: The proposed model achieves state-of-the-art performance on interaction-quality assessment across a wide spectrum of datasets.
Phrase-Level Action Reinforcement Learning for Neural Dialog Response Generation (2021.findings-acl)

Copied to clipboard

Challenge: Existing methods for dialog agent training lack a robust action space for entangled information, which can cause bias and deviate from natural human language.
Approach: They propose phrase-level action reinforcement learning which allows the model to alter the sentence structure and content with the sequential action selection.
Outcome: The proposed model achieves competitive results with state-of-the-art models on the MultiWOZ dataset, indicating that it is effective for solving task-oriented dialogs.
Building Task-Oriented Visual Dialog Systems Through Alternative Optimization Between Dialog Policy and Language Generation (D19-1)

Copied to clipboard

Challenge: Current approaches to visual dialog learning involve an end-to-end framework that maps the multi-modal context to a deep vector and in order to decode a natural dialog response.
Approach: They propose a framework that trains a RL policy for image guessing and a seq2seq model to improve dialog quality.
Outcome: The proposed framework achieves state-of-the-art performance on a guessWhich task . it can be applied to a wide range of tasks including assisting blind people .
Optimizing Conversational Quality in Spoken Dialogue Systems with Reinforcement Learning from AI Feedback (2026.findings-acl)

Copied to clipboard

Challenge: Existing studies on reinforcement learning from human or AI feedback have focused on semantic rewards at the utterance level.
Approach: They propose a multi-reward RLAIF framework for speech-in/speech-out dialogue systems . they combine semantic, audio-quality, and emotion-consistency rewards .
Outcome: The proposed framework improves speech-in/speech-out dialogue system quality . it combines semantic, audio-quality, and emotion-consistency rewards . the proposed framework is available to download from the cdc.
Multi-Agent Task-Oriented Dialog Policy Learning with Role-Aware Reward Decomposition (2020.acl-main)

Copied to clipboard

Challenge: Many studies have applied reinforcement learning to train a dialog policy . but modeling a real-world user simulator is challenging and requires domain expertise .
Approach: They propose to build dialog policies with two agents as dialog agents to avoid building a user simulator beforehand.
Outcome: The proposed method can build a system policy and a user policy simultaneously . it can achieve high task success rate through conversational interaction .
How Helpful is Inverse Reinforcement Learning for Table-to-Text Generation? (2021.acl-short)

Copied to clipboard

Challenge: Existing approaches to Table-to-Text generation suffer from issues such as missing information, repetition and repetition.
Approach: They propose to use Inverse Reinforcement Learning (IRL) to solve the Table-to-Text task . they use multiple interpretable unsupervised reward components that are combined linearly to form a composite reward function.
Outcome: The proposed task outperforms strong RL baselines marginally in the Table-to-Text task.
A Collaborative Multi-agent Reinforcement Learning Framework for Dialog Action Decomposition (2021.emnlp-main)

Copied to clipboard

Challenge: Currently, most reinforcement learning methods for dialog policy learning train a centralized agent that selects a predefined joint action concatenating domain name, intent type, and slot name.
Approach: They propose a hierarchical multi-agent framework in which each part of the action is led by a different agent and a joint optimization process that makes agents can exchange their policy information.
Outcome: The proposed framework reduces labor costs for action templates and decreases the size of the action space for each agent.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations