Dual Hierarchical Dialogue Policy Learning for Legal Inquisitive Conversational Agents (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing systems for conversational AI are user-driven, but in many real-world situations, they do not extract information to achieve its own objectives. |
| Approach: | They propose an inquisitive conversational agent that learns when and how to ask probing questions . they also propose a framework for a conversational ICA specifically tailored to the court . |
| Outcome: | The proposed method outperforms single-agent RL baselines on a U.S. Supreme Court dataset. |
Similar Papers
Deep Reinforcement Learning with Hierarchical Action Exploration for Dialogue Generation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing approaches to improve dialogues with random sampling are inefficient due to the large number of eligible responses with high action values. |
| Approach: | They propose a dual-granularity Q-function that extracts actions based on a grained hierarchy . they use offline RL and learn from multiple reward functions designed to capture emotional nuances in human interactions. |
| Outcome: | The proposed approach outperforms baselines across automatic metrics and human evaluations. |
Rethinking Supervised Learning and Reinforcement Learning in Task-Oriented Dialogue Systems (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Dialogue policy learning for task-oriented dialogue systems has enjoyed great progress through using reinforcement learning methods. |
| Approach: | They propose a dialogue action decoder and a simulator-free adversarial learning method to improve dialogue agent performance without using reinforcement learning. |
| Outcome: | The proposed methods achieve more stable and higher performance with fewer efforts, such as the domain knowledge required to design a user simulator and the intractable parameter tuning in reinforcement learning. |
Agentic Conversational Search with Contextualized Reasoning via Reinforcement Learning (2026.findings-acl)
Copied to clipboard
Fengran Mo, Yifan Gao, Sha Li, Hansi Zeng, Xin Liu, Zhaoxuan Tan, Xian Li, Jianshu Chen, Dakuo Wang, Meng Jiang
| Challenge: | Existing studies focus on single-turn scenarios, which might lack the ability to handle multi-turn interactions. |
| Approach: | They propose a conversational agent that interleaves search and reasoning across turns and provides tailored rewards towards evolving user goals. |
| Outcome: | The proposed agent interleaves search and reasoning across turns, enabling exploratory and adaptive behaviors learned through reinforcement learning (RL) training with tailored rewards towards evolving user goals. |
Feudal Reinforcement Learning for Dialogue Management in Large Domains (N18-2)
Copied to clipboard
Iñigo Casanueva, Paweł Budzianowski, Pei-Hao Su, Stefan Ultes, Lina M. Rojas-Barahona, Bo-Hsiang Tseng, Milica Gašić
| Challenge: | Reinforcement learning (RL) is a promising approach to model dialogue policy optimisation but fails to scale to large domains due to the curse of dimensionality. |
| Approach: | They propose a novel approach to dialogue policy optimisation using reinforcement learning . they propose to decompose the decision into two steps using a domain ontology . |
| Outcome: | The proposed architecture outperforms state-of-the-art in several dialogue domains without any additional reward signal. |
Deep Dyna-Q: Integrating Planning for Task-Completion Dialogue Policy Learning (P18-1)
Copied to clipboard
| Challenge: | Training a task-completion dialogue agent via reinforcement learning (RL) is costly because it requires many interactions with real users. |
| Approach: | They propose a framework that integrates planning for task-completion dialogue policy learning into a dialogue agent using a world model to mimic real user response and generate simulated experience. |
| Outcome: | The proposed framework integrates planning for task-completion dialogue policy learning with real user interaction and simulated user behavior. |
Multi-Agent Task-Oriented Dialog Policy Learning with Role-Aware Reward Decomposition (2020.acl-main)
Copied to clipboard
| Challenge: | Many studies have applied reinforcement learning to train a dialog policy . but modeling a real-world user simulator is challenging and requires domain expertise . |
| Approach: | They propose to build dialog policies with two agents as dialog agents to avoid building a user simulator beforehand. |
| Outcome: | The proposed method can build a system policy and a user policy simultaneously . it can achieve high task success rate through conversational interaction . |
Efficient Dialogue Complementary Policy Learning via Deep Q-network Policy and Episodic Memory Policy (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for training dialogue policies rely on a single learning system, but it requires many rounds of interaction. |
| Approach: | They propose a complementary policy learning framework which exploits the complementary advantages of the episodic memory (EM) policy and the deep Q-network (DQN) policy. |
| Outcome: | The proposed framework outperforms existing methods relying on a single learning system on three dialogue datasets. |
From Query to Counsel: Structured Reasoning with a Multi-Agent Framework and Dataset for Legal Consultation (2026.acl-long)
Copied to clipboard
| Challenge: | Legal consultation question answering presents unique challenges compared to traditional legal QA tasks . |
| Approach: | They propose a framework that converts queries into a legal element graph . jurisMA supports dynamic routing, statutory grounding, and stylistic optimization . |
| Outcome: | The proposed framework outperforms general-purpose and legal-domain LLMs across multiple lexical and semantic metrics. |
Deep Reinforcement Learning-based Dialogue Policy with Graph Convolutional Q-network (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for deep reinforcement learning lack the ability to learn the relationship between dialogue states and actions. |
| Approach: | They propose a graph-structured dialogue policy framework for task-oriented dialogue systems that uses bipartite graphs to construct two different bipartites and generate user-related and knowledge-related subgraphs. |
| Outcome: | The proposed framework significantly improves the effectiveness and stability of dialogue policies. |
Gaussian Process based Deep Dyna-Q approach for Dialogue Policy Learning (2021.findings-acl)
Copied to clipboard
| Challenge: | Reinforcement learning (RL) is the main dialogue policy learning method in recent years. |
| Approach: | They propose a Gaussian Process based Deep Dyna-Q approach to dialogue policy learning . they propose evaluating the quality of experiences generated by the world model using a discriminator . |
| Outcome: | The proposed approach improves the effectiveness and efficiency of dialogue policy learning by 20% with fewer human-machine interactions. |