Using Domain Knowledge to Guide Dialog Structure Induction via Neural Probabilistic Soft Logic

Challenge:	Existing DSI approaches infer latent dialog structure without access to domain knowledge.
Approach:	They propose a neural-symbolic approach that injects symbolic knowledge into latent space of a generative neural model.
Outcome:	The proposed approach boosts performance over the canonical baselines over three dialog structure induction datasets.

Similar Papers

Overview

Challenge

Approach

Outcome

Discovering Dialog Structure Graph for Coherent Dialog Generation (2021.acl-long)

Copied to clipboard

Jun Xu, Zeyang Lei, Haifeng Wang, Zheng-Yu Niu, Hua Wu, Wanxiang Che

Dialogue Systems & Conversational Agents

Challenge:	Existing studies on dialog structure graphs from open-domain dialogs have limited number of dialog states and can be laborious and costly to annotate manually.
Approach:	They propose to use dialog structure graph as a model to discover hierarchical latent dialog states and their transitions from corpus to facilitate dialog management in a RL based dialog system.
Outcome:	The proposed model can discover meaningful dialog structure graph and significantly improve multi-turn coherence on two benchmark corpora.

Unsupervised Dialog Structure Learning (N19-1)

Copied to clipboard

Weiyan Shi, Tiancheng Zhao, Zhou Yu

Dialogue Systems & Conversational Agents

Challenge:	Current dialog systems require human experts to design the dialog structure, which is time consuming and sometimes insufficient to satisfy various customer needs.
Approach:	They propose to extract dialog structure using a modified VRNN model with discrete latent vectors.
Outcome:	The proposed model outperforms existing models on the ability to predict unseen data and is faster and more effective in a reinforcement learning setting.

Unsupervised Slot Schema Induction for Task-oriented Dialog (2022.naacl-main)

Copied to clipboard

Dian Yu, Mingqiu Wang, Yuan Cao, Izhak Shafran, Laurent Shafey, Hagen Soltau

Dialogue Systems & Conversational Agents

Challenge:	Defining task-specific schemas is the first step of building a task-oriented dialog system.
Approach:	They propose an unsupervised approach for slot schema induction from unlabeled dialog corpora using in-domain language models and unsupervised parsing structures.
Outcome:	The proposed method shows significant performance improvement on multi-domain and SGD datasets.

SynthDST: Synthetic Data is All You Need for Few-Shot Dialog State Tracking (2024.eacl-long)

Copied to clipboard

Atharva Kulkarni, Bo-Hsiang Tseng, Joel Moniz, Dhivya Piraviperumal, Hong Yu, Shruti Bhargava

Low-Resource NLP

Challenge:	In-context learning with Large Language Models (LLMs) is a promising avenue of research in Dialog State Tracking (DST).
Approach:	They propose a data generation framework tailored for Dialog State Tracking that uses large language models to synthesize natural, coherent, and free-flowing dialogues with DST annotations.
Outcome:	The proposed framework improves joint goal accuracy by 4-5% over the zero-shot baseline on MultiWOZ 2.1 and 2.4.

DS-TOD: Efficient Domain Specialization for Task-Oriented Dialog (2022.findings-acl)

Copied to clipboard

Chia-Chien Hung, Anne Lauscher, Simone Ponzetto, Goran Glavaš

Language Models

Challenge:	Recent work shows that self-supervised dialog-specific pretraining on large conversational datasets yields substantial gains over traditional language modeling (LM) pretraining.
Approach:	They propose a resource-efficient and modular domain specialization by means of domain adapters in which domain knowledge is encoded.
Outcome:	The proposed framework extracts domain-specific terms and then uses them to build DomainCC and DomainReddit resources based on masked language modeling and response selection objectives.

Dynamic Fusion Network for Multi-Domain End-to-end Task-Oriented Dialog (2020.acl-main)

Copied to clipboard

Libo Qin, Xiao Xu, Wanxiang Che, Yue Zhang, Ting Liu

Dialogue Systems & Conversational Agents

Challenge:	Recent studies show remarkable success in end-to-end task-oriented dialog systems . however, most models rely on large training data, which is difficult to scalable for new domains with limited labeled data.
Approach:	They propose a shared-private network which exploits the relevance between the target domain and each domain.
Outcome:	The proposed model outperforms existing methods on multi-domain dialogue by 13.9% on average.

DialogVED: A Pre-trained Latent Variable Encoder-Decoder Model for Dialog Response Generation (2022.acl-long)

Copied to clipboard

Wei Chen, Yeyun Gong, Song Wang, Bolun Yao, Weizhen Qi, Zhongyu Wei, Xiaowu Hu, Bartuer Zhou, Yi Mao, Weizhu Chen, Biao Cheng, Nan Duan

Dialogue Systems & Conversational Agents

Challenge:	Existing pre-trained dialog models shed light on various downstream tasks in natural language processing (NLP).
Approach:	They propose a dialog pre-training framework that introduces latent variables into the enhanced encoder-decoder pre-train framework to increase relevance and diversity of responses.
Outcome:	The proposed model achieves state-of-the-art on personaChat, DailyDialog, and DSTC7-AVSD datasets.

Towards a Zero-Data, Controllable, Adaptive Dialog System (2024.lrec-main)

Copied to clipboard

Dirk Väth, Lindsey Vanderlyn, Ngoc Thang Vu

Dialogue Systems & Conversational Agents

Challenge:	Recent approaches to controllable dialog systems require additional training data to be deployed in new domains.
Approach:	They propose to generate dialog tree data directly from dialog trees by using a commercial Large Language Model or a single GPU.
Outcome:	The proposed approach can achieve comparable dialog success to models trained on human data.

Do Neural Dialog Systems Use the Conversation History Effectively? An Empirical Study (P19-1)

Copied to clipboard

Chinnadhurai Sankar, Sandeep Subramanian, Chris Pal, Sarath Chandar, Yoshua Bengio

Dialogue Systems & Conversational Agents

Challenge:	Neural generative models are becoming more popular when building conversational agents.
Approach:	They propose to study the sensitivity of neural dialog models to unnatural perturbations . they experiment with 10 different types of perturbations on 4 multi-turn dialog datasets .
Outcome:	The proposed model is sensitive to unnatural changes or perturbations on 4 multi-turn dialog datasets.

Unsupervised Discrete Sentence Representation Learning for Interpretable Neural Dialog Generation (P18-1)

Copied to clipboard

Tiancheng Zhao, Kyusong Lee, Maxine Eskenazi

Semantic Text Processing

Challenge:	Existing encoder-decoder dialog models cannot output interpretable actions as in traditional systems.
Approach:	They propose an unsupervised discrete sentence representation learning method that integrates with existing encoder-decoder dialog models for interpretable response generation.
Outcome:	The proposed model can be integrated with existing encoder-decoder dialog models and discover interpretable semantics via either auto encoding or context predicting.