Semantically Conditioned Dialog Response Generation via Hierarchical Disentangled Self-Attention (P19-1)
Copied to clipboard
| Challenge: | Existing models for limited-domain RNNs are difficult to scale due to the complexity of the inputs. |
| Approach: | They propose to use dialog acts to build a multi-layer hierarchical graph with a disentangled self-attention network. |
| Outcome: | The proposed model improves on the baselines on automatic and human evaluation metrics. |
Similar Papers
Multi-Domain Dialogue Acts and Response Co-Generation (2020.acl-main)
Copied to clipboard
| Challenge: | Existing pipeline approaches for task-oriented dialogue systems tend to predict multiple dialogue acts first and use them to assist response generation. |
| Approach: | They propose a neural co-generation model that generates dialogue acts and responses concurrently and preserves semantic structures of multi-domain dialogue acts. |
| Outcome: | The proposed model improves over state-of-the-art models in automatic and human evaluations on a large-scale dataset. |
Dialog-Post: Multi-Level Self-Supervised Objectives and Hierarchical Model for Dialogue Post-Training (2023.acl-long)
Copied to clipboard
| Challenge: | a new method for dialogue representation and understanding is proposed . pre-trained language models (PLMs) are inappropriate for dialogue understanding tasks . |
| Approach: | They propose a method that trains pre-trained language models to fit dialogues . they use a hierarchical segment-wise self-attention network to model dialogues more comprehensively . |
| Outcome: | The proposed method outperforms existing models and achieves a 3.3% improvement on average. |
Hierarchy Response Learning for Neural Conversation Generation (D19-1)
Copied to clipboard
| Challenge: | Neural conversation generation models can't perceive and express the intention effectively, causing dull and generic responses. |
| Approach: | They propose a hierarchical response generation model to capture conversation intention . they propose an expression reconstruction model and an expression attention model . |
| Outcome: | The proposed model can generate the responses with more appropriate content and expression. |
MultiDM-GCN: Aspect-guided Response Generation in Multi-domain Multi-modal Dialogue System using Graph Convolutional Network (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing research suggests that engaging conversations include visual cues (e.g., a video or images) or audio cue. |
| Approach: | They propose a multi-modal conversational framework that generates the responses following the different aspects of a product or service to cater to the user's needs. |
| Outcome: | The proposed framework outperforms baselines for the task-oriented dialogue setup. |
DIALOGPT : Large-Scale Generative Pre-training for Conversational Response Generation (2020.acl-demos)
Copied to clipboard
Yizhe Zhang, Siqi Sun, Michel Galley, Yen-Chun Chen, Chris Brockett, Xiang Gao, Jianfeng Gao, Jingjing Liu, Bill Dolan
| Challenge: | DIALOGPT is a large, tunable neural conversational response generation model . trained on 147M conversation-like exchanges extracted from Reddit comment chains . |
| Approach: | They present a large, tunable neural conversational response generation model, DIALOGPT . the model is trained on 147M conversation-like exchanges extracted from Reddit comment chains . |
| Outcome: | The proposed model can generate more relevant, contentful and context-consistent responses than baseline systems. |
Dialogue Act Classification with Context-Aware Self-Attention (N19-1)
Copied to clipboard
| Challenge: | Recent work in Dialogue Act classification has treated the task as a sequence labeling problem using hierarchical deep neural networks. |
| Approach: | They propose a hierarchical deep neural network to model different levels of utterance and dialogue act semantics and use contextual dependencies to improve performance. |
| Outcome: | The proposed model improves on the Switchboard Dialogue Act Corpus while maintaining high accuracy. |
LSDSCC: a Large Scale Domain-Specific Conversational Corpus for Response Generation with Diversity Oriented Evaluation Metrics (N18-1)
Copied to clipboard
| Challenge: | Existing evaluation metrics for NRG models can't measure semantic relevance and diversity of generated results. |
| Approach: | They propose a large-scale domain-specific conversational corpus with preprocessing and cleansing procedures for model training and a testing set for measuring the diversity of generated results. |
| Outcome: | The proposed corpus can be taken as a new benchmark dataset for the NRG task. |
Discovering Dialog Structure Graph for Coherent Dialog Generation (2021.acl-long)
Copied to clipboard
| Challenge: | Existing studies on dialog structure graphs from open-domain dialogs have limited number of dialog states and can be laborious and costly to annotate manually. |
| Approach: | They propose to use dialog structure graph as a model to discover hierarchical latent dialog states and their transitions from corpus to facilitate dialog management in a RL based dialog system. |
| Outcome: | The proposed model can discover meaningful dialog structure graph and significantly improve multi-turn coherence on two benchmark corpora. |
Generative Subgraph Retrieval for Knowledge Graph–Grounded Dialog Generation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for knowledge graph–grounded dialog generation fail to leverage the rich knowledge of pretrained language models. |
| Approach: | They propose a method for dialog generation that integrates dialog history with a knowledge graph. |
| Outcome: | The proposed method achieves state-of-the-art in knowledge graph–grounded dialog generation on OpenDialKG and KOMODIS datasets. |
Modelling Context Emotions using Multi-task Learning for Emotion Controlled Dialog Generation (2021.eacl-main)
Copied to clipboard
| Challenge: | Recent research has tackled this task using neural generative methods by augmenting emotion classes with the input sequences. |
| Approach: | They propose to use a self-attention based encoder and a decoder with dot product attention mechanism to generate a viable response with a specified emotion. |
| Outcome: | The proposed model outperforms baselines on automatic evaluation measures such as F1 and BLEU scores, thus resulting in more fluent and adequate responses. |