| Challenge: | Existing dialogue systems have failed to capture the order of utterances in coherent dialogues. |
| Approach: | They propose a self-supervised learning task to capture the flow of dialogues . they propose 'inconsistent order detection' task to predict whether utterance is ordered or misordered . |
| Outcome: | The proposed methods can be applied to open-domain and task-oriented dialogue scenarios and achieve state-of-the-art performance on the OpenSubtitiles and Movie-Ticket Booking datasets. |
Similar Papers
Dialogue Act Classification with Context-Aware Self-Attention (N19-1)
Copied to clipboard
| Challenge: | Recent work in Dialogue Act classification has treated the task as a sequence labeling problem using hierarchical deep neural networks. |
| Approach: | They propose a hierarchical deep neural network to model different levels of utterance and dialogue act semantics and use contextual dependencies to improve performance. |
| Outcome: | The proposed model improves on the Switchboard Dialogue Act Corpus while maintaining high accuracy. |
Learning Dialogue Representations from Consecutive Utterances (2022.naacl-main)
Copied to clipboard
| Challenge: | Dialogue Sentence Embedding (DSE) is a self-supervised contrastive learning method that learns effective dialogue representations suitable for a wide range of dialogue-oriented tasks. |
| Approach: | They propose a self-supervised contrastive learning method that learns dialogue representations suitable for a wide range of dialogue tasks. |
| Outcome: | The proposed method outperforms baselines on five dialogue tasks on a few-shot and zero-shot datasets. |
Rethinking Supervised Learning and Reinforcement Learning in Task-Oriented Dialogue Systems (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Dialogue policy learning for task-oriented dialogue systems has enjoyed great progress through using reinforcement learning methods. |
| Approach: | They propose a dialogue action decoder and a simulator-free adversarial learning method to improve dialogue agent performance without using reinforcement learning. |
| Outcome: | The proposed methods achieve more stable and higher performance with fewer efforts, such as the domain knowledge required to design a user simulator and the intractable parameter tuning in reinforcement learning. |
Self- and Pseudo-self-supervised Prediction of Speaker and Key-utterance for Multi-party Dialogue Reading Comprehension (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models for multi-party dialogue machine reading comprehension focus on how to incorporate speaker information into the model, which is usually rare in real scenarios. |
| Approach: | They propose to model speaker and key-utterances using self-supervised prediction tasks and capture salient clues in a long dialogue. |
| Outcome: | The proposed method outperforms baseline models and state-of-the-art models on two benchmark datasets. |
Towards Robust Personalized Dialogue Generation via Order-Insensitive Representation Regularization (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have focused on developing persona consistent dialogue models . order sensitivity affects the quality and consistency of generated response . |
| Approach: | They propose a model-agnostic framework to improve persona consistent dialogue response generation by concatenating persona texts and dialogue history as a single input sequence. |
| Outcome: | The proposed framework outperforms existing models on the Persona-Chat dataset and shows that it is more robust under different persona orders and more consistent with the persona profile. |
A Semi-Supervised Stable Variational Network for Promoting Replier-Consistency in Dialogue Generation (D19-1)
Copied to clipboard
| Challenge: | Existing methods favor uninformative and non replier-specific responses due to lack of relevant information guidance. |
| Approach: | They propose to use a semi-supervised variable network to generate replier-specific responses . they use vMF as latent space to obtain stable KL performance . |
| Outcome: | The proposed model outperforms baseline models on two large conversation datasets and generates diverse and replier-specific responses. |
SelF-Eval: Self-supervised Fine-grained Dialogue Evaluation (2022.coling-1)
Copied to clipboard
| Challenge: | Existing evaluation metrics are expensive and easy to conduct but ineffective to reflect dialogue quality. |
| Approach: | They propose a self-supervised fine-grained dialogue evaluation framework which can automatically assign fine-granular scores for arbitrarily dialogue data. |
| Outcome: | The proposed framework is highly consistent with human evaluations and better than the state-of-the-art models. |
Improving Abstractive Dialogue Summarization with Speaker-Aware Supervised Contrastive Learning (2022.coling-1)
Copied to clipboard
| Challenge: | Existing summarization systems based on pre-trained models cannot recognize the unique format of the speaker-utterance pair well in the dialogue. |
| Approach: | They propose three speaker-aware supervised contrastive learning tasks to solve the speaker identification problem in dialogue summarization task. |
| Outcome: | The proposed methods improve on two mainstream dialogue summarization datasets. |
Enhancing the Open-Domain Dialogue Evaluation in Latent Space (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to evaluate opendomain dialogues are limited due to the one-to-many nature of dialogues. |
| Approach: | They propose a self-supervised setting to obtain a smooth latent space that captures discourse-level context information and implicitly models more references in latent spaces. |
| Outcome: | The proposed method outperforms baseline methods on two real-world dialogue datasets. |
Group-wise Contrastive Learning for Neural Dialogue Generation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to training dialogue models have low diversity in open-domain contexts . prior art suggests that naive MLE objective is not effective enough . |
| Approach: | They propose to incorporate contrastive learning into dialogue generation by using a pretrained baseline model as a reference. |
| Outcome: | The proposed framework is suited for training a wide range of dialogue generation models with favorable performance over baseline training approaches. |