Dialog-Post: Multi-Level Self-Supervised Objectives and Hierarchical Model for Dialogue Post-Training (2023.acl-long)
Copied to clipboard
| Challenge: | a new method for dialogue representation and understanding is proposed . pre-trained language models (PLMs) are inappropriate for dialogue understanding tasks . |
| Approach: | They propose a method that trains pre-trained language models to fit dialogues . they use a hierarchical segment-wise self-attention network to model dialogues more comprehensively . |
| Outcome: | The proposed method outperforms existing models and achieves a 3.3% improvement on average. |
Similar Papers
Unsupervised Learning of Hierarchical Conversation Structure (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Goal-oriented conversations often have sub-dialogue structure, but it can be domain-dependent . Increasingly, language understanding applications involve conversational speech and text . |
| Approach: | They propose an unsupervised approach to learning hierarchical conversation structure . they use turn and sub-dialogue segment labels to decode the structure based on dialogue acts and subtasks . |
| Outcome: | The proposed approach improves neural models for three conversation-level understanding tasks. |
Dialogue Act Classification with Context-Aware Self-Attention (N19-1)
Copied to clipboard
| Challenge: | Recent work in Dialogue Act classification has treated the task as a sequence labeling problem using hierarchical deep neural networks. |
| Approach: | They propose a hierarchical deep neural network to model different levels of utterance and dialogue act semantics and use contextual dependencies to improve performance. |
| Outcome: | The proposed model improves on the Switchboard Dialogue Act Corpus while maintaining high accuracy. |
Semantically Conditioned Dialog Response Generation via Hierarchical Disentangled Self-Attention (P19-1)
Copied to clipboard
| Challenge: | Existing models for limited-domain RNNs are difficult to scale due to the complexity of the inputs. |
| Approach: | They propose to use dialog acts to build a multi-layer hierarchical graph with a disentangled self-attention network. |
| Outcome: | The proposed model improves on the baselines on automatic and human evaluation metrics. |
Reading Turn by Turn: Hierarchical Attention Architecture for Spoken Dialogue Comprehension (P19-1)
Copied to clipboard
| Challenge: | Existing research on multi-turn spoken conversations focuses on reading comprehension of passages . interactivity of spoken content can cause lower information density and topic diffusion . |
| Approach: | They propose a hierarchical attention neural network architecture to improve spoken dialogue comprehension by combining turn-level and word-level attention mechanisms. |
| Outcome: | The proposed approach outperforms baseline attention models and is robust to lengthy and out-of-distribution test samples. |
A Contextual Hierarchical Attention Network with Adaptive Objective for Dialogue State Tracking (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for dialogue state tracking ignore the slot imbalance problem and treat all slots indiscriminately, which limits the learning of hard slots. |
| Approach: | They propose to employ a contextual hierarchical attention network to enhance the DST by learning contextual representations. |
| Outcome: | The proposed approach achieves 52.68% and 58.55% joint accuracy on multiWOZ 2.0 and MultiWOZ 2.1 datasets and significantly improves performance (+1.24% and +5.98%) |
Hierarchical Transformer for Task Oriented Dialog Systems (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing models for dialog generation are challenging to train using the standard Seq2Seq models. |
| Approach: | They propose a framework for Hierarchical Transformer Encoders that can be morphed into any hierarchical transformer by using specially designed attention masks and positional encodings. |
| Outcome: | The proposed framework can be morphed into any hierarchical encoder, including HRED and HIBERT like models, by using specially designed attention masks and positional encodings. |
A Multi-Dimensional, Cross-Domain and Hierarchy-Aware Neural Architecture for ISO-Standard Dialogue Act Tagging (2022.coling-1)
Copied to clipboard
| Challenge: | Dialogue Act tagging with ISO 24617-2 standard is a difficult task that requires multiple labels covering semantic, syntactic and pragmatic aspects of dialogue. |
| Approach: | They propose a neural architecture to increase Dialogue Act tagging accuracy by using low-frequency fine-grained tags. |
| Outcome: | The proposed model achieves state-of-the-art tagging results on DialogBank data set . it uses syntactic information in the form of Part-Of-Speech and dependency tags . |
Dialog Intent Structure: A Hierarchical Schema of Linked Dialog Acts (L18-1)
Copied to clipboard
| Challenge: | a schema for dialog representation captures the pragmatic intents of the conversation independently from any semantic representation. |
| Approach: | They propose a hierarchical and extensible schema for dialog representation . schema captures pragmatic intents of conversation independently from any semantic representation based on semantic content . |
| Outcome: | The proposed schema captures the pragmatic intents of the conversation independently from any semantic representation. |
Task-Aware Self-Supervised Framework for Dialogue Discourse Parsing (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing discourse parsing approaches are constrained by predefined relation types, which can impede the adaptability of the parser for downstream tasks. |
| Approach: | They propose to introduce a task-aware paradigm to improve the versatility of the parser. |
| Outcome: | Empirical studies on dialogue discourse parsing datasets and a downstream task demonstrate the proposed framework. |
Deep Learning for Dialogue Systems (C18-3)
Copied to clipboard
| Challenge: | Using deep learning to build robust and scalable spoken dialogue systems is still a challenging task. |
| Approach: | tutorial focuses on an overview of dialogue system development . goal-oriented spoken dialogue systems are most prominent component in virtual personal assistants . |
| Outcome: | This tutorial focuses on an overview of dialogue system development while summarizing the challenges. |