MIDAS: A Dialog Act Annotation Scheme for Open Domain HumanMachine Spoken Conversations (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing dialog act schemes are designed for human-human conversations, but are not suitable for automatic speech recognition. |
| Approach: | They propose a dialog act annotation scheme for open-domain human-machine conversations . they collected 24K utterances from a large open- domain spoken conversation dataset . |
| Outcome: | The proposed scheme achieves an F1 score of 0.79 on a 24K spoken conversation dataset. |
Similar Papers
LIDA: Lightweight Interactive Dialogue Annotator (D19-3)
Copied to clipboard
| Challenge: | Dialogue systems are dependent on the quality of the data used to train them. |
| Approach: | They propose to develop an annotation tool specifically for conversation data that handles the entire dialogue annotation pipeline from raw text to structured conversation data. |
| Outcome: | The proposed tool handles the entire dialogue annotation pipeline from raw text to structured conversation data and has a dedicated interface to resolve inter-annotator disagreements. |
The ADELE Corpus of Dyadic Social Text Conversations:Dialog Act Annotation with ISO 24617-2 (L18-1)
Copied to clipboard
Emer Gilmartin, Christian Saam, Brendan Spillane, Maria O’Reilly, Ketong Su, Arturo Calvo, Loredana Cerrato, Killian Levacher, Nick Campbell, Vincent Wade
| Challenge: | Recent studies have focused on task-based or instrumental dialogs, but there is increasing interest in social or interactional dialogs. |
| Approach: | They describe a corpus of 193 dyadic text dialogs based on a novel 'getting to know you' social dialog elicitation paradigm and propose additional acts to better cover greeting and leavetaking. |
| Outcome: | The proposed actions cover greeting and leavetaking, and the proposed acts improve the interaction between the dialogs and spoken language. |
ISO-Standard Domain-Independent Dialogue Act Tagging for Conversational Agents (C18-1)
Copied to clipboard
| Challenge: | Existing methods for DA annotation are incompatible with each other and do not cover all aspects necessary for open-domain human-machine interaction. |
| Approach: | They propose to map publicly available corpora to a subset of the ISO standard and create a task-independent training corpus for DA classification. |
| Outcome: | The proposed method can train a domain-independent DA tagger on out-of-domain conversational data and achieve robustness across different DA categories. |
TicketTalk: Toward human-level performance with end-to-end, transaction-based dialog systems (2021.acl-long)
Copied to clipboard
| Challenge: | TicketTalk dataset with 23,789 annotated dialogs is a data-driven, end-to-end approach to transaction-based dialog systems that performs at near-human levels in terms of verbal response quality and factual grounding accuracy. |
| Approach: | They propose a data-driven, end-to-end approach to transaction-based dialog systems that performs at near-human levels in terms of verbal response quality and factual grounding accuracy. |
| Outcome: | The proposed model generates verbal responses and API call predictions on a movie ticketing dialog dataset with 23,789 annotated conversations. |
Action-Based Conversations Dataset: A Corpus for Building More In-Depth Task-Oriented Dialogue Systems (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing goal-oriented dialogue datasets focus on identifying slots and values, but in reality, customer service agents follow multi-step procedures derived from explicit company policies. |
| Approach: | They propose to use a fully-labeled dataset to study customer service dialogue systems in real-world scenarios. |
| Outcome: | The proposed dataset outperforms existing models but still lacks 50.8% absolute accuracy to reach human-level performance on the dataset. |
Dependency Parsing for Spoken Dialog Systems (D19-1)
Copied to clipboard
| Challenge: | Dependency parsing of conversational input can help to understand dialogs . currently available annotation schemes do not adapt well to spoken human-machine dialogs. |
| Approach: | They propose an annotation scheme that extends Universal Dependencies guidelines to spoken dialogs. |
| Outcome: | The proposed scheme disambiguates relationships between entities extracted from dialogs . it is better than existing models on public datasets and fine-tuned on ConvBank data . |
Language Model as an Annotator: Exploring DialoGPT for Dialogue Summarization (2021.acl-long)
Copied to clipboard
| Challenge: | Existing dialogue summarization systems encode text with a number of general semantic features, but these are often not available in open-domain tools. |
| Approach: | They propose to use DialoGPT to label three types of features on two datasets . they propose to employ pre-trained and non-pre-tried models as dialogue annotators . |
| Outcome: | The proposed method improves on two dialogue summarization datasets and achieves state-of-the-art performance. |
Annotation Process for the Dialog Act Classification of a Taglish E-commerce Q&A Corpus (D19-51)
Copied to clipboard
| Challenge: | Existing studies on DA classification in general contexts have not addressed this problem. |
| Approach: | They constructed a text-based corpus of 7,265 posts from the question and answer section of products on Lazada Philippines. |
| Outcome: | The text-based corpus of 7,265 posts from the question and answer section of products on Lazada Philippines was constructed using a tagset for DA classification . the corpus was composed dominantly of single-label posts, with 34% of the corpuse having multiple intent tags. |
Semi-Supervised Bootstrapping of Dialogue State Trackers for Task-Oriented Modelling (D19-1)
Copied to clipboard
| Challenge: | Existing systems rely on modular, domain-focused frameworks for analyzing complex problems. |
| Approach: | They propose semi-supervised learning methods that can reduce the amount of required intermediate labelling by leveraging un-annotated data instead of transcribed utterances. |
| Outcome: | The proposed model reduces the amount of turn-level annotations by 30% while maintaining equivalent system performance. |
EDA: Enriching Emotional Dialogue Acts using an Ensemble of Neural Annotators (2020.lrec-1)
Copied to clipboard
| Challenge: | Emotion recognition helps to build natural dialogue systems. |
| Approach: | They propose to use a recurrent neural model to annotate emotion corpora with dialogue act labels and an ensemble annotator to extract the final dialogue act label. |
| Outcome: | The proposed model annotates two accessible multi-modal emotion corpora with and without context and extracts the final dialogue act label. |