Towards Neural Speaker Modeling in Multi-Party Conversation: The Task, Dataset, and Models (L18-1)
Copied to clipboard
| Challenge: | Existing methods for speaker modeling are based on hand-crafted statistics and ad hoc to a certain application. |
| Approach: | They propose to use speaker classification as a surrogate task for general speaker modeling and collect massive data to facilitate research in this direction. |
| Outcome: | The proposed models outperform the existing models and are feasible with speaker identity information. |
Similar Papers
A Dynamic Speaker Model for Conversational Interactions (N19-1)
Copied to clipboard
| Challenge: | a neural model for characterizing individual differences in speakers is shown to be useful in human-computer interaction and dialog act prediction. |
| Approach: | They propose a neural model for learning a dynamically updated speaker embedding in a conversational context. |
| Outcome: | The proposed model is used for content ranking and dialog act prediction in human-human conversations. |
Who is Speaking? Speaker-Aware Multiparty Dialogue Act Classification (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Identifying how speakers interact with each other in a conversation is difficult when more than two interlocutors take part in . To overcome this challenge, we propose to explicitly add speaker awareness to each utterance representation. |
| Approach: | They propose to add speaker awareness to each utterance representation to model how each speaker is behaving within the local context of a conversation. |
| Outcome: | The proposed approach is able to model multiparticipant and dyadic conversations on the MRDA and SwDA datasets and shows that it is more efficient than previous approaches. |
Bazinga! A Dataset for Multi-Party Dialogues Structuring (2022.lrec-1)
Copied to clipboard
Paul Lerner, Juliette Bergoënd, Camille Guinaudeau, Hervé Bredin, Benjamin Maurice, Sharleyne Lefevre, Martin Bouteiller, Aman Berhe, Léo Galmant, Ruiqing Yin, Claude Barras
| Challenge: | a dataset of 16 TV and movie series is filled with challenging multi-party dialogues. |
| Approach: | They propose a dataset built around 16 TV and movie series with challenging multi-party dialogues. |
| Outcome: | The proposed dataset is a step towards better multi-party dialogue structuring and understanding. |
Pre-training Multi-party Dialogue Models with Latent Discourse Inference (2023.acl-long)
Copied to clipboard
| Challenge: | Existing studies have failed to scale up the pre-training process by putting aside unlabeled data . et al., 2019: multi-party dialogues are more difficult for models to understand since they involve multiple interlocutors resulting in interweaving reply-to relations and information flows. |
| Approach: | They propose to treat discourse structures as latent variables and jointly infer them to pre-train a model that understands the discourse structure of multi-party dialogues. |
| Outcome: | The proposed model outperforms baselines and achieves state-of-the-art results on multiple downstream tasks. |
PACHAT: Persona-Aware Speech Assistant for Multi-party Dialogue (2025.emnlp-main)
Copied to clipboard
| Challenge: | Extensive research on spoken dialogue systems has advanced the development of intelligent voice assistants, but integration of role information within speech remains an underexplored area. |
| Approach: | They propose a language-based spoken dialogue system that integrates role information within speech to generate contextually appropriate responses. |
| Outcome: | The proposed architecture achieves speaker-specific responses, character understanding, and the generation of targeted replies in multi-party dialogue scenarios, surpassing existing spoken dialogue systems. |
MPC-BERT: A Pre-Trained Language Model for Multi-Party Conversation Understanding (2021.acl-long)
Copied to clipboard
| Challenge: | Existing models for multi-party conversation represent interlocutors and utterances individually . existing methods ignore complicated structure of MPC which may provide crucial interlocutor and tertiary semantics. |
| Approach: | They propose a pre-trained model for multi-party conversation that considers learning who says what to whom in a unified model with elaborated self-supervised tasks. |
| Outcome: | The proposed model outperforms existing models on three downstream tasks at two benchmarks. |
Speaker Overlap-aware Neural Diarization for Multi-party Meeting Analysis (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to speaker diarization treat speaker dependency and overlaps as multi-label classification problems. |
| Approach: | They propose to reformulate overlapped speaker diarization task as a single-label prediction problem via power set encoding (PSE) to overcome the disadvantages, they propose a speaker overlap-aware neural diarisation model which incorporates a context-independent scorer and a contextual-dependent score. |
| Outcome: | The proposed model outperforms the state-of-the-art methods on speaker voice activity detection and improves relative diarization error reduction by 6.30%. |
Deep Learning for Dialogue Systems (C18-3)
Copied to clipboard
| Challenge: | Using deep learning to build robust and scalable spoken dialogue systems is still a challenging task. |
| Approach: | tutorial focuses on an overview of dialogue system development . goal-oriented spoken dialogue systems are most prominent component in virtual personal assistants . |
| Outcome: | This tutorial focuses on an overview of dialogue system development while summarizing the challenges. |
Language Model as an Annotator: Exploring DialoGPT for Dialogue Summarization (2021.acl-long)
Copied to clipboard
| Challenge: | Existing dialogue summarization systems encode text with a number of general semantic features, but these are often not available in open-domain tools. |
| Approach: | They propose to use DialoGPT to label three types of features on two datasets . they propose to employ pre-trained and non-pre-tried models as dialogue annotators . |
| Outcome: | The proposed method improves on two dialogue summarization datasets and achieves state-of-the-art performance. |
Recent Neural Methods on Slot Filling and Intent Classification for Task-Oriented Dialogue Systems: A Survey (2020.coling-main)
Copied to clipboard
| Challenge: | In recent years, neural-network based models have been used for a wide range of tasks, including slot filling and intent classification. |
| Approach: | They propose three neural architectures to model slot filling and intent classification . they propose independent models, joint models and transfer learning models that exploit the mutual benefit of the two tasks simultaneously and scale the model to new domains. |
| Outcome: | The proposed models model SF and IC separately, exploit mutual benefit of the two tasks simultaneously and scale the model to new domains. |