Dialogue Act-Aided Backchannel Prediction Using Multi-Task Learning (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Backchanneling is a form of feedback that is produced by listeners in a conversation . since the advent of ChatGPT, modern dialogue systems exhibit answer quality levels on par with humans in various professions. |
| Approach: | They propose a multi-task learning approach that learns textual representations for the task of backchannel prediction in tandem with dialogue act classification. |
| Outcome: | The proposed approach improves the prediction of specific backchannels by up to 2.0% in F1 . the audio encoder is pre-trained in a self-supervised fashion using voice activity projection . |
Similar Papers
A Practical Dialogue-Act-Driven Conversation Model for Multi-Turn Response Selection (D19-1)
Copied to clipboard
| Challenge: | Dialogue acts are important in conversation modeling, but they are rarely available for new conversations. |
| Approach: | They propose an end-to-end multi-task model that integrates dialogue acts with context and response in a crossway fashion. |
| Outcome: | The proposed model improves the accuracy of the dialogue act prediction task and the MRR for the response selection task. |
Yeah, Un, Oh: Continuous and Real-time Backchannel Prediction with Fine-tuning of Voice Activity Projection (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing methods for backchannel prediction relied on turn-based or artificially balanced datasets. |
| Approach: | They propose a method for real-time, continuous backchannel prediction using a fine-tuned Voice Activity Projection model. |
| Outcome: | The proposed method outperforms baseline methods in timing and type prediction tasks in real-world environments. |
BPM_MT: Enhanced Backchannel Prediction Model using Multi-Task Learning (2021.emnlp-main)
Copied to clipboard
| Challenge: | Backchannel (BC) is a short and quick reaction signal of a listener to a speaker's utterances. |
| Approach: | They propose a model that utilizes lexical information in utterances to enhance backchannel (BC) prediction. |
| Outcome: | The proposed model showed 14.24% performance improvement compared to baseline in the four BC categories: continuer, understanding, empathic response, and No BC. |
Knowledge-Grounded Dialogue Generation with Pre-trained Language Models (2020.emnlp-main)
Copied to clipboard
| Challenge: | Empirical results indicate that pre-trained language models can significantly outperform state-of-the-art methods in both automatic evaluation and human judgment. |
| Approach: | They propose to equip a pre-trained language model with a knowledge selection module to generate knowledge-grounded dialogues. |
| Outcome: | The proposed model outperforms state-of-the-art methods in evaluation and human judgment. |
Multi-Domain Dialogue Acts and Response Co-Generation (2020.acl-main)
Copied to clipboard
| Challenge: | Existing pipeline approaches for task-oriented dialogue systems tend to predict multiple dialogue acts first and use them to assist response generation. |
| Approach: | They propose a neural co-generation model that generates dialogue acts and responses concurrently and preserves semantic structures of multi-domain dialogue acts. |
| Outcome: | The proposed model improves over state-of-the-art models in automatic and human evaluations on a large-scale dataset. |
A Simple and Efficient Multi-Task Learning Approach for Conditioned Dialogue Generation (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing studies have focused on conditioned dialogue generation, but there is a scarcity of labeled responses. |
| Approach: | They propose a multi-task learning approach to leverage labeled dialogue and text data to generate conditioned dialogues. |
| Outcome: | The proposed approach outperforms the state-of-the-art models by leveraging the labeled texts and obtains larger improvement compared to the previous methods to leverage text data. |
Multi-task Learning for Natural Language Generation in Task-Oriented Dialogue (D19-1)
Copied to clipboard
| Challenge: | Existing methods to generate natural language for task-oriented dialogues lack naturalness and variation in language. |
| Approach: | They propose a multi-task learning framework for natural language generation that explicitly targets for naturalness in generated responses via an unconditioned language model. |
| Outcome: | The proposed framework outperforms existing models across multiple datasets in the study of natural language generation. |
Re-framing Incremental Deep Language Models for Dialogue Processing with Multi-task Learning (2020.coling-main)
Copied to clipboard
| Challenge: | Using a multi-task learning framework, we train a universal incremental dialogue processing model with four tasks of disfluency detection, language modelling, part-of-speech tagging and utterance segmentation in a simple deep recurrent setting. |
| Approach: | They propose a multi-task learning framework to train a universal incremental dialogue processing model with four tasks of disfluency detection, language modelling, part-of-speech tagging and utterance segmentation in a simple deep recurrent setting. |
| Outcome: | The proposed model outperforms individual tasks and delivers competitive performance. |
Aligning Backchannel and Dialogue Context Representations via Contrastive LLM Fine-Tuning (2026.acl-long)
Copied to clipboard
| Challenge: | Prior work on predicting backchannel timing has focused on lexical form and prosody, but the relationship between lexico-prosodic form and meaning remains underexplored. |
| Approach: | They propose a framework for fine-tuning large language models on dialogue transcripts to derive rich contextual representations; and a joint embedding space for dialogue contexts and backchannel realizations. |
| Outcome: | The proposed framework improves context-backchannel retrieval and human perception is more sensitive to extended conversational context and embeddings align more closely with human judgments than raw WavLM features. |
Improving Backchannel Prediction Leveraging Sequential and Attentive Context Awareness (2024.findings-eacl)
Copied to clipboard
| Challenge: | Backchannels are short and often affirmative or empathetic responses from a listener during a conversation . et al. (2010) showed that timely backchanneling can enhance storytelling ability . |
| Approach: | They propose a context-aware backchannel prediction approach that leverages a pretrained wav2vec model to enhance backchannel performance. |
| Outcome: | The proposed approach improves performance in Korean and English datasets . it leverages the pretrained wav2vec model for encoding audio signal . |