BPM_MT: Enhanced Backchannel Prediction Model using Multi-Task Learning (2021.emnlp-main)
Copied to clipboard
| Challenge: | Backchannel (BC) is a short and quick reaction signal of a listener to a speaker's utterances. |
| Approach: | They propose a model that utilizes lexical information in utterances to enhance backchannel (BC) prediction. |
| Outcome: | The proposed model showed 14.24% performance improvement compared to baseline in the four BC categories: continuer, understanding, empathic response, and No BC. |
Similar Papers
Dialogue Act-Aided Backchannel Prediction Using Multi-Task Learning (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Backchanneling is a form of feedback that is produced by listeners in a conversation . since the advent of ChatGPT, modern dialogue systems exhibit answer quality levels on par with humans in various professions. |
| Approach: | They propose a multi-task learning approach that learns textual representations for the task of backchannel prediction in tandem with dialogue act classification. |
| Outcome: | The proposed approach improves the prediction of specific backchannels by up to 2.0% in F1 . the audio encoder is pre-trained in a self-supervised fashion using voice activity projection . |
Open Your Model’s Eyes: Video and Context-Aware Multimodal Backchannel Prediction (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for predicting backchannels rely on audio and text . existing methods omit visual cues and conversational contexts for accurate prediction . |
| Approach: | They propose a framework that leverages visual cues and conversational contexts to enhance backchannel prediction. |
| Outcome: | The proposed framework outperforms existing methods and simple multimodal baselines in recognizing complex backchannels such as empathy. |
Improving Backchannel Prediction Leveraging Sequential and Attentive Context Awareness (2024.findings-eacl)
Copied to clipboard
| Challenge: | Backchannels are short and often affirmative or empathetic responses from a listener during a conversation . et al. (2010) showed that timely backchanneling can enhance storytelling ability . |
| Approach: | They propose a context-aware backchannel prediction approach that leverages a pretrained wav2vec model to enhance backchannel performance. |
| Outcome: | The proposed approach improves performance in Korean and English datasets . it leverages the pretrained wav2vec model for encoding audio signal . |
Predicting Turn-Taking and Backchannel in Human-Machine Conversations Using Linguistic, Acoustic, and Visual Signals (2025.acl-long)
Copied to clipboard
| Challenge: | Existing systems for human-machine conversations are limited in predicting turn-taking and backchannel actions. |
| Approach: | They propose a multi-modal face-to-face (MM-F2F) human conversation dataset . they collect and annotate over 210 hours of human conversation videos . |
| Outcome: | The proposed model achieves state-of-the-art on turn-taking and backchannel prediction tasks. |
Aligning Backchannel and Dialogue Context Representations via Contrastive LLM Fine-Tuning (2026.acl-long)
Copied to clipboard
| Challenge: | Prior work on predicting backchannel timing has focused on lexical form and prosody, but the relationship between lexico-prosodic form and meaning remains underexplored. |
| Approach: | They propose a framework for fine-tuning large language models on dialogue transcripts to derive rich contextual representations; and a joint embedding space for dialogue contexts and backchannel realizations. |
| Outcome: | The proposed framework improves context-backchannel retrieval and human perception is more sensitive to extended conversational context and embeddings align more closely with human judgments than raw WavLM features. |
Beyond Text: Leveraging Multi-Task Learning and Cognitive Appraisal Theory for Post-Purchase Intention Analysis (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have shown that user-level features can carry more task-related information than the text itself. |
| Approach: | They evaluate multi-task learning frameworks grounded in Cognitive Appraisal Theory to predict user behavior as a function of users’ self-expression and psychological attributes. |
| Outcome: | The proposed models improve on the language and traits of users, while lacking rich annotations of other attributes. |
Knowledge-Grounded Dialogue Generation with Pre-trained Language Models (2020.emnlp-main)
Copied to clipboard
| Challenge: | Empirical results indicate that pre-trained language models can significantly outperform state-of-the-art methods in both automatic evaluation and human judgment. |
| Approach: | They propose to equip a pre-trained language model with a knowledge selection module to generate knowledge-grounded dialogues. |
| Outcome: | The proposed model outperforms state-of-the-art methods in evaluation and human judgment. |
Modelling Context Emotions using Multi-task Learning for Emotion Controlled Dialog Generation (2021.eacl-main)
Copied to clipboard
| Challenge: | Recent research has tackled this task using neural generative methods by augmenting emotion classes with the input sequences. |
| Approach: | They propose to use a self-attention based encoder and a decoder with dot product attention mechanism to generate a viable response with a specified emotion. |
| Outcome: | The proposed model outperforms baselines on automatic evaluation measures such as F1 and BLEU scores, thus resulting in more fluent and adequate responses. |
Predicting Reference: What do Language Models Learn about Discourse Models? (2020.emnlp-main)
Copied to clipboard
| Challenge: | a growing literature that probes neural language models to assess their latent acquisition of grammatical knowledge has not investigated their acquisition of discourse modeling ability. |
| Approach: | They draw on a psycholinguistic literature that has established how different contexts affect referential biases concerning who is likely to be referred to next. |
| Outcome: | The proposed models do not resemble human language users, the authors show . their models capture the linguistic knowledge required to perform discourse modeling . |
Meta-learning via Language Model In-context Tuning (2022.acl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models have reduced "task learning and prediction" to a simple sequence prediction problem. |
| Approach: | They propose a meta-learning method that recasts task adaptation and prediction as a sequence prediction problem. |
| Outcome: | The proposed method outperforms MAML on two classification tasks and improves on binaryClfs. |