Aligning Backchannel and Dialogue Context Representations via Contrastive LLM Fine-Tuning (2026.acl-long)
Copied to clipboard
| Challenge: | Prior work on predicting backchannel timing has focused on lexical form and prosody, but the relationship between lexico-prosodic form and meaning remains underexplored. |
| Approach: | They propose a framework for fine-tuning large language models on dialogue transcripts to derive rich contextual representations; and a joint embedding space for dialogue contexts and backchannel realizations. |
| Outcome: | The proposed framework improves context-backchannel retrieval and human perception is more sensitive to extended conversational context and embeddings align more closely with human judgments than raw WavLM features. |
Similar Papers
Investigating the Representation of Backchannels and Fillers in Fine-tuned Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Backchannels and fillers are important linguistic expressions in dialogue, but often ignored in modern transformer-based language models. |
| Approach: | They use clustering analysis to learn backchannels and fillers in dialogues in English and Japanese and use natural language generation metrics to confirm this. |
| Outcome: | The proposed models can learn representations of backchannels and fillers using three fine-tuning strategies. |
Open Your Model’s Eyes: Video and Context-Aware Multimodal Backchannel Prediction (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for predicting backchannels rely on audio and text . existing methods omit visual cues and conversational contexts for accurate prediction . |
| Approach: | They propose a framework that leverages visual cues and conversational contexts to enhance backchannel prediction. |
| Outcome: | The proposed framework outperforms existing methods and simple multimodal baselines in recognizing complex backchannels such as empathy. |
Rethinking Pragmatics in Large Language Models: Towards Open-Ended Evaluation and Preference Tuning (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to assess social-pragmatic inference in large language models are inadequacy, and preferential tuning is the best approach. |
| Approach: | They propose to use free-form models' responses as a measure to assess social-pragmatic reasoning and advocate for preference optimization over supervised finetuning (SFT). |
| Outcome: | The proposed model outperforms supervised finetuning (SFT) and offers a near-free launch in pragmatic abilities without compromising general capabilities. |
Exploring Context Strategies in LLMs for Discourse-Aware Machine Translation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models excel at machine translation, but the impact of how LLMs utilize different forms of contextual information on discourse-level phenomena remains underexplored. |
| Approach: | They examine how different forms of context influence standard MT metrics and specific discourse phenomena such as formality, pronoun selection, and lexical cohesion. |
| Outcome: | Evaluating multiple LLMs across multiple domains and language pairs, the findings consistently show that context boosts translation and discourse-specific performance. |
Middle-Layer Representation Alignment for Cross-Lingual Transfer in Fine-Tuned LLMs (2025.acl-long)
Copied to clipboard
| Challenge: | Effective cross-lingual transfer is hindered by performance gaps and the scarcity of fine-tuning data in many languages. |
| Approach: | They propose a middle-layer alignment objective integrated into task-specific training to improve cross-lingual transfer across languages. |
| Outcome: | The proposed method improves cross-lingual transfer to lower-resource languages and can be merged with existing modules without full re-training. |
WildFeedback: Aligning LLMs With In-situ User Interactions And Feedback (2026.acl-long)
Copied to clipboard
Taiwei Shi, Zhuoer Wang, Longqi Yang, Ying-Chun Lin, Zexue He, Mengting Wan, Pei Zhou, Sujay Kumar Jauhar, Sihao Chen, Shan Xia, Hongfei Zhang, Jieyu Zhao, Xiaofeng Xu, Xia Song, Jennifer Neville
| Challenge: | Traditional alignment methods rely on human annotations and are subjective and misalignment with real-world user preferences. |
| Approach: | They propose a framework that leverages in-situ user feedback during conversations with LLMs to create preference datasets automatically. |
| Outcome: | The proposed framework identifies and classifies user feedback to LLM responses between conversation turns and creates examples of preferred and dispreferred responses according to user preferences. |
Learning LLM Preference over Intra-Dialogue Pairs: A Framework for Utterance-level Understandings (2025.naacl-industry)
Copied to clipboard
Xuanqing Liu, Luyang Kong, Wei Niu, Afshin Khashei, Belinda Zeng, Steve Johnson, Jon Jay, Davor Golac, Matt Pope
| Challenge: | Large language models (LLMs) have demonstrated remarkable capabilities in handling complex dialogue tasks without requiring use case-specific fine-tuning. |
| Approach: | They propose a framework that combines the scalability of LLM-generated labels with the precision of human annotations to achieve higher speed and accuracy comparable to larger models. |
| Outcome: | The proposed framework significantly improves accuracy across utterance-level dialogue tasks, including sentiment detection (over 2%), dialogue act classification (over 1.5%), etc. |
BIG5-CHAT: Shaping LLM Personalities Through Training on Human-Grounded Data (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for embedding human personality traits into LLMs are limited by realism and validity issues. |
| Approach: | They propose to use a large-scale dataset to embed human personality traits into LLMs . they use supervised fine-tuning and direct preference optimization to train LLM models . |
| Outcome: | The proposed methods outperform prompting on personality assessments and IPIP-NEO, and show higher conscientiousness, agreeableness, lower extraversion, and lower neuroticism on reasoning tasks. |
How Large Language Models Encode Context Knowledge? A Layer-Wise Probing Study (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies have focused on enhancing the factualness of large language models using context knowledge. |
| Approach: | They propose to use ChatGPT to construct probing datasets that provide diverse and coherent evidence corresponding to various facts. |
| Outcome: | The proposed model can encode knowledge across different layers, and it is compared with existing models. |
Linguistic Cues for LLM-based Implicit Discourse Relation Classification (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have been successful in many NLP tasks, but they struggle to capture subtle lexical relations between arguments. |
| Approach: | They propose a strategy that enriches arguments with explicit lexical-level semantic cues before fine-tuning. |
| Outcome: | The proposed approach improves F1 scores in cross-domain scenarios by more than 10 points compared to baselines. |