Collaborative Rational Speech Act: Pragmatic Reasoning for Multi-Turn Dialog (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing extensions of Rational Speech Act face challenges in scaling to multi-turn, collaborative scenarios. |
| Approach: | They propose a Rational Speech Act extension that optimizes a gain function adapted from rate-distortion theory to model multi-turn dialog by optimizing a model gain . they demonstrate the effectiveness of CRSA on referential games and template-based doctor–patient dialogs in the medical domain. |
| Outcome: | The proposed model yields more consistent, interpretable, and collaborative behavior than baselines, paving the way for more pragmatic and socially aware language agents. |
Similar Papers
Large Scale Multi-Actor Generative Dialog Modeling (2020.acl-main)
Copied to clipboard
| Challenge: | Non-goal oriented dialog agents typically exhibit inconsistent personality across conversations or the average personality of all users. |
| Approach: | They propose a model that conditionally models past conversations to probabilistically model multi-turn conversations in the actor’s persona. |
| Outcome: | The proposed model improves perplexity on 1.7M held out Reddit conversations by 0.47 on scaling from 117M to 8.3B parameters. |
On the Same Wavelength? Evaluating Pragmatic Reasoning in Language Models across Broad Concepts (2025.emnlp-main)
Copied to clipboard
| Challenge: | Language models (LMs) are increasingly used as conversational agents because of their pragmatic reasoning abilities. |
| Approach: | They propose an evaluation framework derived from *Wavelength*, a popular communication game where a speaker and a listener communicate about a broad range of concepts in a granular manner. |
| Outcome: | The proposed evaluation framework outperforms direct and Chain-of-Thought (CoT) prompting on language comprehension and language production tasks. |
Communicate to Play: Pragmatic Reasoning for Efficient Cross-Cultural Communication (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing research in cross-cultural communication focuses on single-turn interactions or centers on knowledge of cultural values or norms. |
| Approach: | They propose a method to resolve cross-cultural differences in common ground . they use contrastive learning of embedding space and LLM prompting to create a game . |
| Outcome: | The proposed method improves collaboration between simulated players of different cultures in a referential game of Codenames Duet. |
RSA-Control: A Pragmatics-Grounded Lightweight Controllable Text Generation Framework (2024.emnlp-main)
Copied to clipboard
| Challenge: | RSA-Control is a training-free controllable text generation framework . existing studies rely on fine-tuning pre-trained language models . external components could hurt coherence and accuracy of the model . |
| Approach: | They propose a training-free controllable text generation framework grounded in pragmatics that directs the generation process by recursively reasoning between imaginary speakers and listeners. |
| Outcome: | The proposed framework achieves strong attribute control while maintaining fluency and content consistency. |
Review-Instruct: A Review-Driven Multi-Turn Conversations Generation Method for Large Language Models (2025.findings-acl)
Copied to clipboard
Jiangxu Wu, Cong Wang, Tianhuang Su, Lin Haozhi, JunYang JunYang, Zhangchao Zhangchao, Binqiang Pan, SongpanYang SongpanYang, Mingpeng Mingpeng, Kai Shi, Zixian Li
| Challenge: | Existing methods for generating multi-turn dialogue data struggle to ensure both diversity and quality in instructions. |
| Approach: | They propose a framework that synthesizes multi-turn conversations through an iterative "Ask-Respond-Review" process involving three agent roles: a Candidate, multiple Reviewers, and a Chairman. |
| Outcome: | The proposed framework synthesizes multi-turn conversations through an iterative "Ask-Respond-Review" process involving three agent roles: a Candidate, multiple Reviewers, and a Chairman. |
Dialogue Chain-of-Thought Distillation for Commonsense-aware Conversational Agents (2023.emnlp-main)
Copied to clipboard
Hyungjoo Chae, Yongho Song, Kai Ong, Taeyoon Kwon, Minjin Kim, Youngjae Yu, Dongha Lee, Dongyeop Kang, Jinyoung Yeo
| Challenge: | a human-like chatbot requires commonsense reasoning to comprehend and respond to information . however, identifying and aggregating key evidence within a single hop is a challenge . a knowledge distillation framework is proposed that leverages LLMs as unreliable teachers . |
| Approach: | They propose a framework that leverages large language models as unreliable teachers to facilitate multi-hop reasoning over a dialogue context. |
| Outcome: | The proposed framework leverages LLMs as unreliable teachers and selectively distills consistent and helpful rationales via alignment filters. |
Sketching a Linguistically-Driven Reasoning Dialog Model for Social Talk (2022.acl-srw)
Copied to clipboard
| Challenge: | a new study shows that dialog systems that can hold social talk and make sense of conversational content are not efficient for context-sensitive natural language understanding and reasoning. |
| Approach: | They propose a linguistically-informed architecture to handle social talk in English . they propose linguistic models that fit the context-sensitive components into a Bayesian game-theoretic model . |
| Outcome: | The proposed architecture is based on corpus-based methods but does not track what is happening in a conversation. |
Common Ground Tracking in Multimodal Dialogue (2024.lrec-main)
Copied to clipboard
Ibrahim Khalil Khebour, Kenneth Lai, Mariah Bradford, Yifan Zhu, Richard A. Brutti, Christopher Tam, Jingxuan Tu, Benjamin A. Ibarra, Nathaniel Blanchard, Nikhil Krishnaswamy, James Pustejovsky
| Challenge: | In dialogue modeling, there is considerable attention on “dialogue state tracking” (DST) but “common ground tracking” identifies the shared belief space held by all participants in a task-oriented dialogue: the task-relevant propositions all participants accept as true. |
| Approach: | They propose a method for automatically identifying the current set of shared beliefs and ”questions under discussion” of a group with a shared goal. |
| Outcome: | The proposed method predicts moves toward building common ground relative to ground truth in a multimodal interaction with an AI. |
Confidence-Calibrated Small-Large Language Model Collaboration for Cost-Efficient Reasoning (2026.eacl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have superior reasoning capabilities compared to small language models, but incur substantially higher inference costs. |
| Approach: | They propose a system that cascades an LLM with an SLM to achieve a balance between accuracy and cost in complex reasoning tasks. |
| Outcome: | The proposed system improves the SLM’s reasoning ability and confidence calibration across diverse datasets and model backbones. |
Dynamic Evaluation with Cognitive Reasoning for Multi-turn Safety of Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Existing safety evaluation methods rely on static assessments that use fixed harmful prompts or predefined prefixes as jailbreak templates. |
| Approach: | They propose a dynamic evaluation framework for multi-turn safety assessment of LLMs based on cognitive theories to simulate real chatting process and scenario simulation and strategy decision to guide dynamic generation. |
| Outcome: | The proposed framework has been applied to evaluate the safety of widely used LLMs. |