Dialogue Act-based Breakdown Detection in Negotiation Dialogues (2021.eacl-main)
Copied to clipboard
| Challenge: | Recent studies have succeeded in modeling a negotiating agent in natural language that can control both text generation and reasoning in goal-oriented dialogue systems. |
| Approach: | They propose a human-human negotiation dialogue dataset that features increased complexities in terms of the number of possible solutions and a utility function. |
| Outcome: | The proposed method performs comparable to text-based approaches in existing corpora and better results in the proposed dataset. |
Similar Papers
Let’s Negotiate! A Survey of Negotiation Dialogue Systems (2024.findings-eacl)
Copied to clipboard
Haolan Zhan, Yufei Wang, Zhuang Li, Tao Feng, Yuncheng Hua, Suraj Sharma, Lizhen Qu, Zhaleh Semnani Azad, Ingrid Zukerman, Reza Haf
| Challenge: | Recent research has focused on negotiation dialogue systems, but no systematic review of this task has been conducted. |
| Approach: | They propose to provide a systematic review of negotiation dialogue systems and to provide an overview of current research. |
| Outcome: | The proposed systems are based on the literature and are compared against existing systems. |
Action-Based Conversations Dataset: A Corpus for Building More In-Depth Task-Oriented Dialogue Systems (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing goal-oriented dialogue datasets focus on identifying slots and values, but in reality, customer service agents follow multi-step procedures derived from explicit company policies. |
| Approach: | They propose to use a fully-labeled dataset to study customer service dialogue systems in real-world scenarios. |
| Outcome: | The proposed dataset outperforms existing models but still lacks 50.8% absolute accuracy to reach human-level performance on the dataset. |
Treating Dialogue Quality Evaluation as an Anomaly Detection Problem (2020.lrec-1)
Copied to clipboard
| Challenge: | Dialogue systems for interaction with humans are becoming more popular . the best way to estimate their success is through means of human evaluation . |
| Approach: | They investigate the effectiveness of perceiving dialogue evaluation as an anomaly detection task. |
| Outcome: | The proposed approach is based on four models and shows negative results . the proposed approach could be used in the future to improve human-led dialogue evaluations. |
A Co-Attentive Cross-Lingual Neural Model for Dialogue Breakdown Detection (2020.coling-main)
Copied to clipboard
| Challenge: | Existing models for dialogue breakdown detection do not focus on preventing dialogue breakdowns. |
| Approach: | They propose a model that integrates a pretrained cross-lingual language model and a co-attention network for dialogue breakdown detection. |
| Outcome: | The proposed model outperforms all previous approaches on evaluation metrics in Japanese and English tracks in Dialogue Breakdown Detection Challenge 4 . |
A Brief Survey of Textual Dialogue Corpora (2022.lrec-1)
Copied to clipboard
| Challenge: | Several dialogue corpora are available for research purposes, but they do not cover all the necessities of real-world applications. |
| Approach: | They analyze available dialogue corpora and propose possible approaches to create new ones. |
| Outcome: | The proposed corpus of human-human dialogues is based on a list of available dialogue corpora . it covers speakers, size, languages, collection, annotations, and domains . some trends are identified and possible approaches are also discussed . |
Utterance-level Detection Framework for LLM-Involved Content Detection in Conversational Setting (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing methods focus on static, document-level content, overlooking the dynamic nature of dialogues. |
| Approach: | They propose an utterance-level detection framework which integrates features from individual and combined analysis of dialogue participants’ responses to detect LLM-generated text under conversational setting. |
| Outcome: | The proposed framework achieves 98.14% accuracy with high inference speed and extensive results on different models and settings. |
Do LLMs Understand Dialogues? A Case Study on Dialogue Acts (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown remarkable performance on many unseen tasks in a zero-shot setting. |
| Approach: | They propose to identify three key pre-tasks essential for accurate DA prediction: Turn Management, Communicative Function Identification, and Dialogue Structure Prediction. |
| Outcome: | The proposed model fails to outperform basic rule-based tasks on three key pre-tasks, and the results suggest that the model is flawed. |
Automatic Speech Interruption Detection: Analysis, Corpus, and System (2024.lrec-main)
Copied to clipboard
| Challenge: | Interruption detection is a new but challenging task in the field of speech processing. |
| Approach: | They propose to define automatic speech interruption detection and build a specialized corpus to analyze interrupted conversations. |
| Outcome: | The proposed system can detect interruptions in speech with promising results . it can be used to ensure speaking turns are respected during official political debates . |
In Search of the Lost Arch in Dialogue: A Dependency Dialogue Acts Corpus for Multi-Party Dialogues (2025.findings-acl)
Copied to clipboard
Jon Cai, Brendan King, Peyton Cameron, Susan Windisch Brown, Miriam Eckert, Dananjay Srinivas, George Arthur Baker, V Kate Everson, Martha Palmer, James Martin, Jeffrey Flanigan
| Challenge: | Understanding speaker intentions remains a challenge in NLP . a number of corpora annotated using theoretical frameworks of dialogue focus on utterance-level labeling of speaker intent, missing wider context, or the rhetorical structure of a dialogue. |
| Approach: | They propose to annotate a corpus of 33 dialogues and over 9,000 utterance units using the Dependency Dialogue Acts framework. |
| Outcome: | The proposed corpus spans four genres of multi-party conversations from different modalities. |
KODIS: A Multicultural Dispute Resolution Dialogue Corpus (2025.naacl-long)
Copied to clipboard
| Challenge: | KODIS is a dyadic dispute resolution corpus containing thousands of dialogues from over 75 countries. |
| Approach: | They propose to use a dyadic dispute resolution corpus to examine how conflicts escalate through conversation rather than deal-making. |
| Outcome: | The proposed corpus contains thousands of dialogues from over 75 countries. |