Challenge: Current conversational agents (CAs) do not recognize repair initiation, leading to breakdowns or disengagement.
Approach: They propose a multimodal model to automatically detect repair initiation in Dutch dialogues by integrating linguistic and prosodic features grounded in Conversation Analysis.
Outcome: The proposed model integrates linguistic and prosodic features grounded in Conversation Analysis to detect repair initiation in Dutch dialogues.

Similar Papers

Talking to a Know-It-All GPT or a Second-Guesser Claude? How Repair reveals distinct Multi-Turn Behavior in LLMs (2026.acl-long)

Copied to clipboard

Challenge: a lot of research aims to mitigate these problems by introducing specific computational solutions.
Approach: They examine how large language models engage in the interactive process of repair in multi-turn dialogues around solvable and unsolvable math questions.
Outcome: The models respond to user-initiated repair differently from one another . the models exhibit their own characteristic form of unreliability in the context of repair .
Repairs in a Block World: A New Benchmark for Handling User Corrections with Multi-Modal Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: In dialogue, the addressee may misunderstand the speaker and respond erroneously.
Approach: They collect, analyse, and publicly release a dataset of multi-modal TPR sequences in dialogue . they evaluate several state-of-the-art Vision and Language Models across multiple settings .
Outcome: The proposed model underperforms in a human-robot interaction task compared to humans . the proposed model can benefit from specialised losses targeting relevant tokens .
Multimodal Conversation Modelling for Topic Derailment Detection (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing work on analysing textual dialogues that derailed into toxic content ignores visual information, such as images and videos.
Approach: They propose a new multimodal conversational architecture that utilises visual and conversational contexts to classify comments for derailment.
Outcome: The proposed approach outperforms existing methods and is more robust to textual noise.
MONAH: Multi-Modal Narratives for Humans to analyze conversations (2021.eacl-main)

Copied to clipboard

Challenge: In conversational analyses, humans manually weave multimodal information into the transcripts, which is significantly time-consuming.
Approach: They propose a system that automatically expands the verbatim transcripts of video-recorded conversations using multimodal data streams.
Outcome: The proposed system improves detecting rapport-building by expanding the range of multimodal annotations.
A Co-Attentive Cross-Lingual Neural Model for Dialogue Breakdown Detection (2020.coling-main)

Copied to clipboard

Challenge: Existing models for dialogue breakdown detection do not focus on preventing dialogue breakdowns.
Approach: They propose a model that integrates a pretrained cross-lingual language model and a co-attention network for dialogue breakdown detection.
Outcome: The proposed model outperforms all previous approaches on evaluation metrics in Japanese and English tracks in Dialogue Breakdown Detection Challenge 4 .
INTERVENOR: Prompting the Coding Ability of Large Language Models with the Interactive Chain of Repair (2024.findings-acl)

Copied to clipboard

Challenge: Experimental results show that INTERVENOR surpasses baseline models, exhibiting improvements of approximately 18% and 4.3% over GPT-3.5 in code generation and code translation tasks.
Approach: They propose a system that prompts Large Language Models to play distinct roles during the code repair process, functioning as both a Code Learner and a code teacher.
Outcome: The proposed system surpasses baseline models in code generation and code translation tasks and improves on syntax errors and assertion errors.
Conversations Gone Awry: Detecting Early Signs of Conversational Failure (P18-1)

Copied to clipboard

Challenge: Prior work focused on characterizing and detecting content exhibiting antisocial online behavior.
Approach: They propose a task of predicting from the very start of a conversation whether it will get out of hand.
Outcome: The proposed framework can detect early warning signs of antisocial behavior in online conversations.
Dialogue Act-based Breakdown Detection in Negotiation Dialogues (2021.eacl-main)

Copied to clipboard

Challenge: Recent studies have succeeded in modeling a negotiating agent in natural language that can control both text generation and reasoning in goal-oriented dialogue systems.
Approach: They propose a human-human negotiation dialogue dataset that features increased complexities in terms of the number of possible solutions and a utility function.
Outcome: The proposed method performs comparable to text-based approaches in existing corpora and better results in the proposed dataset.
Hey, wait a minute: on at-issue sensitivity in Language Models (2026.eacl-short)

Copied to clipboard

Challenge: Existing methods to evaluate dialogue naturalness are limited.
Approach: They propose a method to assess dialogue naturalness using linguistic notion of at-issueness.
Outcome: The proposed method mitigates bias in linguistic analyses of LMs and tests discourse-sensitive behavior.
Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaboration (2023.findings-emnlp)

Copied to clipboard

Challenge: Recent studies have shown that ChatGPT has limitations such as failing to ask clarifying questions to ambiguous queries or refusing problematic user requests.
Approach: They propose a Proactive Chain-of-Thought prompting scheme which augments LLMs with the goal planning capability over descriptive reasoning chains to trigger proactivity.
Outcome: The proposed scheme augments LLMs with the goal planning capability over descriptive reasoning chains to trigger the proactivity of LLM-based proactive dialogue systems.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations