Speculative End-Turn Detector for Efficient Speech Chatbot Assistant (2026.acl-long)
Copied to clipboard
| Challenge: | Spoken dialogue systems with large language models struggle with end-turn detection . this limitation often leads to premature or delayed responses, disrupting the flow of spoken conversations. |
| Approach: | They propose a dataset for end-turn detection that uses a lightweight GRU-based model and a high-performance Wav2vec-based system to make a more challenging classification of distinguishing turn ends from mere pauses. |
| Outcome: | The proposed framework significantly improves real-time ETD accuracy while keeping computations low. |
Similar Papers
Response-conditioned Turn-taking Prediction (2023.findings-acl)
Copied to clipboard
| Challenge: | Traditionally, turn-taking is done using a simple silence threshold, but more modern approaches use cues known to be important in human-human turn-shifts. |
| Approach: | They propose a turn-taking and response-ranking model that conditions the end-of-turn prediction on conversation history and what the next speaker wants to say. |
| Outcome: | The proposed model outperforms the baseline model in a variety of metrics. |
End-to-end Task-oriented Dialogue: A Survey of Tasks, Methods, and Future Directions (2023.emnlp-main)
Copied to clipboard
| Challenge: | End-to-end task-oriented dialogue (EToD) can generate responses in an end-to end fashion without modular training, which attracts escalating popularity. |
| Approach: | They present a systematic review of EToD and propose a unified perspective to summarize existing approaches and recent trends. |
| Outcome: | The proposed approaches can generate responses in an end-to-end fashion without modular training, which attracts escalating popularity. |
TicketTalk: Toward human-level performance with end-to-end, transaction-based dialog systems (2021.acl-long)
Copied to clipboard
| Challenge: | TicketTalk dataset with 23,789 annotated dialogs is a data-driven, end-to-end approach to transaction-based dialog systems that performs at near-human levels in terms of verbal response quality and factual grounding accuracy. |
| Approach: | They propose a data-driven, end-to-end approach to transaction-based dialog systems that performs at near-human levels in terms of verbal response quality and factual grounding accuracy. |
| Outcome: | The proposed model generates verbal responses and API call predictions on a movie ticketing dialog dataset with 23,789 annotated conversations. |
Injecting Salesperson’s Dialogue Strategies in Large Language Models with Chain-of-Thought Reasoning (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent research in dialogue systems focuses on task-oriented (TOD) and open-domain (chit-chat) dialogues. |
| Approach: | They propose to use chit-chat to simulate task-oriented dialogues to train sales agents. |
| Outcome: | The proposed model improves coherence and reduces aggression, improving model learning for sales-customer interactions. |
An End-to-end Approach for Handling Unknown Slot Values in Dialogue State Tracking (P18-1)
Copied to clipboard
| Challenge: | a dialogue state tracker is a core component in most of today's spoken dialogue systems . slot-filling dialogues are composed of a predefined set of slots that need to be filled through the conversation . |
| Approach: | They propose an E2E architecture that extracts unknown slot values while still achieving state-of-the-art accuracy on the standard DSTC2 benchmark. |
| Outcome: | The proposed architecture achieves state-of-the-art accuracy on the DSTC2 benchmark while retaining predefined slot values. |
Beyond the Known: Investigating LLMs Performance on Out-of-Domain Intent Detection (2024.lrec-main)
Copied to clipboard
Pei Wang, Keqing He, Yejie Wang, Xiaoshuai Song, Yutao Mou, Jingang Wang, Yunsen Xian, Xunliang Cai, Weiran Xu
| Challenge: | Out-of-domain (OOD) intent detection is crucial for task-oriented dialogue systems. |
| Approach: | They conduct a comprehensive evaluation of large language models (LLMs) under various experimental settings and outline their strengths and weaknesses. |
| Outcome: | The proposed models exhibit strong zero-shot and few-shot capabilities, but is still at a disadvantage compared to models fine-tuned with full resource. |
LLaMA-Omni 2: LLM-based Real-time Spoken Chatbot with Autoregressive Streaming Speech Synthesis (2025.acl-long)
Copied to clipboard
| Challenge: | LLaMA-Omni 2 is a series of speech language models (SpeechLMs) based on large language models. |
| Approach: | They introduce a series of speech language models capable of real-time speech interaction . LLaMA-Omni 2 trains on 200K multi-turn speech dialogue samples . |
| Outcome: | The proposed speech language models surpass state-of-the-art models on spoken question answering and speech instruction. |
Lingke: a Fine-grained Multi-turn Chatbot for Customer Service (C18-2)
Copied to clipboard
| Challenge: | e-commerce chatbots usually need a mass of human dialogue data to train, but for multi-turn conversations, the performance is poor. |
| Approach: | They propose an information retrieval augmented multi-turn chatbot which can answer questions based on unstructured documents and deal with multi-turned conversations. |
| Outcome: | The proposed solution outperforms all other models in multi-turn conversations and can learn from conversation records. |
Data Collection and End-to-End Learning for Conversational AI (D19-2)
Copied to clipboard
| Challenge: | tutorial aims to familiarise research community with recent advances in statistical dialogue systems . focus of tutorial is on learning end-to-end from data and their relation to more common modular systems. |
| Approach: | This tutorial aims to familiarise the research community with the latest advances in statistical dialogue systems . the focus of the tutorial is on recently introduced end-to-end learning for dialogue systems and their relation to more common modular systems. |
| Outcome: | This tutorial aims to familiarise the research community with the recent advances in statistical dialogue systems for open-domain and task-based dialogue paradigms. |
Diving Deep into Modes of Fact Hallucinations in Dialogue Systems (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Knowledge Graph(KG) grounded conversations often use large pre-trained models and suffer from fact hallucination. |
| Approach: | They propose to use a human feedback analysis to identify various modes of hallucination in KG chatbots. |
| Outcome: | The proposed system provides fine-grained signals that control fallacious content while generating responses. |