Matthew Marge, Stephen Nogar, Cory J. Hayes, Stephanie M. Lukin, Jesse Bloecker, Eric Holder, Clare Voss
| Challenge: | a new research platform supports spoken dialogue interaction with multiple robots . a ground robot and an aerial robot are used to perform search and rescue tasks . |
| Approach: | They propose a platform that supports spoken dialogue interaction with multiple robots . they use existing tools for speech recognition and dialogue management . |
| Outcome: | The proposed platform supports spoken dialogue interaction with multiple robots in a search and rescue scenario. |
Similar Papers
Multimodal Large Language Models for Human-AI Interaction: Foundations, Agents, and Inclusive Applications (2026.eacl-tutorials)
Copied to clipboard
| Challenge: | This tutorial presents foundations, agentic capabilities, and inclusive applications of multimodal large language models. |
| Approach: | This tutorial presents foundations, agentic capabilities, and inclusive applications of multimodal large language models. |
| Outcome: | This tutorial covers foundations, agentic capabilities, and inclusive applications of multimodal large language models. |
Achieving Common Ground in Multi-modal Dialogue (2020.acl-tutorials)
Copied to clipboard
| Challenge: | tutorial focuses on three main topic areas: grounding in human-human communication, dialogue systems and multi-modal interactive systems. |
| Approach: | This tutorial examines the use of computational dialogue research to design grounding modules and behaviors in cutting-edge systems. |
| Outcome: | This tutorial examines the results of recent research on grounding in human-human communication . it shows how these results lead to rich and challenging opportunities for doing grounding more flexible and powerful ways . |
ScoutBot: A Dialogue System for Collaborative Navigation (P18-4)
Copied to clipboard
Stephanie M. Lukin, Felix Gervits, Cory J. Hayes, Pooja Moolchandani, Anton Leuski, John G. Rogers III, Carlos Sanchez Amaro, Matthew Marge, Clare R. Voss, David Traum
| Challenge: | Demo will allow users to issue unconstrained spoken language commands to ScoutBot. |
| Approach: | The demonstration will allow users to issue unconstrained spoken language commands to ScoutBot. |
| Outcome: | The demonstration will allow users to issue unconstrained spoken language commands to ScoutBot. |
Multi-party Multimodal Conversations Between Patients, Their Companions, and a Social Robot in a Hospital Memory Clinic (2024.eacl-demo)
Copied to clipboard
Angus Addlesee, Neeraj Cherakara, Nivan Nelson, Daniel Hernandez Garcia, Nancie Gunson, Weronika Sieińska, Christian Dondrup, Oliver Lemon
| Challenge: | a new spoken dialogue system is being developed for hospitals and hospitals to enable multi-party interactions . a social robot can be used to have multi-part conversations with patients and their companions . |
| Approach: | They describe a spoken dialogue system that allows patients to have multi-party conversations with their companions . they use speech and video input to generate both speech and gestures - arm, head, and eye movements . |
| Outcome: | The proposed system generates human-like clarification requests when the patient pauses mid-utterance, answers in-domain questions, and responds appropriately to out-of-domain requests. |
MultiDoc2Dial: Modeling Dialogues Grounded in Multiple Documents (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing work treats document-grounded dialogue modeling as a machine reading comprehension task based on a single document or passage. |
| Approach: | They propose a task and dataset for modeling goal-oriented dialogues grounded in multiple documents. |
| Outcome: | The proposed task and dataset address realistic scenarios where goal-oriented dialogues involve multiple topics and hence are grounded on different documents. |
ConvLab-3: A Flexible Dialogue System Toolkit Based on a Unified Data Format (2023.emnlp-demo)
Copied to clipboard
Qi Zhu, Christian Geishauser, Hsien-chin Lin, Carel van Niekerk, Baolin Peng, Zheng Zhang, Shutong Feng, Michael Heck, Nurul Lubis, Dazhen Wan, Xiaochen Zhu, Jianfeng Gao, Milica Gasic, Minlie Huang
| Challenge: | Existing tools for building TOD systems often lack a user-friendly interface . a toolkit with advanced, easily integrable modules is needed to bridge this gap . |
| Approach: | They propose a multifaceted dialogue system toolkit that integrates diverse datasets and models with a streamlined training process and in-depth evaluation tools. |
| Outcome: | The proposed toolkit combines RL and transfer learning to support the rapid development and evaluation of robust dialogue policies. |
Let’s Negotiate! A Survey of Negotiation Dialogue Systems (2024.findings-eacl)
Copied to clipboard
Haolan Zhan, Yufei Wang, Zhuang Li, Tao Feng, Yuncheng Hua, Suraj Sharma, Lizhen Qu, Zhaleh Semnani Azad, Ingrid Zukerman, Reza Haf
| Challenge: | Recent research has focused on negotiation dialogue systems, but no systematic review of this task has been conducted. |
| Approach: | They propose to provide a systematic review of negotiation dialogue systems and to provide an overview of current research. |
| Outcome: | The proposed systems are based on the literature and are compared against existing systems. |
Dialogue is the Plan: From Interface to Joint Action in Agentic AI (2026.acl-short)
Copied to clipboard
| Challenge: | Large Language Model agents' language use is often used as an interface for instructing and reporting results. |
| Approach: | They argue that large language models are often used as an interface for instructingactions and reporting results. |
| Outcome: | We show that large-scale language models can be used to plan and act, yet their language is often used as an interface for instructing and reporting results. |
Deep Learning for Dialogue Systems (C18-3)
Copied to clipboard
| Challenge: | Using deep learning to build robust and scalable spoken dialogue systems is still a challenging task. |
| Approach: | tutorial focuses on an overview of dialogue system development . goal-oriented spoken dialogue systems are most prominent component in virtual personal assistants . |
| Outcome: | This tutorial focuses on an overview of dialogue system development while summarizing the challenges. |
A Speculative and Tentative Common Ground Handling for Efficient Composition of Uncertain Dialogue (2022.lrec-1)
Copied to clipboard
| Challenge: | a study explores how the grounding process is composed and adapts to human cognitive processes . common ground is a set of information shared among participants that serves as a precondition for understanding individual utterances . |
| Approach: | a study investigates how the grounding process is composed by participants . it suggests that common ground may not necessarily be formed bottom-up through analytic expressions . |
| Outcome: | a new approach to human-like dialogue may be more suitable for natural human communication, the authors say . they show that common ground is mutually accepted among participants through holistic expressions . |