| Challenge: | Recent studies have focused on developing dialogue systems that enable collaborative work, but few studies have centered on creative collaborative work. |
| Approach: | They collected 500 dialogues of human-human collaboration in Minecraft as a basis for developing a dialogue system that enables creative collaborative work. |
| Outcome: | The proposed system can be used to create a collaborative garden in Minecraft and collect text chats, action logs, and subjective evaluations. |
Similar Papers
Collaborative Dialogue in Minecraft (P19-1)
Copied to clipboard
| Challenge: | Using computer games to simulate grounded situations, we want to develop interactive agents that can communicate with humans to solve tasks in grounded scenarios. |
| Approach: | They propose a Minecraft-based collaborative building task in which one player is shown a building structure and needs to instruct the other player to build it. |
| Outcome: | The proposed agent can communicate with humans to solve a building task in a Minecraft-based environment without the need for physical robots. |
MindCraft: Theory of Mind Modeling for Situated Dialogue in Collaborative Tasks (2021.emnlp-main)
Copied to clipboard
| Challenge: | Creating embodied, situated agents able to move in, communicate naturally about, and collaborate on human terms in the physical world has been a persisting goal in artificial intelligence (Winograd, 1972). |
| Approach: | They propose to use a 3D Minecraft dataset to model the beliefs of human partners in situ to enable theory of mind modeling in situated interactions. |
| Outcome: | The proposed model can be used to model human collaborative behaviors in the 3D virtual blocks world of Minecraft. |
Learning to execute instructions in a Minecraft dialogue (2020.acl-main)
Copied to clipboard
| Challenge: | Existing attempts to build interactive agents that can communicate with humans about and operate within the physical world are either completely ungrounded, focus on slot-value filling tasks, or operate within static environments, such as images or videos. |
| Approach: | They define the subtask of predicting correct action sequences in a given game context and capture B’s past actions as well as B’ s perspective leads to a significant improvement in performance. |
| Outcome: | The proposed task improves the performance of the two-player game and its corresponding Minecraft Dialogue Corpus. |
Collecting and Analyzing Dialogues in a Tagline Co-Writing Task (2024.lrec-main)
Copied to clipboard
| Challenge: | Currently, most studies on dialogue systems focus on problemsolving dialogues and relatively little research has been done on systems that can engage in creative collaboration with users. |
| Approach: | They designed a tagline co-writing task in which two people collaborate to create taglines via text chat and collected dialogue logs, editing logs and questionnaire results. |
| Outcome: | The proposed task involved a tagline co-writing task in which two people collaborate to create taglines via text chat, and collected dialogue logs, editing logs and questionnaire results. |
Improving Grounded Language Understanding in a Collaborative Environment by Interacting with Agents Through Help Feedback (2024.findings-eacl)
Copied to clipboard
| Challenge: | In many approaches to Natural Language Processing tasks, language is inherently interactive. |
| Approach: | They propose to use human-AI collaboration to improve human-human interaction by providing feedback that the agent can understand and utilize. |
| Outcome: | The proposed task is an interactive grounded language understanding task in a MineCraft-like world. |
A Speculative and Tentative Common Ground Handling for Efficient Composition of Uncertain Dialogue (2022.lrec-1)
Copied to clipboard
| Challenge: | a study explores how the grounding process is composed and adapts to human cognitive processes . common ground is a set of information shared among participants that serves as a precondition for understanding individual utterances . |
| Approach: | a study investigates how the grounding process is composed by participants . it suggests that common ground may not necessarily be formed bottom-up through analytic expressions . |
| Outcome: | a new approach to human-like dialogue may be more suitable for natural human communication, the authors say . they show that common ground is mutually accepted among participants through holistic expressions . |
CausalMACE: Causality Empowered Multi-Agents in Minecraft Cooperative Tasks (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work on multi-agent collaborative tasks in Minecraft is limited due to inefficiency and limited fault tolerance. |
| Approach: | They propose a framework that incorporates causality to manage dependencies among subtasks. |
| Outcome: | The proposed framework achieves state-of-the-art performance in multi-agent cooperative tasks of Minecraft. |
Dialogue Collection for Recording the Process of Building Common Ground in a Collaborative Task (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing studies on the process of building common ground have not been well conducted. |
| Approach: | They propose a method for recording the process of building common ground through a dialogue by using the intermediate result of a task. |
| Outcome: | The proposed method can record the building common ground process by using the intermediate result of a task and can be estimated quite accurately. |
Achieving Common Ground in Multi-modal Dialogue (2020.acl-tutorials)
Copied to clipboard
| Challenge: | tutorial focuses on three main topic areas: grounding in human-human communication, dialogue systems and multi-modal interactive systems. |
| Approach: | This tutorial examines the use of computational dialogue research to design grounding modules and behaviors in cutting-edge systems. |
| Outcome: | This tutorial examines the results of recent research on grounding in human-human communication . it shows how these results lead to rich and challenging opportunities for doing grounding more flexible and powerful ways . |
A Research Platform for Multi-Robot Dialogue with Humans (N19-4)
Copied to clipboard
Matthew Marge, Stephen Nogar, Cory J. Hayes, Stephanie M. Lukin, Jesse Bloecker, Eric Holder, Clare Voss
| Challenge: | a new research platform supports spoken dialogue interaction with multiple robots . a ground robot and an aerial robot are used to perform search and rescue tasks . |
| Approach: | They propose a platform that supports spoken dialogue interaction with multiple robots . they use existing tools for speech recognition and dialogue management . |
| Outcome: | The proposed platform supports spoken dialogue interaction with multiple robots in a search and rescue scenario. |