Papers with Builder
Collaborative Dialogue in Minecraft (P19-1)
Copied to clipboard
| Challenge: | Using computer games to simulate grounded situations, we want to develop interactive agents that can communicate with humans to solve tasks in grounded scenarios. |
| Approach: | They propose a Minecraft-based collaborative building task in which one player is shown a building structure and needs to instruct the other player to build it. |
| Outcome: | The proposed agent can communicate with humans to solve a building task in a Minecraft-based environment without the need for physical robots. |
Retrieval-Augmented Code Generation for Situated Action Generation: A Case Study on Minecraft (2024.findings-emnlp)
Copied to clipboard
| Challenge: | In the Minecraft Collaborative Building Task, two players collaborate to build a building using 3D blocks. |
| Approach: | They propose to use large language models to model the Builder's sequence of actions in the Minecraft Collaborative Building Task. |
| Outcome: | The proposed methods significantly improve performance over baseline methods and provide detailed analysis for future work. |