Papers by Alvaro Herrasti
Iconary: A Pictionary-Based Game for Testing Multimodal Communication with Drawings and Text (2021.emnlp-main)
Copied to clipboard
Christopher Clark, Jordi Salvador, Dustin Schwenk, Derrick Bonafilia, Mark Yatskar, Eric Kolve, Alvaro Herrasti, Jonghyun Choi, Sachin Mehta, Sam Skjonsberg, Carissa Schoenick, Aaron Sarnat, Hannaneh Hajishirzi, Aniruddha Kembhavi, Oren Etzioni, Ali Farhadi
| Challenge: | Communicating with humans is challenging for AIs because of its complexity and multimodality. |
| Approach: | They propose to use a game of drawing and guessing based on Pictionary to test AIs' understanding of the world and multi-modal gestures. |
| Outcome: | The proposed game is a test for mixing language and visual/symbolic communication in AI. |