Papers by Yoonhyung Kim
Learning to Embed Multi-Modal Contexts for Situated Conversational Agents (2022.findings-naacl)
Copied to clipboard
Haeju Lee, Oh Joon Kwon, Yunseon Choi, Minho Park, Ran Han, Yoonhyung Kim, Jinhyeon Kim, Youngjune Lee, Haebin Shin, Kangwook Lee, Kee-Eung Kim
| Challenge: | Situated Interactive Multi-Modal Conversations 2.0 aims to create virtual shopping assistants that can accept complex multi-modal inputs. |
| Approach: | They propose a joint learning approach that integrates visual inputs and performs all four subtasks at once for efficiency. |
| Outcome: | The proposed approach won the 10th Dialog Systems Technology Challenge (DSTC10) . it incorporates visual inputs and performs all four subtasks at once for efficiency . |