Papers by Simon Heck
mForms : Multimodal Form Filling with Question Answering (2024.lrec-main)
Copied to clipboard
| Challenge: | The paper presents a new approach to form-filling by reformulating the task as multimodal natural language Question Answering (QA). |
| Approach: | They propose a new approach to form-filling by reformulating the task as multimodal natural language Question Answering (QA) the paper introduces a multimodal form-filled dataset and an extension of the popular ATIS dataset to support future research and experimentation. |
| Outcome: | The proposed approach maintains robust accuracy for sparse training conditions and achieves state-of-the-art F1 of 0.97 on ATIS with approximately 1/10th the training data. |