Papers by Hatem Mousselly-Sergieh
Multimodal Frame Identification with Multilingual Evaluation (N18-1)
Copied to clipboard
| Challenge: | FrameNet Semantic Role Labeling aims to disambiguate situations around predicates using textual representations. |
| Approach: | They extend a frame identification task to leverage multimodal representations to improve FrameNet Semantic Role Labeling. |
| Outcome: | The proposed system outperforms its unimodal counterpart on the English frameNet and its German counterpart on IMAGINED words. |