Papers by Teresa Botschen
Multimodal Grounding for Language Processing (C18-1)
Copied to clipboard
| Challenge: | Recent developments in multimodal processing facilitate conceptual grounding of language. |
| Approach: | They analyze multimodal processing to examine the benefits and challenges of multimodal grounding . they focus on multimodal linguistic grounding of verbs which play a crucial role in compositional power of language. |
| Outcome: | The proposed methods improve the cognitive models of human information processing and address the challenges that arise. |
Multimodal Frame Identification with Multilingual Evaluation (N18-1)
Copied to clipboard
| Challenge: | FrameNet Semantic Role Labeling aims to disambiguate situations around predicates using textual representations. |
| Approach: | They extend a frame identification task to leverage multimodal representations to improve FrameNet Semantic Role Labeling. |
| Outcome: | The proposed system outperforms its unimodal counterpart on the English frameNet and its German counterpart on IMAGINED words. |