Papers by Torsten Wörtwein
Beyond Additive Fusion: Learning Non-Additive Multimodal Interactions (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Multimodal fusion addresses the problem of analyzing spoken words in the multimodal context, including visual expressions and prosodic cues. |
| Approach: | They propose to use multimodal fusion to separate unimodal, bimodal, and trimodal interactions in a multimodal model. |
| Outcome: | The proposed model separates unimodal, bimodal, and trimodal interactions while not degrading predictive performance. |