Papers by Adams Kong
Unimodal and Crossmodal Refinement Network for Multimodal Sequence Fusion (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to modulate one modal feature to another are lacking in multimodal representation learning. |
| Approach: | They propose to use unimodal and crossmodal refinement networks to enhance uni and cross-modal representations by iterative updating of distributions with transformer-based attention layers to refine modality-specific learning. |
| Outcome: | The proposed network outperforms state-of-the-art techniques on MOSI and MOSEI datasets. |