Papers by Shuhong Chen
Multimodal Affective Analysis Using Hierarchical Attention Strategy with Word-Level Alignment (P18-1)
Copied to clipboard
| Challenge: | Existing approaches to classify human affect and subjective information from multiple data sources are limited by the lack of high-level feature associations. |
| Approach: | They propose a hierarchical multimodal architecture with attention and word-level fusion to classify utterance-level sentiment and emotion from text and audio data. |
| Outcome: | The proposed model outperforms state-of-the-art approaches on published datasets and visualizes and interprets synchronized attention over modalities. |
Hybrid Attention based Multimodal Network for Spoken Language Classification (C18-1)
Copied to clipboard
| Challenge: | Using linguistic content and vocal characteristics for multimodal deep learning is difficult for computers to interpret human meaning . |
| Approach: | They propose a deep multimodal network with feature attention and modality attention to classify utterance-level speech data. |
| Outcome: | The proposed system achieves state-of-the-art or competitive results on three published multimodal datasets. |